-- Logs begin at Thu 2022-07-28 16:48:24 UTC, end at Thu 2022-07-28 18:11:42 UTC. -- Jul 28 17:40:50.003298 dv-cinder-813229-13-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 28 17:40:50.013555 dv-cinder-813229-13-smb devstack@keystone.service[80299]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 28 17:40:50.015920 dv-cinder-813229-13-smb devstack@keystone.service[80299]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 17:40:50 2022] *** Jul 28 17:40:50.015920 dv-cinder-813229-13-smb devstack@keystone.service[80299]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 17:40:50.015920 dv-cinder-813229-13-smb devstack@keystone.service[80299]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 17:40:50.015920 dv-cinder-813229-13-smb devstack@keystone.service[80299]: nodename: dv-cinder-813229-13-smb Jul 28 17:40:50.015920 dv-cinder-813229-13-smb devstack@keystone.service[80299]: machine: x86_64 Jul 28 17:40:50.015920 dv-cinder-813229-13-smb devstack@keystone.service[80299]: clock source: unix Jul 28 17:40:50.015920 dv-cinder-813229-13-smb devstack@keystone.service[80299]: pcre jit disabled Jul 28 17:40:50.015920 dv-cinder-813229-13-smb devstack@keystone.service[80299]: detected number of CPU cores: 4 Jul 28 17:40:50.015920 dv-cinder-813229-13-smb devstack@keystone.service[80299]: current working directory: / Jul 28 17:40:50.015920 dv-cinder-813229-13-smb devstack@keystone.service[80299]: detected binary path: /usr/bin/uwsgi-core Jul 28 17:40:50.015920 dv-cinder-813229-13-smb devstack@keystone.service[80299]: your processes number limit is 47680 Jul 28 17:40:50.016529 dv-cinder-813229-13-smb devstack@keystone.service[80299]: your memory page size is 4096 bytes Jul 28 17:40:50.016529 dv-cinder-813229-13-smb devstack@keystone.service[80299]: detected max file descriptor number: 2048 Jul 28 17:40:50.016529 dv-cinder-813229-13-smb devstack@keystone.service[80299]: lock engine: pthread robust mutexes Jul 28 17:40:50.016529 dv-cinder-813229-13-smb devstack@keystone.service[80299]: thunder lock: enabled Jul 28 17:40:50.016529 dv-cinder-813229-13-smb devstack@keystone.service[80299]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 28 17:40:50.016529 dv-cinder-813229-13-smb devstack@keystone.service[80299]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 17:40:50.058889 dv-cinder-813229-13-smb devstack@keystone.service[80299]: Python main interpreter initialized at 0x55e04e4e09c0 Jul 28 17:40:50.058889 dv-cinder-813229-13-smb devstack@keystone.service[80299]: python threads support enabled Jul 28 17:40:50.058889 dv-cinder-813229-13-smb devstack@keystone.service[80299]: your server socket listen backlog is limited to 100 connections Jul 28 17:40:50.058889 dv-cinder-813229-13-smb devstack@keystone.service[80299]: your mercy for graceful operations on workers is 90 seconds Jul 28 17:40:50.059277 dv-cinder-813229-13-smb devstack@keystone.service[80299]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 17:40:50.059350 dv-cinder-813229-13-smb devstack@keystone.service[80299]: *** Operational MODE: preforking *** Jul 28 17:40:50.059631 dv-cinder-813229-13-smb devstack@keystone.service[80299]: *** uWSGI is running in multiple interpreter mode *** Jul 28 17:40:50.059631 dv-cinder-813229-13-smb devstack@keystone.service[80299]: spawned uWSGI master process (pid: 80299) Jul 28 17:40:50.059848 dv-cinder-813229-13-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 28 17:40:50.060722 dv-cinder-813229-13-smb devstack@keystone.service[80299]: spawned uWSGI worker 1 (pid: 80309, cores: 1) Jul 28 17:40:50.060722 dv-cinder-813229-13-smb devstack@keystone.service[80299]: spawned uWSGI worker 2 (pid: 80310, cores: 1) Jul 28 17:40:50.060928 dv-cinder-813229-13-smb devstack@keystone.service[80299]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 17:40:55.500684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:40:55.500684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: from cryptography.utils import int_from_bytes Jul 28 17:40:55.501548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:40:55.501548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: from cryptography.utils import int_from_bytes Jul 28 17:40:55.501655 dv-cinder-813229-13-smb devstack@keystone.service[80309]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:40:55.501655 dv-cinder-813229-13-smb devstack@keystone.service[80309]: from cryptography.utils import int_from_bytes Jul 28 17:40:55.501655 dv-cinder-813229-13-smb devstack@keystone.service[80309]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:40:55.501655 dv-cinder-813229-13-smb devstack@keystone.service[80309]: from cryptography.utils import int_from_bytes Jul 28 17:40:55.550842 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 17:40:55.551048 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 17:40:55.551179 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] command line args: [] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 17:40:55.551487 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 17:40:55.551617 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 17:40:55.551704 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ================================================================================ {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 17:40:55.551765 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 17:40:55.551895 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] admin_token = **** {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.551979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] command line args: [] {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 17:40:55.552217 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] config_dir = [] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.552364 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 17:40:55.552458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.552538 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ================================================================================ {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 17:40:55.552684 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] admin_token = **** {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.552781 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] config_source = [] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.552853 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] config_dir = [] {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.553022 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] debug = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.553162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.553238 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] config_source = [] {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.553313 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.553604 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] debug = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.553604 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.553816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.553889 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.553991 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.554249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.554380 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.554682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.554794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.554794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] list_limit = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.555018 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] log_config_append = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.555147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.555237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.555368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] log_dir = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.555465 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] list_limit = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.555600 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] log_config_append = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.555688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] log_file = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.555811 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.555956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] log_dir = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.556033 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.556171 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] log_file = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.556423 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.556543 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.556657 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.556943 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.557095 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.557236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.557322 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.557481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.557591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.557665 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.557860 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.558080 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.558200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.558358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.558493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.558574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.558827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.558946 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.559024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.559321 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.559451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.559588 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.559711 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.559849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.560126 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.560211 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.560455 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.560712 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.560928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.96/identity {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.561033 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.561289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] publish_errors = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.561547 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.96/identity {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.561707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.561794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] publish_errors = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.562025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.562109 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.562184 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.562460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.562543 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.562705 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.562808 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.562949 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] standard_threads = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.563175 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.563323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.563507 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.563723 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.563844 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.563968 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] standard_threads = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.564092 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] use_journal = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.564092 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] use_json = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.564335 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.564462 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] use_stderr = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.564579 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.564696 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] use_syslog = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.564826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.564953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.565140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] use_journal = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.565140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] use_json = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.565365 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.565488 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] use_stderr = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.565606 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.565729 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] use_syslog = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.565729 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:40:55.565981 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.566108 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.566245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.566373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.566497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.566497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.566741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.566877 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.566877 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.567106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.567226 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.567360 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.567498 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.567630 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.567756 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.567892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.568018 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.568162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.568290 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.568425 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.568550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.568690 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.568815 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.568958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.569112 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.569239 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.569361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.569495 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.569630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.569880 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.570008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.570136 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.570271 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.570398 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.570522 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.570656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.570791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.570912 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.571047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.571176 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.571322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.571462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.571596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.571722 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.571845 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.571971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.572093 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.572224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.572359 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.572477 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.572598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.572732 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.572867 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.573013 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.573186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.573316 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.573442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.573567 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.573704 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.573829 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.573954 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.574077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.574194 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.574319 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.574462 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.574600 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.574723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.574849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.574980 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.575110 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.575249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.575385 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.575514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.575634 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.575758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.575887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.576124 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.576250 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.576374 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.576374 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.576611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.576611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.576856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.576996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.577154 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.577280 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.577405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.577539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.577676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.577803 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.577925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.578051 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.578186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.578314 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.578451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.578578 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.578702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.578826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.578953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.579076 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.579213 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.579333 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.579501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.579636 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.579777 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.579777 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.580010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.580010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.580200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.580200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.580522 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.580522 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.580783 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.580783 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.581005 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.581221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.581367 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.581512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.581661 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.581661 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.581901 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.582112 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.582243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.582243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.582607 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.582758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.582888 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.583016 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.583150 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.583418 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.583549 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.583676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.583811 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.583811 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.584053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.584185 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.584313 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.584453 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.584582 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.584582 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.584720 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.584839 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.584915 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.584993 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.585078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.585149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.585220 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.585288 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.585367 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.585445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.585515 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.585583 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.585703 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.585778 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.585846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.585846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.585978 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.586046 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.586113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.586113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.586234 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.586312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.586381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.586454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.586528 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.586597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.586664 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.586738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.586808 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.586881 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.586949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.587017 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.587084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.587227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.587300 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.587368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.587435 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.587501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.587568 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.587642 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.587722 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.587802 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.587872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.587939 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.588006 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.588155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.588261 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.588339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.588410 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.588477 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.588545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.588612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.588679 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.588753 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.588822 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.588895 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.588965 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.589032 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.589128 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.589206 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.589276 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.589343 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] auth.external = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.589410 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.589477 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.589551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.589620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.589689 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.589756 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.589823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.589897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] auth.password = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.589973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.590073 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] auth.token = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.590156 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] auth.external = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.590303 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.590426 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.590504 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.590653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.590777 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.590867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.590944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.591112 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] auth.password = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.591235 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.591312 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] auth.token = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.591458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.591647 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.591733 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.591806 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.591875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] credential.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.592033 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.592158 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.592259 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.592334 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.592506 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.592629 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.592732 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.592826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.592994 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.593176 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.593256 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] credential.caching = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.593328 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.593496 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.593619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.593715 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.593791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.593986 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.594111 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.594190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.594261 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.594462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.594585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.594663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.594770 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.594960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.595096 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.595185 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.595259 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.595429 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.595518 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.595681 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.595772 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] federation.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.595975 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.596056 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.596226 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.596309 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.596475 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.596556 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.596707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.596789 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.596958 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.597039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.597225 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] federation.caching = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.597306 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.597467 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.597549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.597703 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.597783 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.597955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.598041 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.598189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.598269 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.598438 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.598519 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.598679 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.598759 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.598952 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.599032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.599205 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.599339 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.599559 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.599712 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.599787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.599857 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.599926 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.600068 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.600149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.600293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] identity.caching = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.600371 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.600557 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.600634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.600813 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.600889 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.601052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.601149 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.601308 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.601384 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.601544 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.601623 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.601788 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.601908 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.602031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.602115 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.602276 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.602354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.602530 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.602611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.602768 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.602846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.603003 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.603080 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.603241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.603320 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.603487 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.603564 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.603722 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.603800 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.603962 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.604041 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.604214 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.604299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.604428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.604507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.604671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.604751 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.604913 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.604991 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.605185 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.605265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.605421 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.605500 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.605661 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.605738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.605896 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.605977 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.606135 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.606214 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.606378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.606454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.606659 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.606751 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.606855 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.606935 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.607094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.607172 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.607324 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.607411 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.607563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.607642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.607804 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.607882 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.608044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.608121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.608281 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.608360 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.608514 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.608590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.608755 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.608840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.608991 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.609090 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.609246 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.609322 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.609477 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.609568 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.609722 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.609801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.609963 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.610041 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.610197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.610274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.610435 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.610514 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.610669 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.610747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.610901 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.610979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.611131 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.611209 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.611385 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.611463 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.611615 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.611699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.611860 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.611936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.612098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.612175 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.612336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.612422 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.612569 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.612646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.user = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.612800 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.612877 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.613038 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.613208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.613341 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.613428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.613556 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.613634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.613789 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.613874 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.614037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.614115 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.614273 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.614349 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.614559 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.614656 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.614816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.614947 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.615199 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.615319 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.615428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.615568 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.615675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.615806 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.615923 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.616058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.616136 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.616307 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.616386 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.616555 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.616633 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.616824 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.616935 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.617090 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.617214 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.617332 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.617535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.617638 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.617712 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.617792 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.617956 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.618035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.618196 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.618274 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.618438 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.618525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.618678 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.618756 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.618926 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.619004 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.619171 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.619256 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.619404 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.619483 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.619643 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.619721 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.619881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.619968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] resource.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.620129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.620206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.620368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.620445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.620602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.620687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.620842 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.620918 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.621109 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.621189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.621350 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.621439 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.621581 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.621658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.621820 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.621896 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.622060 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] resource.caching = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.622145 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.622293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] role.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.622369 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.622539 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] role.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.622616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.622769 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.622926 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.623021 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.623097 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.623267 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.623344 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.623505 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.623590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.623749 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.623826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.623986 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.624063 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.624230 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.624315 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.624465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] role.caching = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.624541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.624712 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.624789 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] role.driver = sql {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.624945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.625023 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.625214 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.625293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.625466 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.625543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.625713 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.625792 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.625971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.626050 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.626212 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.626392 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.626479 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.626630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.626709 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.626881 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.626959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.627131 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.627217 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.627380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.627458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.627631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.627709 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.627866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.627953 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.628115 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.628191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.628366 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.628541 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.628619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.628829 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.628986 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.629106 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.629306 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.629557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.629813 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.630084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.630169 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.630327 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.630453 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.630563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.630640 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.630779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.630898 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.631013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] token.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.631092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.631249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.631336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.631497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.631575 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.631735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.631812 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.631989 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.632076 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.632236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.632314 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.632469 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.632546 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.632711 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.632797 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.632956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.633034 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.633225 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.633307 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.633462 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.633553 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.633698 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.633775 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.633931 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.634007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.634169 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] token.caching = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.634254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.634411 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.634489 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.634640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.634715 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.634884 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.634969 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.635139 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.635217 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.635391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.635468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] database.connection = **** {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.635632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.635719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.635879 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.635965 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.636123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.636199 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.636365 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.636443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.636602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.636687 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.636838 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.636915 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.637128 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.637212 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.637328 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.637417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.637573 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.637651 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.637802 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.637885 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.638049 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.638135 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.638265 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.638344 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.638512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.638590 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] database.connection = **** {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.638746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.638832 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.638989 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.639412 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.639570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.639647 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.639813 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.639890 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.640049 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.640127 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.640218 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 17:40:55.640296 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.640530 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.640771 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.641019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.641282 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.641530 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.641768 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.642018 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.642257 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.642505 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.642740 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.642982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.643220 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:40:55.643392 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 17:40:55.669618 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.669813 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.670046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.671774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.672012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.672242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.678386 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.680911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.707974 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.708152 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.709612 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.709848 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.765155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.767358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.815701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.815903 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.816018 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.816289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.881370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.881549 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.881810 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.882032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.882252 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.882373 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.882443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.882522 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.882724 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.882948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.883171 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.883397 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.906011 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.906154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.906403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.906521 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.906591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.906651 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.906723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.906794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.906866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.906971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.907058 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.907242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.907364 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.907522 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.918655 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.919126 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.931870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.932012 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.932224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.932318 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.932439 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.932520 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.932636 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.932726 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.932870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.932951 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.933086 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.933165 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.933285 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.933378 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:40:55.950510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.950714 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 17:40:55.950839 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.951043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.951155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 17:40:55.951222 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 17:40:55.951387 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.951476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.951575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 17:40:55.951763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.951888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.951970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.952134 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.952256 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.952371 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.952651 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.962024 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.962314 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.962583 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.962707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.962835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.962997 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.963261 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.963542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.969758 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:55.970415 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:55.974666 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:55.974960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.975244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.975531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.975816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.975959 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:55.976044 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.976119 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.976330 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.976455 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.976548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.976638 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.976861 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.976987 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.977124 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.977213 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.977436 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.977563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.977763 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.978034 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.978303 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:55.978554 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.001344 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.002569 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.002837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.003121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.004058 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.004336 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.008133 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.008412 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.008696 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.009441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.009706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.009984 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.015725 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.015898 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.016907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.017217 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.020429 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.020727 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.021212 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.021506 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.021785 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.021907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.022065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.022200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.022362 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.022499 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.022620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.022758 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.022910 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.023170 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.023444 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.023736 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.038594 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.038928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.040085 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.040375 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.042850 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.044321 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.046011 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.046318 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.047494 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.047780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.050700 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.052393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.053944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.055611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.057225 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.057534 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.057813 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.058102 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.058382 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.058675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.058876 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.059167 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.059441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.059807 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.060035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.060317 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.074798 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.075081 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.075351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.075615 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.076474 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.076762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.077032 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.077323 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.082483 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.084147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.084522 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.084657 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.086115 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.086393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.088513 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.088997 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.089232 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.089478 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.089605 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.089804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.089927 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.090090 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.090326 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.090456 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.102240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.102502 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.102731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.102818 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.102881 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.103050 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.103176 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.103329 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.103452 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.103600 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.103739 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.103856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.103947 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.104227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.119938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.120137 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.123045 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.123169 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.126000 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.127366 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.128567 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.128840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.130300 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.130429 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.130713 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.130800 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.130948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.131106 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.137592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.137716 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.139373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.139571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.142360 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.142486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.142630 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.142758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.142881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.143058 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.143147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.143271 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.151307 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.151598 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.151792 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.151885 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.152025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.152150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.158721 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.159000 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.159124 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:40:56.159269 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.159415 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.159569 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.159672 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.159808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.159931 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.160069 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.160149 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.160350 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.160542 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.160639 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.160770 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.160951 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.161168 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.161297 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.161545 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.161644 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.161823 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.161960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.162089 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.162214 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.162339 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.162465 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.162729 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.163004 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:40:56.195999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e04e4e09c0 pid: 80309 (default app) Jul 28 17:40:56.197316 dv-cinder-813229-13-smb devstack@keystone.service[80310]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e04e4e09c0 pid: 80310 (default app) Jul 28 17:40:56.199570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61b611-946c-414f-9ba6-337d97d06459 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:40:56.199868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61b611-946c-414f-9ba6-337d97d06459 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:40:56.200144 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61b611-946c-414f-9ba6-337d97d06459 None None] PATH_INFO: `/v3` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:40:56.204381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1/1] 10.222.0.96 () {50 vars in 791 bytes} [Thu Jul 28 17:40:56 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:03.923417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2ff7c-91c7-4100-8c92-e760530742c4 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:03.924367 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2ff7c-91c7-4100-8c92-e760530742c4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:03.924367 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2ff7c-91c7-4100-8c92-e760530742c4 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:03.930761 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1/2] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:03 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:03.937892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556a4f5-2f58-4218-907b-5f466b8789a4 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:03.938357 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556a4f5-2f58-4218-907b-5f466b8789a4 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:03.938448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556a4f5-2f58-4218-907b-5f466b8789a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:04.017309 dv-cinder-813229-13-smb devstack@keystone.service[80309]: INFO dbcounter [None req-2556a4f5-2f58-4218-907b-5f466b8789a4 None None] Registered counter for database keystone Jul 28 17:41:04.042457 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG oslo_db.sqlalchemy.engines [None req-2556a4f5-2f58-4218-907b-5f466b8789a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80309) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:41:04.053860 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writer thread running {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:41:04.239376 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG passlib.handlers.bcrypt [None req-2556a4f5-2f58-4218-907b-5f466b8789a4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80309) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 17:41:04.239700 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG passlib.handlers.bcrypt [None req-2556a4f5-2f58-4218-907b-5f466b8789a4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80309) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 17:41:04.300111 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-2556a4f5-2f58-4218-907b-5f466b8789a4 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:04.302965 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-2556a4f5-2f58-4218-907b-5f466b8789a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:04.443410 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 2/3] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 17:41:04.600097 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2ff7c-91c7-4100-8c92-e760530742c4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:04.676053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: INFO dbcounter [None req-38d2ff7c-91c7-4100-8c92-e760530742c4 None None] Registered counter for database keystone Jul 28 17:41:04.697261 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG oslo_db.sqlalchemy.engines [None req-38d2ff7c-91c7-4100-8c92-e760530742c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:41:04.709494 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writer thread running {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:41:04.831843 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2ff7c-91c7-4100-8c92-e760530742c4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:04.837682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a2797-f088-4f77-9cac-b605d13e7787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:04.838357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a2797-f088-4f77-9cac-b605d13e7787 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:04.838624 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a2797-f088-4f77-9cac-b605d13e7787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:04.838895 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a2797-f088-4f77-9cac-b605d13e7787 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:04.847783 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a2797-f088-4f77-9cac-b605d13e7787 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:04.900209 dv-cinder-813229-13-smb devstack@keystone.service[80310]: WARNING keystone.common.rbac_enforcer.enforcer [None req-225a2797-f088-4f77-9cac-b605d13e7787 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 17:41:04.900475 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a2797-f088-4f77-9cac-b605d13e7787 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:04.911286 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 2/4] 10.222.0.96 () {58 vars in 1324 bytes} [Thu Jul 28 17:41:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 17:41:04.917889 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556a4f5-2f58-4218-907b-5f466b8789a4 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:04.933475 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556a4f5-2f58-4218-907b-5f466b8789a4 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:04.939163 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ad223-9cc9-4cfd-8af7-8ffd7a9f437e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:04.940315 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ad223-9cc9-4cfd-8af7-8ffd7a9f437e admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:04.940606 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ad223-9cc9-4cfd-8af7-8ffd7a9f437e admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:04.940879 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ad223-9cc9-4cfd-8af7-8ffd7a9f437e admin admin] PATH_INFO: `/v3/projects/84ce091dd3714924a52d3b36bdfb30f4` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:04.942484 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ad223-9cc9-4cfd-8af7-8ffd7a9f437e admin admin] RBAC: Authorizing `identity:get_project(project_id=84ce091dd3714924a52d3b36bdfb30f4)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:04.992747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ae4ad223-9cc9-4cfd-8af7-8ffd7a9f437e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 17:41:04.993115 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ad223-9cc9-4cfd-8af7-8ffd7a9f437e admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:04.997839 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 3/5] 10.222.0.96 () {56 vars in 1207 bytes} [Thu Jul 28 17:41:04 2022] GET /identity/v3/projects/84ce091dd3714924a52d3b36bdfb30f4 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:07.185996 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b37bc6-5f04-4a2e-8c20-734368ba292a None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:07.186579 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b37bc6-5f04-4a2e-8c20-734368ba292a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:07.186579 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b37bc6-5f04-4a2e-8c20-734368ba292a None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:07.192342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 3/6] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:07.198189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a36b5b-1fed-499e-a95c-850a4f2b41c9 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:07.198612 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a36b5b-1fed-499e-a95c-850a4f2b41c9 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:07.198711 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a36b5b-1fed-499e-a95c-850a4f2b41c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:07.220703 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-21a36b5b-1fed-499e-a95c-850a4f2b41c9 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:07.222275 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-21a36b5b-1fed-499e-a95c-850a4f2b41c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:07.232476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 4/7] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 17:41:07.256336 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b37bc6-5f04-4a2e-8c20-734368ba292a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:07.279640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b37bc6-5f04-4a2e-8c20-734368ba292a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:07.287788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfb6c0-72bb-4d52-8fb9-850c60f8d6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:07.288414 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfb6c0-72bb-4d52-8fb9-850c60f8d6ac admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:07.288695 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfb6c0-72bb-4d52-8fb9-850c60f8d6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:07.288976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfb6c0-72bb-4d52-8fb9-850c60f8d6ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:07.297905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfb6c0-72bb-4d52-8fb9-850c60f8d6ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:07.299716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfb6c0-72bb-4d52-8fb9-850c60f8d6ac admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:07.309467 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 4/8] 10.222.0.96 () {58 vars in 1324 bytes} [Thu Jul 28 17:41:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 17:41:07.318488 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a36b5b-1fed-499e-a95c-850a4f2b41c9 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:07.329966 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a36b5b-1fed-499e-a95c-850a4f2b41c9 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:07.339830 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73927ac-1ab2-42c4-8d25-a2528de908d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:07.340778 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73927ac-1ab2-42c4-8d25-a2528de908d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:07.341284 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73927ac-1ab2-42c4-8d25-a2528de908d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:07.341664 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73927ac-1ab2-42c4-8d25-a2528de908d0 admin admin] PATH_INFO: `/v3/users/139abd87c3e347d299314e22a7c95f3f` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:07.344104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73927ac-1ab2-42c4-8d25-a2528de908d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=139abd87c3e347d299314e22a7c95f3f)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:07.347099 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73927ac-1ab2-42c4-8d25-a2528de908d0 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:07.349510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 5/9] 10.222.0.96 () {56 vars in 1198 bytes} [Thu Jul 28 17:41:07 2022] GET /identity/v3/users/139abd87c3e347d299314e22a7c95f3f => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:09.415229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832c3ab-a199-499e-a9d1-7aeb9543a6db None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:09.415771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832c3ab-a199-499e-a9d1-7aeb9543a6db None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:09.415771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832c3ab-a199-499e-a9d1-7aeb9543a6db None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:09.417077 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 5/10] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:09.422473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e93226-17f9-4e72-bf3d-e672685bc88b None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:09.422874 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e93226-17f9-4e72-bf3d-e672685bc88b None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:09.423058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e93226-17f9-4e72-bf3d-e672685bc88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:09.438238 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a77049-1b74-4c20-abb9-2c0185156f11 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:09.438752 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a77049-1b74-4c20-abb9-2c0185156f11 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:09.439025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a77049-1b74-4c20-abb9-2c0185156f11 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:09.440367 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 6/11] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:41:09.444877 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-a1e93226-17f9-4e72-bf3d-e672685bc88b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:09.445346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be806fc4-583f-471a-b71e-23619daf4a7b None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:09.445629 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be806fc4-583f-471a-b71e-23619daf4a7b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:09.445898 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be806fc4-583f-471a-b71e-23619daf4a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:09.446141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-a1e93226-17f9-4e72-bf3d-e672685bc88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:09.486984 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG passlib.handlers.bcrypt [None req-be806fc4-583f-471a-b71e-23619daf4a7b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80310) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 17:41:09.487438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG passlib.handlers.bcrypt [None req-be806fc4-583f-471a-b71e-23619daf4a7b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80310) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 17:41:09.530953 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 6/12] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:09.532731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-be806fc4-583f-471a-b71e-23619daf4a7b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:09.534378 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-be806fc4-583f-471a-b71e-23619daf4a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:09.555049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e93226-17f9-4e72-bf3d-e672685bc88b None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:09.580241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:09.634033 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 7/13] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:41:09.656067 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be806fc4-583f-471a-b71e-23619daf4a7b None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:09.663538 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e93226-17f9-4e72-bf3d-e672685bc88b None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:09.698152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99713cc7-5ada-4523-adc0-053d42483018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:09.698719 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99713cc7-5ada-4523-adc0-053d42483018 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:09.699000 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99713cc7-5ada-4523-adc0-053d42483018 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:09.699254 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99713cc7-5ada-4523-adc0-053d42483018 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:09.710578 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99713cc7-5ada-4523-adc0-053d42483018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:09.719448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-99713cc7-5ada-4523-adc0-053d42483018 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:41:09.719448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:09.719448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:09.719448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:09.719448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:09.719448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:09.719448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:09.719448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:09.719448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:09.719448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:09.719448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:09.719448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:09.719448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:09.719448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:09.719448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:09.719448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:09.720373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:09.720373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:09.720373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:09.720373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:09.720373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:09.720373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:09.720373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:09.720373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:09.720373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:09.720373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:09.720373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:09.720373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:09.720373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:09.720373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:09.720373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:09.720373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:09.721349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:09.721349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:09.721349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:09.721349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:09.721349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:09.721349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:09.721349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:09.721349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:09.721349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:09.721349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:09.721349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:41:09.721349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:09.721349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 7/14] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:41:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:41:09.726804 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99713cc7-5ada-4523-adc0-053d42483018 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:09.764884 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be806fc4-583f-471a-b71e-23619daf4a7b None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:09.767329 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:09.805253 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992be92-4f15-4ef9-95a8-568bb4e48be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:09.806248 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992be92-4f15-4ef9-95a8-568bb4e48be4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:09.806596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992be92-4f15-4ef9-95a8-568bb4e48be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:09.806879 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992be92-4f15-4ef9-95a8-568bb4e48be4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:09.814138 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:09.833033 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99713cc7-5ada-4523-adc0-053d42483018 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:09.867870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff399f-11cc-4ba0-b3ab-1e6983cea787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:09.868492 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff399f-11cc-4ba0-b3ab-1e6983cea787 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:09.868772 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff399f-11cc-4ba0-b3ab-1e6983cea787 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:09.869044 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff399f-11cc-4ba0-b3ab-1e6983cea787 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:09.869819 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff399f-11cc-4ba0-b3ab-1e6983cea787 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:09.870131 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff399f-11cc-4ba0-b3ab-1e6983cea787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:09.871557 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff399f-11cc-4ba0-b3ab-1e6983cea787 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:09.875864 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992be92-4f15-4ef9-95a8-568bb4e48be4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:09.877424 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992be92-4f15-4ef9-95a8-568bb4e48be4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:09.883770 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 8/15] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:09.889988 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff399f-11cc-4ba0-b3ab-1e6983cea787 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:09.982843 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 8/16] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:41:09.989004 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992be92-4f15-4ef9-95a8-568bb4e48be4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:09.992508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:10.099535 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992be92-4f15-4ef9-95a8-568bb4e48be4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:10.107258 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff399f-11cc-4ba0-b3ab-1e6983cea787 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:10.137455 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26829de1-b9d8-45d6-91d8-a40a8b179298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:10.138320 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26829de1-b9d8-45d6-91d8-a40a8b179298 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:10.138599 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26829de1-b9d8-45d6-91d8-a40a8b179298 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:10.138874 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26829de1-b9d8-45d6-91d8-a40a8b179298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:10.141395 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7b5fc-e98c-4498-b497-b431c5aa04a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:10.142044 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7b5fc-e98c-4498-b497-b431c5aa04a3 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:10.142325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7b5fc-e98c-4498-b497-b431c5aa04a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:10.142602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7b5fc-e98c-4498-b497-b431c5aa04a3 None admin] PATH_INFO: `/v3/users/139abd87c3e347d299314e22a7c95f3f` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:10.143783 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7b5fc-e98c-4498-b497-b431c5aa04a3 None admin] RBAC: Authorizing `identity:get_user(user_id=139abd87c3e347d299314e22a7c95f3f)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:10.145273 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7b5fc-e98c-4498-b497-b431c5aa04a3 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:10.147500 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 9/17] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:09 2022] GET /identity/v3/users/139abd87c3e347d299314e22a7c95f3f => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:10.152953 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7b5fc-e98c-4498-b497-b431c5aa04a3 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:10.157676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26829de1-b9d8-45d6-91d8-a40a8b179298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:10.159181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26829de1-b9d8-45d6-91d8-a40a8b179298 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:10.169196 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:10.179856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-26829de1-b9d8-45d6-91d8-a40a8b179298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:41:10.179856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:10.179856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:10.179856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:10.179856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:10.179856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:10.179856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:10.179856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:10.179856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:10.179856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:10.179856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:10.179856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:10.179856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:41:10.179856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:41:10.179856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:41:10.180684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:41:10.180684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:10.180684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:10.180684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:10.180684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:10.180684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:10.180684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:10.180684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:10.180684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:10.180684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:10.180684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:10.180684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:10.180684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:10.180684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:10.180684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:10.180684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:10.180684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:10.181514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:41:10.181514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:41:10.181514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:41:10.181514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:41:10.181514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 9/18] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:41:10.186941 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26829de1-b9d8-45d6-91d8-a40a8b179298 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:10.245198 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:10.258268 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7b5fc-e98c-4498-b497-b431c5aa04a3 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:10.293359 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b03181-0fe7-49cc-837a-a220c4108c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:10.293556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26829de1-b9d8-45d6-91d8-a40a8b179298 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:10.294008 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b03181-0fe7-49cc-837a-a220c4108c96 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:10.294286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b03181-0fe7-49cc-837a-a220c4108c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:10.294558 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b03181-0fe7-49cc-837a-a220c4108c96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:10.295732 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b03181-0fe7-49cc-837a-a220c4108c96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:10.297235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b03181-0fe7-49cc-837a-a220c4108c96 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:10.298815 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 10/19] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:41:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:10.304794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b03181-0fe7-49cc-837a-a220c4108c96 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:10.331942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28b159-84b5-4a04-8676-6b9d701c4a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:10.332658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28b159-84b5-4a04-8676-6b9d701c4a3b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:10.332935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28b159-84b5-4a04-8676-6b9d701c4a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:10.333346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28b159-84b5-4a04-8676-6b9d701c4a3b None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:10.334039 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28b159-84b5-4a04-8676-6b9d701c4a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:10.334393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28b159-84b5-4a04-8676-6b9d701c4a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:10.335802 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28b159-84b5-4a04-8676-6b9d701c4a3b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:10.353139 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 10/20] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:10.388162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:10.412939 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b03181-0fe7-49cc-837a-a220c4108c96 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:10.451452 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fca105-9320-4855-8d66-441443b791c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:10.452167 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fca105-9320-4855-8d66-441443b791c4 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:10.452372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fca105-9320-4855-8d66-441443b791c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:10.452647 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fca105-9320-4855-8d66-441443b791c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:10.453520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fca105-9320-4855-8d66-441443b791c4 None admin] RBAC: Adding query filter params (role.id=980cae90acae42189f92fd6dd42867a5, scope.domain.id=default, user.id=139abd87c3e347d299314e22a7c95f3f) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:10.453828 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fca105-9320-4855-8d66-441443b791c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:10.455336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fca105-9320-4855-8d66-441443b791c4 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:10.463822 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 11/21] 10.222.0.96 () {56 vars in 1322 bytes} [Thu Jul 28 17:41:10 2022] GET /identity/v3/role_assignments?user.id=139abd87c3e347d299314e22a7c95f3f&scope.domain.id=default&role.id=980cae90acae42189f92fd6dd42867a5 => generated 233 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:12.893862 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79295b-55cf-4cbc-8298-88c34e68af1e None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:12.894382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79295b-55cf-4cbc-8298-88c34e68af1e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:12.894382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79295b-55cf-4cbc-8298-88c34e68af1e None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:12.896136 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 11/22] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:12.901483 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2342fb0-4501-46cc-b1e5-4f8ad3239164 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:12.902293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2342fb0-4501-46cc-b1e5-4f8ad3239164 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:12.902789 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2342fb0-4501-46cc-b1e5-4f8ad3239164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:12.920237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edafad-c1dc-4d24-b4e2-3adecb6e6402 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:12.920893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edafad-c1dc-4d24-b4e2-3adecb6e6402 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:12.921395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edafad-c1dc-4d24-b4e2-3adecb6e6402 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:12.922943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 12/23] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:41:12.929137 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16696096-3cce-4579-82b9-8d0b417b0489 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:12.929721 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16696096-3cce-4579-82b9-8d0b417b0489 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:12.930192 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16696096-3cce-4579-82b9-8d0b417b0489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:12.942246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-e2342fb0-4501-46cc-b1e5-4f8ad3239164 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:12.949104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e2342fb0-4501-46cc-b1e5-4f8ad3239164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:12.966814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-16696096-3cce-4579-82b9-8d0b417b0489 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:12.968344 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-16696096-3cce-4579-82b9-8d0b417b0489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:13.093726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 12/24] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:13.096266 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cadc64-3e03-495a-a40a-9af90bf9fb69 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:13.097972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cadc64-3e03-495a-a40a-9af90bf9fb69 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:13.099286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cadc64-3e03-495a-a40a-9af90bf9fb69 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:13.101796 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 13/25] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:13.108238 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2d52b-d97d-47c7-a204-3e4ce2504c6d None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:13.108775 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2d52b-d97d-47c7-a204-3e4ce2504c6d None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:13.109290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2d52b-d97d-47c7-a204-3e4ce2504c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:13.113941 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 13/26] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:41:13.129763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-79a2d52b-d97d-47c7-a204-3e4ce2504c6d None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:13.131655 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-79a2d52b-d97d-47c7-a204-3e4ce2504c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:13.151899 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16696096-3cce-4579-82b9-8d0b417b0489 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:13.234203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:13.261491 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 14/27] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:41:13.263768 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2d52b-d97d-47c7-a204-3e4ce2504c6d None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:13.273507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:13.340491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16696096-3cce-4579-82b9-8d0b417b0489 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:13.391962 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b58a6-4a46-47bd-8aa0-dd26dc5b5a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:13.392636 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b58a6-4a46-47bd-8aa0-dd26dc5b5a26 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:13.393186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b58a6-4a46-47bd-8aa0-dd26dc5b5a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:13.393476 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b58a6-4a46-47bd-8aa0-dd26dc5b5a26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:13.405367 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b58a6-4a46-47bd-8aa0-dd26dc5b5a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:13.408080 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b58a6-4a46-47bd-8aa0-dd26dc5b5a26 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:13.425161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-fa1b58a6-4a46-47bd-8aa0-dd26dc5b5a26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:41:13.425161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:13.425161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:13.425161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:13.425161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:13.425161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:13.425161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:13.425161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:13.425161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:13.425161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:13.425161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:13.425161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:13.425161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:41:13.425161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:41:13.425161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:41:13.426200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:41:13.426200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:13.426200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:13.426200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:13.426200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:13.426200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:13.426200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:13.426200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:13.426200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:13.426200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:13.426200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:13.426200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:13.426200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:13.426200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:13.426200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:13.426200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:13.426200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:13.427178 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:41:13.427178 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:41:13.427178 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:41:13.427178 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:41:13.428980 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 14/28] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:41:13.430109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b58a6-4a46-47bd-8aa0-dd26dc5b5a26 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:13.492303 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2d52b-d97d-47c7-a204-3e4ce2504c6d None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:13.533006 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cc327-023a-4512-a6cb-e322e35af97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:13.534028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cc327-023a-4512-a6cb-e322e35af97e None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:13.534539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cc327-023a-4512-a6cb-e322e35af97e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:13.535006 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cc327-023a-4512-a6cb-e322e35af97e None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:13.535928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cc327-023a-4512-a6cb-e322e35af97e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:13.537427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:13.537873 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cc327-023a-4512-a6cb-e322e35af97e None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:13.540353 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b58a6-4a46-47bd-8aa0-dd26dc5b5a26 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:13.671691 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 15/29] 10.222.0.96 () {60 vars in 1131 bytes} [Thu Jul 28 17:41:13 2022] POST /identity/v3/roles => generated 219 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:41:13.678329 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cc327-023a-4512-a6cb-e322e35af97e None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:13.708099 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3166e0-77ff-4a64-bde2-e7a436d00ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:13.709787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3166e0-77ff-4a64-bde2-e7a436d00ece None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:13.710124 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3166e0-77ff-4a64-bde2-e7a436d00ece None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:13.710427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3166e0-77ff-4a64-bde2-e7a436d00ece None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:13.734776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3166e0-77ff-4a64-bde2-e7a436d00ece None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:13.742808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-2f3166e0-77ff-4a64-bde2-e7a436d00ece None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:41:13.742808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:13.742808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:13.742808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:13.742808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:13.742808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:13.742808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:13.742808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:13.742808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:13.742808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:13.742808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:13.742808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:13.742808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:13.742808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:13.742808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:13.742808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:13.743897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:13.743897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:13.743897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:13.743897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:13.743897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:13.743897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:13.743897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:13.743897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:13.743897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:13.743897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:13.743897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:13.743897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:13.743897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:13.743897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:13.743897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:13.743897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:13.744803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:13.744803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:13.744803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:13.744803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:13.744803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:13.744803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:13.744803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:13.744803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:13.744803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:13.744803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:13.744803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:41:13.744803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:41:13.746867 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 15/30] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:41:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:13.748303 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5687c0-2767-4e55-9ed5-936348129d85 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:13.748726 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5687c0-2767-4e55-9ed5-936348129d85 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:13.749175 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5687c0-2767-4e55-9ed5-936348129d85 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:13.750540 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 16/31] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:13.751705 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371b990-2221-486e-8aa9-6de001b528a3 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:13.751952 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371b990-2221-486e-8aa9-6de001b528a3 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:13.752220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371b990-2221-486e-8aa9-6de001b528a3 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:13.753392 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 17/32] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:13.762612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63c06b-da1a-4d42-9f0a-108808c63195 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:13.762877 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63c06b-da1a-4d42-9f0a-108808c63195 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:13.763381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63c06b-da1a-4d42-9f0a-108808c63195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:13.789876 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-8b63c06b-da1a-4d42-9f0a-108808c63195 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:13.791586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8b63c06b-da1a-4d42-9f0a-108808c63195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:13.792346 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:13.839223 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cc327-023a-4512-a6cb-e322e35af97e None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:13.880452 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ffc9e-0348-4d1b-a16e-72f3a1438bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:13.881558 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ffc9e-0348-4d1b-a16e-72f3a1438bff None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:13.882287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ffc9e-0348-4d1b-a16e-72f3a1438bff None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:13.882721 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ffc9e-0348-4d1b-a16e-72f3a1438bff None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:13.884159 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ffc9e-0348-4d1b-a16e-72f3a1438bff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:13.884613 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ffc9e-0348-4d1b-a16e-72f3a1438bff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:13.886391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ffc9e-0348-4d1b-a16e-72f3a1438bff None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:13.888095 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 18/33] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:13.889330 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63c06b-da1a-4d42-9f0a-108808c63195 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:13.918186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 16/34] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:13.920274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bcfa8-189d-432e-946d-82993805c21b None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:13.920746 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bcfa8-189d-432e-946d-82993805c21b None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:13.921189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bcfa8-189d-432e-946d-82993805c21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:13.940748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-d99bcfa8-189d-432e-946d-82993805c21b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:13.942702 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-d99bcfa8-189d-432e-946d-82993805c21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:13.993302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:14.010955 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63c06b-da1a-4d42-9f0a-108808c63195 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:14.035589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 17/35] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:14.036791 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bcfa8-189d-432e-946d-82993805c21b None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:14.054115 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b273591-4484-4df8-ab69-56460aac5f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:14.054948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b273591-4484-4df8-ab69-56460aac5f20 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:14.055428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b273591-4484-4df8-ab69-56460aac5f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:14.055847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b273591-4484-4df8-ab69-56460aac5f20 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:14.056709 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b273591-4484-4df8-ab69-56460aac5f20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:14.057134 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b273591-4484-4df8-ab69-56460aac5f20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:14.058784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b273591-4484-4df8-ab69-56460aac5f20 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:14.078232 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 19/36] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:14.078232 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b273591-4484-4df8-ab69-56460aac5f20 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:14.104163 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:14.155917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bcfa8-189d-432e-946d-82993805c21b None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:14.193045 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b273591-4484-4df8-ab69-56460aac5f20 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:14.193334 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3720ab0-dadc-4d6c-8b19-ab95925c8f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:14.194083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3720ab0-dadc-4d6c-8b19-ab95925c8f30 None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:14.194423 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3720ab0-dadc-4d6c-8b19-ab95925c8f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:14.194643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3720ab0-dadc-4d6c-8b19-ab95925c8f30 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:14.195352 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3720ab0-dadc-4d6c-8b19-ab95925c8f30 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:14.196749 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3720ab0-dadc-4d6c-8b19-ab95925c8f30 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:14.225105 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 18/37] 10.222.0.96 () {60 vars in 1131 bytes} [Thu Jul 28 17:41:14 2022] POST /identity/v3/roles => generated 225 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:41:14.225105 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3720ab0-dadc-4d6c-8b19-ab95925c8f30 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:14.229346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18938ec-9f2c-4c98-8c11-ef57174b4c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:14.229998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18938ec-9f2c-4c98-8c11-ef57174b4c97 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:14.230288 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18938ec-9f2c-4c98-8c11-ef57174b4c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:14.230565 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18938ec-9f2c-4c98-8c11-ef57174b4c97 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:14.231513 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18938ec-9f2c-4c98-8c11-ef57174b4c97 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:14.233041 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18938ec-9f2c-4c98-8c11-ef57174b4c97 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:14.347980 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3720ab0-dadc-4d6c-8b19-ab95925c8f30 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:14.363878 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:14.395720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 20/38] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Jul 28 17:41:14 2022] POST /identity/v3/projects => generated 301 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:41:14.395720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18938ec-9f2c-4c98-8c11-ef57174b4c97 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:14.395720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:14.403274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7a4e5-f245-4e2b-9639-4d8fc70442b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:14.404074 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7a4e5-f245-4e2b-9639-4d8fc70442b7 None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:14.404363 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7a4e5-f245-4e2b-9639-4d8fc70442b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:14.404637 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7a4e5-f245-4e2b-9639-4d8fc70442b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:14.406095 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7a4e5-f245-4e2b-9639-4d8fc70442b7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:14.407062 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7a4e5-f245-4e2b-9639-4d8fc70442b7 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:14.431332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 19/39] 10.222.0.96 () {60 vars in 1131 bytes} [Thu Jul 28 17:41:14 2022] POST /identity/v3/roles => generated 223 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:41:14.432994 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bd068-e8c6-404f-b94b-34ea5cceac23 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:14.433319 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bd068-e8c6-404f-b94b-34ea5cceac23 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:14.433602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bd068-e8c6-404f-b94b-34ea5cceac23 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:14.434870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 20/40] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:14.441495 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078293a7-a8ac-47fa-8324-a638007d2e47 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:14.442121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078293a7-a8ac-47fa-8324-a638007d2e47 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:14.443019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078293a7-a8ac-47fa-8324-a638007d2e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:14.470311 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-078293a7-a8ac-47fa-8324-a638007d2e47 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:14.471969 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-078293a7-a8ac-47fa-8324-a638007d2e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:14.546137 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18938ec-9f2c-4c98-8c11-ef57174b4c97 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:14.563621 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 21/41] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:41:14.594081 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078293a7-a8ac-47fa-8324-a638007d2e47 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:14.597081 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1637e29-0929-4837-911a-abbf88a77638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:14.597800 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1637e29-0929-4837-911a-abbf88a77638 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:14.598088 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1637e29-0929-4837-911a-abbf88a77638 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:14.598369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1637e29-0929-4837-911a-abbf88a77638 None admin] PATH_INFO: `/v3/users/139abd87c3e347d299314e22a7c95f3f` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:14.600149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1637e29-0929-4837-911a-abbf88a77638 None admin] RBAC: Authorizing `identity:get_user(user_id=139abd87c3e347d299314e22a7c95f3f)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:14.601857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1637e29-0929-4837-911a-abbf88a77638 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:14.603617 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 21/42] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:14 2022] GET /identity/v3/users/139abd87c3e347d299314e22a7c95f3f => generated 247 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:14.609383 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1637e29-0929-4837-911a-abbf88a77638 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:14.698198 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:14.717746 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078293a7-a8ac-47fa-8324-a638007d2e47 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:14.720023 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:14.730638 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1637e29-0929-4837-911a-abbf88a77638 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:14.752825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece155da-a551-4b42-8a73-d84bd5d8cc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:14.753510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece155da-a551-4b42-8a73-d84bd5d8cc19 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:14.753787 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece155da-a551-4b42-8a73-d84bd5d8cc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:14.754062 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece155da-a551-4b42-8a73-d84bd5d8cc19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:14.755271 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece155da-a551-4b42-8a73-d84bd5d8cc19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:14.756891 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece155da-a551-4b42-8a73-d84bd5d8cc19 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:14.758489 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 22/43] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:41:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:14.764388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece155da-a551-4b42-8a73-d84bd5d8cc19 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:14.765217 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefbb87-c34e-4d4b-8c9d-ec10ff18d350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:14.765873 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefbb87-c34e-4d4b-8c9d-ec10ff18d350 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:14.766159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefbb87-c34e-4d4b-8c9d-ec10ff18d350 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:14.766439 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefbb87-c34e-4d4b-8c9d-ec10ff18d350 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:14.768407 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefbb87-c34e-4d4b-8c9d-ec10ff18d350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:14.769180 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefbb87-c34e-4d4b-8c9d-ec10ff18d350 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:14.773095 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 22/44] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:41:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:14.776496 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefbb87-c34e-4d4b-8c9d-ec10ff18d350 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:14.865639 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece155da-a551-4b42-8a73-d84bd5d8cc19 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:14.876514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefbb87-c34e-4d4b-8c9d-ec10ff18d350 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:14.900935 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462a0fa-e28c-4df2-9891-3354f84c22ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:14.901594 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462a0fa-e28c-4df2-9891-3354f84c22ec None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:14.901875 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462a0fa-e28c-4df2-9891-3354f84c22ec None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:14.902139 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462a0fa-e28c-4df2-9891-3354f84c22ec None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:14.902843 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462a0fa-e28c-4df2-9891-3354f84c22ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:14.904306 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462a0fa-e28c-4df2-9891-3354f84c22ec None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:14.910700 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a3384-24d0-4bbf-822f-36419efccb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:14.911398 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a3384-24d0-4bbf-822f-36419efccb19 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:14.911837 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a3384-24d0-4bbf-822f-36419efccb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:14.912109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a3384-24d0-4bbf-822f-36419efccb19 None admin] PATH_INFO: `/v3/domains/default/users/139abd87c3e347d299314e22a7c95f3f/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:14.914190 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a3384-24d0-4bbf-822f-36419efccb19 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=139abd87c3e347d299314e22a7c95f3f, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:14.915651 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a3384-24d0-4bbf-822f-36419efccb19 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:14.928025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:14.933205 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 23/45] 10.222.0.96 () {58 vars in 1361 bytes} [Thu Jul 28 17:41:14 2022] PUT /identity/v3/domains/default/users/139abd87c3e347d299314e22a7c95f3f/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:41:14.939934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 23/46] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Jul 28 17:41:14 2022] POST /identity/v3/projects => generated 312 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:41:16.929172 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109153a-7f42-45ae-a8fa-b6a1b337b6e1 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:16.929738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109153a-7f42-45ae-a8fa-b6a1b337b6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:16.929738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109153a-7f42-45ae-a8fa-b6a1b337b6e1 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:16.931236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 24/47] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:16.936545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e5ad1-f469-4465-902a-7979571abb55 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:16.936955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e5ad1-f469-4465-902a-7979571abb55 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:16.937153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e5ad1-f469-4465-902a-7979571abb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:16.955961 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-b17e5ad1-f469-4465-902a-7979571abb55 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:16.957281 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b17e5ad1-f469-4465-902a-7979571abb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:16.975517 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:17.020464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627009a-17b6-4913-b81e-1a97213c6aff None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:17.020464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627009a-17b6-4913-b81e-1a97213c6aff None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:17.020464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627009a-17b6-4913-b81e-1a97213c6aff None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:17.022938 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 25/48] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:41:17.029702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cb240-852b-43c1-bba1-8725e6dfe218 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:17.029964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cb240-852b-43c1-bba1-8725e6dfe218 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:17.030243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cb240-852b-43c1-bba1-8725e6dfe218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:17.035317 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 24/49] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:17.049961 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-4b0cb240-852b-43c1-bba1-8725e6dfe218 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:17.051605 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4b0cb240-852b-43c1-bba1-8725e6dfe218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:17.058986 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e5ad1-f469-4465-902a-7979571abb55 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:17.124644 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 26/50] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:17.149052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cb240-852b-43c1-bba1-8725e6dfe218 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:17.161790 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e5ad1-f469-4465-902a-7979571abb55 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:17.198701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c5db9-cb11-4a6b-a2a2-d9907f6d638c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:17.199303 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c5db9-cb11-4a6b-a2a2-d9907f6d638c None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:17.199582 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c5db9-cb11-4a6b-a2a2-d9907f6d638c None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:17.199839 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c5db9-cb11-4a6b-a2a2-d9907f6d638c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:17.210487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c5db9-cb11-4a6b-a2a2-d9907f6d638c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:17.215407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-796c5db9-cb11-4a6b-a2a2-d9907f6d638c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:41:17.215407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:17.215407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:17.215407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:17.215407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:17.215407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:17.215407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:17.215407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:17.215407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:17.215407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:17.215407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:17.215407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:17.215407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:17.215407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:17.215407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:17.215407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:17.216228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:17.216228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:17.216228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:17.216228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:17.216228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:17.216228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:17.216228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:17.216228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:17.216228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:17.216228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:17.216228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:17.216228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:17.216228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:17.216228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:17.216228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:17.216228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:17.216964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:17.216964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:17.216964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:17.216964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:17.216964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:17.216964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:17.216964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:17.216964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:17.216964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:17.216964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:17.216964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:41:17.216964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:17.216964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 25/51] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:41:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:17.222582 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c5db9-cb11-4a6b-a2a2-d9907f6d638c None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:17.238418 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:17.255996 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cb240-852b-43c1-bba1-8725e6dfe218 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:17.282827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:17.291306 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28845370-19b6-49d3-8d55-7d403df8ed23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:17.291960 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28845370-19b6-49d3-8d55-7d403df8ed23 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:17.292241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28845370-19b6-49d3-8d55-7d403df8ed23 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:17.292525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28845370-19b6-49d3-8d55-7d403df8ed23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:17.293799 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28845370-19b6-49d3-8d55-7d403df8ed23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:17.295276 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28845370-19b6-49d3-8d55-7d403df8ed23 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:17.296878 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 27/52] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:41:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:17.302728 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28845370-19b6-49d3-8d55-7d403df8ed23 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:17.323447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c5db9-cb11-4a6b-a2a2-d9907f6d638c None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:17.356446 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca14658-019e-4b6d-9a7b-1a77c78b5ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:17.357081 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca14658-019e-4b6d-9a7b-1a77c78b5ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:17.357374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca14658-019e-4b6d-9a7b-1a77c78b5ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:17.357644 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca14658-019e-4b6d-9a7b-1a77c78b5ed0 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:17.358356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca14658-019e-4b6d-9a7b-1a77c78b5ed0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:17.358660 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca14658-019e-4b6d-9a7b-1a77c78b5ed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:17.360062 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca14658-019e-4b6d-9a7b-1a77c78b5ed0 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:17.368052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 26/53] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:17.373664 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca14658-019e-4b6d-9a7b-1a77c78b5ed0 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:17.402477 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28845370-19b6-49d3-8d55-7d403df8ed23 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:17.437364 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa42189-1aba-44d2-ad02-9cea0b650777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:17.437995 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa42189-1aba-44d2-ad02-9cea0b650777 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:17.438278 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa42189-1aba-44d2-ad02-9cea0b650777 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:17.438557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa42189-1aba-44d2-ad02-9cea0b650777 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:17.439248 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa42189-1aba-44d2-ad02-9cea0b650777 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:17.440727 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa42189-1aba-44d2-ad02-9cea0b650777 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:17.450270 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:17.469919 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 28/54] 10.222.0.96 () {60 vars in 1140 bytes} [Thu Jul 28 17:41:17 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:41:17.474452 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca14658-019e-4b6d-9a7b-1a77c78b5ed0 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:17.520185 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792a65b-740f-46ce-b6d5-c391f73f890b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:17.520981 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792a65b-740f-46ce-b6d5-c391f73f890b None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:17.522001 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792a65b-740f-46ce-b6d5-c391f73f890b None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:17.522299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792a65b-740f-46ce-b6d5-c391f73f890b None admin] PATH_INFO: `/v3/users/139abd87c3e347d299314e22a7c95f3f` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:17.523684 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792a65b-740f-46ce-b6d5-c391f73f890b None admin] RBAC: Authorizing `identity:get_user(user_id=139abd87c3e347d299314e22a7c95f3f)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:17.525372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792a65b-740f-46ce-b6d5-c391f73f890b None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:17.527123 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 27/55] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:17 2022] GET /identity/v3/users/139abd87c3e347d299314e22a7c95f3f => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:17.533150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa42189-1aba-44d2-ad02-9cea0b650777 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:17.589037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:17.644713 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa42189-1aba-44d2-ad02-9cea0b650777 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:17.681952 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d35e0-4d88-4bf9-b226-d38953e1210c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:17.682612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d35e0-4d88-4bf9-b226-d38953e1210c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:17.682898 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d35e0-4d88-4bf9-b226-d38953e1210c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:17.683225 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d35e0-4d88-4bf9-b226-d38953e1210c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:17.684374 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d35e0-4d88-4bf9-b226-d38953e1210c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:17.686164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d35e0-4d88-4bf9-b226-d38953e1210c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:17.687682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 29/56] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:41:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:17.694105 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792a65b-740f-46ce-b6d5-c391f73f890b None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:17.796611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792a65b-740f-46ce-b6d5-c391f73f890b None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:17.832266 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf93c8-ae2a-4c24-bef1-2d1390207ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:17.832887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf93c8-ae2a-4c24-bef1-2d1390207ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:17.833203 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf93c8-ae2a-4c24-bef1-2d1390207ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:17.833649 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf93c8-ae2a-4c24-bef1-2d1390207ac3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:17.834468 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf93c8-ae2a-4c24-bef1-2d1390207ac3 None admin] RBAC: Adding query filter params (role.id=980cae90acae42189f92fd6dd42867a5, scope.domain.id=default, user.id=139abd87c3e347d299314e22a7c95f3f) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:17.834779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf93c8-ae2a-4c24-bef1-2d1390207ac3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:17.836518 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf93c8-ae2a-4c24-bef1-2d1390207ac3 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:17.842466 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 28/57] 10.222.0.96 () {56 vars in 1322 bytes} [Thu Jul 28 17:41:17 2022] GET /identity/v3/role_assignments?user.id=139abd87c3e347d299314e22a7c95f3f&scope.domain.id=default&role.id=980cae90acae42189f92fd6dd42867a5 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:19.492863 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d154db9-afa6-499a-816d-f60fd6010f8d None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:19.493598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d154db9-afa6-499a-816d-f60fd6010f8d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:19.493598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d154db9-afa6-499a-816d-f60fd6010f8d None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:19.495522 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 30/58] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:19.504115 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977464d-507d-479d-934b-d7cf91235053 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:19.504799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977464d-507d-479d-934b-d7cf91235053 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:19.504974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977464d-507d-479d-934b-d7cf91235053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:19.525460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-3977464d-507d-479d-934b-d7cf91235053 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:19.526670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-3977464d-507d-479d-934b-d7cf91235053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:19.528871 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:19.605770 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 29/59] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:19.630688 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d154db9-afa6-499a-816d-f60fd6010f8d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:19.745718 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d154db9-afa6-499a-816d-f60fd6010f8d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:19.761679 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:19.783389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a71fc-ad25-4da9-b4c4-c174118f9b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:19.784047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a71fc-ad25-4da9-b4c4-c174118f9b64 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:19.784323 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a71fc-ad25-4da9-b4c4-c174118f9b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:19.784600 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a71fc-ad25-4da9-b4c4-c174118f9b64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:19.785862 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a71fc-ad25-4da9-b4c4-c174118f9b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:19.787391 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a71fc-ad25-4da9-b4c4-c174118f9b64 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:19.788971 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 31/60] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:41:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:19.795412 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977464d-507d-479d-934b-d7cf91235053 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:19.924499 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977464d-507d-479d-934b-d7cf91235053 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:19.961075 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb2a9b-b83d-4ebf-9360-2602a3aeda3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:19.961714 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb2a9b-b83d-4ebf-9360-2602a3aeda3d None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:19.961990 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb2a9b-b83d-4ebf-9360-2602a3aeda3d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:19.962255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb2a9b-b83d-4ebf-9360-2602a3aeda3d None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:19.962933 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb2a9b-b83d-4ebf-9360-2602a3aeda3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:19.964401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb2a9b-b83d-4ebf-9360-2602a3aeda3d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:19.979670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:19.997644 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 30/61] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Jul 28 17:41:19 2022] POST /identity/v3/users => generated 275 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:41:23.182966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1a5b2-43cb-478e-beda-fd074d48b6b0 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:23.183952 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1a5b2-43cb-478e-beda-fd074d48b6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:23.184429 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1a5b2-43cb-478e-beda-fd074d48b6b0 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:23.186300 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 32/62] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:23.191902 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd59cb2-29e5-4726-bdd2-3b85afd0e6fa None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:23.192764 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd59cb2-29e5-4726-bdd2-3b85afd0e6fa None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:23.193270 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd59cb2-29e5-4726-bdd2-3b85afd0e6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:23.221471 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-1dd59cb2-29e5-4726-bdd2-3b85afd0e6fa None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:23.223059 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1dd59cb2-29e5-4726-bdd2-3b85afd0e6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:23.287155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e47453-6432-4e95-a0c6-162bdce56317 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:23.287935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e47453-6432-4e95-a0c6-162bdce56317 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:23.288461 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e47453-6432-4e95-a0c6-162bdce56317 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:23.290082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 33/63] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:23.297089 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063589f-253c-4641-9d94-cd9b26893aa1 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:23.297089 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063589f-253c-4641-9d94-cd9b26893aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:23.297089 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063589f-253c-4641-9d94-cd9b26893aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:23.328520 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-3063589f-253c-4641-9d94-cd9b26893aa1 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:23.329762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3063589f-253c-4641-9d94-cd9b26893aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:23.334176 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 31/64] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:23.360216 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd59cb2-29e5-4726-bdd2-3b85afd0e6fa None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:23.442423 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 34/65] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:41:23.444676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23e4a1-6133-4e63-95ff-eba1dafb7ca3 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:23.445287 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23e4a1-6133-4e63-95ff-eba1dafb7ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:23.445766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23e4a1-6133-4e63-95ff-eba1dafb7ca3 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:23.447245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 35/66] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:23.469638 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3b839-46f3-4eeb-aed3-78f8b02696e3 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:23.470243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3b839-46f3-4eeb-aed3-78f8b02696e3 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:23.470786 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3b839-46f3-4eeb-aed3-78f8b02696e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:23.490405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-95a3b839-46f3-4eeb-aed3-78f8b02696e3 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:23.490785 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd59cb2-29e5-4726-bdd2-3b85afd0e6fa None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:23.492458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-95a3b839-46f3-4eeb-aed3-78f8b02696e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:23.516192 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:23.532224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb488c-8ffc-4d39-a1f9-85fa4e873ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:23.532997 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb488c-8ffc-4d39-a1f9-85fa4e873ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:23.533395 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb488c-8ffc-4d39-a1f9-85fa4e873ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:23.533734 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb488c-8ffc-4d39-a1f9-85fa4e873ec8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:23.545260 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb488c-8ffc-4d39-a1f9-85fa4e873ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:23.550147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-67cb488c-8ffc-4d39-a1f9-85fa4e873ec8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:41:23.550147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:23.550147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:23.550147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:23.550147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:23.550147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:23.550147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:23.550147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:23.550147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:23.550147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:23.550147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:23.550147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:23.550147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:23.550147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:23.550147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:23.550147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:23.550987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:23.550987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:23.550987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:23.550987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:23.550987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:23.550987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:23.550987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:23.550987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:23.550987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:23.550987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:23.550987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:23.550987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:23.550987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:23.550987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:23.550987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:23.550987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:23.552199 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:23.552199 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:23.552199 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:23.552199 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:23.552199 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:23.552199 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:23.552199 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:23.552199 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:23.552199 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:23.552199 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:23.552199 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:41:23.552199 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:23.552199 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 32/67] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:41:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:41:23.553157 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb488c-8ffc-4d39-a1f9-85fa4e873ec8 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:23.583096 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 36/68] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:41:23.584594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3b839-46f3-4eeb-aed3-78f8b02696e3 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:23.644883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:23.686132 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb488c-8ffc-4d39-a1f9-85fa4e873ec8 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:23.723419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3b839-46f3-4eeb-aed3-78f8b02696e3 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:23.724023 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcf424-737a-4bd8-b23a-23a82ade27b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:23.724742 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcf424-737a-4bd8-b23a-23a82ade27b8 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:23.725186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcf424-737a-4bd8-b23a-23a82ade27b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:23.725462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcf424-737a-4bd8-b23a-23a82ade27b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:23.735846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dcf424-737a-4bd8-b23a-23a82ade27b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:23.740837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-f0dcf424-737a-4bd8-b23a-23a82ade27b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:23.740837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:23.740837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:23.740837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:23.740837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:23.740837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:23.740837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:23.740837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:23.740837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:23.740837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:23.740837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:23.740837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:23.740837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:23.740837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:23.740837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:23.740837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:23.741846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:23.741846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:23.741846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:23.741846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:23.741846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:23.741846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:23.741846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:23.741846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:23.741846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:23.741846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:23.741846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:23.741846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:23.741846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:23.741846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:23.741846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:23.741846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:23.742580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:23.742580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:23.742580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:23.742580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:23.742580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:23.742580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:23.742580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:23.742580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:23.742580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:23.742580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:23.742580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:23.742580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:23.747286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 33/69] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:23.747775 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcf424-737a-4bd8-b23a-23a82ade27b8 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:23.762551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e0454-c16a-4f48-b514-cd11a4516d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:23.763195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e0454-c16a-4f48-b514-cd11a4516d92 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:23.763478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e0454-c16a-4f48-b514-cd11a4516d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:23.763762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e0454-c16a-4f48-b514-cd11a4516d92 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:23.764830 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e0454-c16a-4f48-b514-cd11a4516d92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:23.765200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e0454-c16a-4f48-b514-cd11a4516d92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:23.766691 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e0454-c16a-4f48-b514-cd11a4516d92 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:23.777220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 37/70] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:23.777717 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f655e07-ecd5-473c-aa93-bfab1859b949 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:23.778014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f655e07-ecd5-473c-aa93-bfab1859b949 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:23.778296 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f655e07-ecd5-473c-aa93-bfab1859b949 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:23.779932 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 38/71] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:23.780733 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f655e07-ecd5-473c-aa93-bfab1859b949 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:23.801842 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:23.856231 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcf424-737a-4bd8-b23a-23a82ade27b8 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:23.890783 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f655e07-ecd5-473c-aa93-bfab1859b949 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:23.899107 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:23.902347 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5445811-c2d1-4297-b50f-4d393715cb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:23.903012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5445811-c2d1-4297-b50f-4d393715cb69 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:23.903296 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5445811-c2d1-4297-b50f-4d393715cb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:23.903561 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5445811-c2d1-4297-b50f-4d393715cb69 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:23.915698 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5445811-c2d1-4297-b50f-4d393715cb69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:23.920616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-d5445811-c2d1-4297-b50f-4d393715cb69 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:41:23.920616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:23.920616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:23.920616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:23.920616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:23.920616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:23.920616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:23.920616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:23.920616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:23.920616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:23.920616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:23.920616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:23.920616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:23.920616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:23.920616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:23.920616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:23.921512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:23.921512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:23.921512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:23.921512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:23.921512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:23.921512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:23.921512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:23.921512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:23.921512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:23.921512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:23.921512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:23.921512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:23.921512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:23.921512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:23.921512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:23.921512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:23.922255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:23.922255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:23.922255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:23.922255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:23.922255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:23.922255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:23.922255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:23.922255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:23.922255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:23.922255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:23.922255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:41:23.922255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:23.922255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 34/72] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:41:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:23.927396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5445811-c2d1-4297-b50f-4d393715cb69 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:23.928853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc5d9a-8a0f-410c-94f5-1c2dc4cc7cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:23.929513 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc5d9a-8a0f-410c-94f5-1c2dc4cc7cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:23.929794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc5d9a-8a0f-410c-94f5-1c2dc4cc7cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:23.930061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc5d9a-8a0f-410c-94f5-1c2dc4cc7cc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:23.930995 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc5d9a-8a0f-410c-94f5-1c2dc4cc7cc4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:23.931305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc5d9a-8a0f-410c-94f5-1c2dc4cc7cc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:23.933907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc5d9a-8a0f-410c-94f5-1c2dc4cc7cc4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:23.942819 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 39/73] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:23.944352 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2c1e8-9174-4b7d-9267-44e26a781f86 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:23.944644 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2c1e8-9174-4b7d-9267-44e26a781f86 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:23.944920 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2c1e8-9174-4b7d-9267-44e26a781f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:23.963924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c9e2c1e8-9174-4b7d-9267-44e26a781f86 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:23.965164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c9e2c1e8-9174-4b7d-9267-44e26a781f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:24.030294 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 40/74] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:24.031602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dea42b-e758-4211-9c60-95c07bd3b034 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:24.031886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dea42b-e758-4211-9c60-95c07bd3b034 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:24.032164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dea42b-e758-4211-9c60-95c07bd3b034 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:24.033411 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 41/75] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:24.034128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dea42b-e758-4211-9c60-95c07bd3b034 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:24.041688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5445811-c2d1-4297-b50f-4d393715cb69 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:24.053733 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:24.080167 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddf394-e69a-41a4-b00a-45ca9d0b2114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:24.080815 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddf394-e69a-41a4-b00a-45ca9d0b2114 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:24.081123 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddf394-e69a-41a4-b00a-45ca9d0b2114 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:24.081398 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddf394-e69a-41a4-b00a-45ca9d0b2114 None admin] PATH_INFO: `/v3/users/139abd87c3e347d299314e22a7c95f3f` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:24.082594 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddf394-e69a-41a4-b00a-45ca9d0b2114 None admin] RBAC: Authorizing `identity:get_user(user_id=139abd87c3e347d299314e22a7c95f3f)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:24.084217 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddf394-e69a-41a4-b00a-45ca9d0b2114 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:24.086150 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 35/76] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:23 2022] GET /identity/v3/users/139abd87c3e347d299314e22a7c95f3f => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:24.086716 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddf394-e69a-41a4-b00a-45ca9d0b2114 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:24.131832 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:24.137001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dea42b-e758-4211-9c60-95c07bd3b034 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:24.173546 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f269857-fbcb-4e8f-8d0b-f18c3bb9af5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:24.174204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f269857-fbcb-4e8f-8d0b-f18c3bb9af5b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:24.174466 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f269857-fbcb-4e8f-8d0b-f18c3bb9af5b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:24.174771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f269857-fbcb-4e8f-8d0b-f18c3bb9af5b None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:24.175486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f269857-fbcb-4e8f-8d0b-f18c3bb9af5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:24.175800 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f269857-fbcb-4e8f-8d0b-f18c3bb9af5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:24.177253 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f269857-fbcb-4e8f-8d0b-f18c3bb9af5b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:24.185317 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddf394-e69a-41a4-b00a-45ca9d0b2114 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:24.185498 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 42/77] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:41:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:24.186762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66d647-f7a9-4398-8f48-0ead9364d9b0 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:24.187056 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66d647-f7a9-4398-8f48-0ead9364d9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:24.187336 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66d647-f7a9-4398-8f48-0ead9364d9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:24.209145 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-ea66d647-f7a9-4398-8f48-0ead9364d9b0 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:24.210377 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ea66d647-f7a9-4398-8f48-0ead9364d9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:24.225051 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317523f-40ed-4cba-b06b-2615e75c80f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:24.225748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317523f-40ed-4cba-b06b-2615e75c80f1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:24.226024 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317523f-40ed-4cba-b06b-2615e75c80f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:24.226303 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317523f-40ed-4cba-b06b-2615e75c80f1 None admin] PATH_INFO: `/v3/users/8f485e8f65e54640b471926b42d2c321` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:24.239719 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317523f-40ed-4cba-b06b-2615e75c80f1 None admin] RBAC: Authorizing `identity:get_user(user_id=8f485e8f65e54640b471926b42d2c321)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:24.241325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317523f-40ed-4cba-b06b-2615e75c80f1 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:24.242967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 36/78] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:24 2022] GET /identity/v3/users/8f485e8f65e54640b471926b42d2c321 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:24.243720 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317523f-40ed-4cba-b06b-2615e75c80f1 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:24.276087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:24.280024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 43/79] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:24.280959 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66d647-f7a9-4398-8f48-0ead9364d9b0 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:24.357618 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317523f-40ed-4cba-b06b-2615e75c80f1 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:24.370779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:24.381367 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66d647-f7a9-4398-8f48-0ead9364d9b0 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:24.392021 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb9556-7223-4391-b160-7f383aced15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:24.392672 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb9556-7223-4391-b160-7f383aced15e None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:24.392956 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb9556-7223-4391-b160-7f383aced15e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:24.393266 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb9556-7223-4391-b160-7f383aced15e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:24.394428 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb9556-7223-4391-b160-7f383aced15e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:24.395883 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb9556-7223-4391-b160-7f383aced15e None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:24.397950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 37/80] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:41:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:24.403404 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb9556-7223-4391-b160-7f383aced15e None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:24.416314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574bb0d-e939-46ca-b790-dda27f44ec4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:24.416948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574bb0d-e939-46ca-b790-dda27f44ec4d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:24.417263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574bb0d-e939-46ca-b790-dda27f44ec4d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:24.417542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574bb0d-e939-46ca-b790-dda27f44ec4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:24.490683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574bb0d-e939-46ca-b790-dda27f44ec4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:24.492179 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574bb0d-e939-46ca-b790-dda27f44ec4d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:24.504593 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:24.509163 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb9556-7223-4391-b160-7f383aced15e None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:24.544397 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dca52e-8709-4152-b60f-5f1b4701b910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:24.545043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dca52e-8709-4152-b60f-5f1b4701b910 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:24.545352 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dca52e-8709-4152-b60f-5f1b4701b910 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:24.545622 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dca52e-8709-4152-b60f-5f1b4701b910 None admin] PATH_INFO: `/v3/users/8f485e8f65e54640b471926b42d2c321` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:24.546802 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dca52e-8709-4152-b60f-5f1b4701b910 None admin] RBAC: Authorizing `identity:get_user(user_id=8f485e8f65e54640b471926b42d2c321)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:24.548273 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dca52e-8709-4152-b60f-5f1b4701b910 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:24.549924 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 38/81] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:24 2022] GET /identity/v3/users/8f485e8f65e54640b471926b42d2c321 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:24.550680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dca52e-8709-4152-b60f-5f1b4701b910 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:24.585016 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:24.596808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 44/82] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:41:24.602039 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574bb0d-e939-46ca-b790-dda27f44ec4d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:24.655070 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dca52e-8709-4152-b60f-5f1b4701b910 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:24.687252 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843baf77-c524-46bb-8d2f-848444c463e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:24.687902 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843baf77-c524-46bb-8d2f-848444c463e1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:24.688247 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843baf77-c524-46bb-8d2f-848444c463e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:24.688459 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843baf77-c524-46bb-8d2f-848444c463e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:24.696109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574bb0d-e939-46ca-b790-dda27f44ec4d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:24.721934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:24.731957 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17d11b-b7ca-49ee-8298-49efc676a911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:24.732652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17d11b-b7ca-49ee-8298-49efc676a911 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:24.732931 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17d11b-b7ca-49ee-8298-49efc676a911 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:24.733267 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17d11b-b7ca-49ee-8298-49efc676a911 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:24.743587 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa17d11b-b7ca-49ee-8298-49efc676a911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:24.748481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-fa17d11b-b7ca-49ee-8298-49efc676a911 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:24.748481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:24.748481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:24.748481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:24.748481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:24.748481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:24.748481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:24.748481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:24.748481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:24.748481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:24.748481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:24.748481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:24.748481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:24.748481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:24.748481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:24.748481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:24.749613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:24.749613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:24.749613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:24.749613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:24.749613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:24.749613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:24.749613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:24.749613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:24.749613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:24.749613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:24.749613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:24.749613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:24.749613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:24.749613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:24.749613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:24.749613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:24.755613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:24.755613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:24.755613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:24.755613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:24.755613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:24.755613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:24.755613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:24.755613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:24.755613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:24.755613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:24.755613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:24.755613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:41:24.755613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 45/83] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:24.755613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17d11b-b7ca-49ee-8298-49efc676a911 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:24.765091 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843baf77-c524-46bb-8d2f-848444c463e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:24.766671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843baf77-c524-46bb-8d2f-848444c463e1 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:24.802815 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:24.854341 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17d11b-b7ca-49ee-8298-49efc676a911 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:24.869541 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 39/84] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:41:24.870323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843baf77-c524-46bb-8d2f-848444c463e1 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:24.892561 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bfda5-cbbc-421e-ba4f-93ea5b91c567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:24.893236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bfda5-cbbc-421e-ba4f-93ea5b91c567 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:24.893495 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bfda5-cbbc-421e-ba4f-93ea5b91c567 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:24.893768 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bfda5-cbbc-421e-ba4f-93ea5b91c567 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:24.894470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852bfda5-cbbc-421e-ba4f-93ea5b91c567 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:24.895947 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852bfda5-cbbc-421e-ba4f-93ea5b91c567 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:24.937186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 46/85] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Jul 28 17:41:24 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:41:24.937186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bfda5-cbbc-421e-ba4f-93ea5b91c567 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:24.952670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:24.995379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843baf77-c524-46bb-8d2f-848444c463e1 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:25.037502 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bd5f6-bf15-4728-be2e-3d740c2e764d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:25.038157 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bd5f6-bf15-4728-be2e-3d740c2e764d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:25.038445 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bd5f6-bf15-4728-be2e-3d740c2e764d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:25.038727 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bd5f6-bf15-4728-be2e-3d740c2e764d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:25.048607 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bfda5-cbbc-421e-ba4f-93ea5b91c567 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:25.057413 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:25.093694 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188c00e-bec3-4e28-b4a4-3d21ac2c8448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:25.094448 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188c00e-bec3-4e28-b4a4-3d21ac2c8448 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:25.094641 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188c00e-bec3-4e28-b4a4-3d21ac2c8448 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:25.094948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188c00e-bec3-4e28-b4a4-3d21ac2c8448 None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:25.096177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188c00e-bec3-4e28-b4a4-3d21ac2c8448 None admin] RBAC: Authorizing `identity:get_project(project_id=963ff5e1d9f74853b35cd0babec573b9)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:25.097853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188c00e-bec3-4e28-b4a4-3d21ac2c8448 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:25.099618 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 47/86] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:24 2022] GET /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:25.100649 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188c00e-bec3-4e28-b4a4-3d21ac2c8448 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:25.116579 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bd5f6-bf15-4728-be2e-3d740c2e764d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:25.118128 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bd5f6-bf15-4728-be2e-3d740c2e764d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:25.197991 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:25.227038 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188c00e-bec3-4e28-b4a4-3d21ac2c8448 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:25.242941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 40/87] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:41:25.244375 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bd5f6-bf15-4728-be2e-3d740c2e764d None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:25.276052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23123826-6337-4760-aa41-5a977c6289bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:25.276694 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23123826-6337-4760-aa41-5a977c6289bf None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:25.276975 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23123826-6337-4760-aa41-5a977c6289bf None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:25.277309 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23123826-6337-4760-aa41-5a977c6289bf None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:25.278037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23123826-6337-4760-aa41-5a977c6289bf None admin] RBAC: Adding query filter params (name=member) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:25.278342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23123826-6337-4760-aa41-5a977c6289bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:25.279745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23123826-6337-4760-aa41-5a977c6289bf None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:25.291750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 48/88] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:25.294927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23123826-6337-4760-aa41-5a977c6289bf None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:25.338233 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:25.368260 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bd5f6-bf15-4728-be2e-3d740c2e764d None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:25.410836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23123826-6337-4760-aa41-5a977c6289bf None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:25.412543 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020abf7-ba93-44e7-b2eb-a633b3769dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:25.413223 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020abf7-ba93-44e7-b2eb-a633b3769dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:25.413498 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020abf7-ba93-44e7-b2eb-a633b3769dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:25.413771 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020abf7-ba93-44e7-b2eb-a633b3769dd8 None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:25.415940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020abf7-ba93-44e7-b2eb-a633b3769dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=963ff5e1d9f74853b35cd0babec573b9)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:25.417427 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020abf7-ba93-44e7-b2eb-a633b3769dd8 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:25.424179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 41/89] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:25 2022] GET /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:25.424179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020abf7-ba93-44e7-b2eb-a633b3769dd8 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:25.452803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479aced-aa79-474c-8dec-e1a531ae8355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:25.453780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479aced-aa79-474c-8dec-e1a531ae8355 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:25.454267 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479aced-aa79-474c-8dec-e1a531ae8355 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:25.454738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479aced-aa79-474c-8dec-e1a531ae8355 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:25.455796 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479aced-aa79-474c-8dec-e1a531ae8355 None admin] RBAC: Adding query filter params (role.id=980cae90acae42189f92fd6dd42867a5, scope.project.id=963ff5e1d9f74853b35cd0babec573b9, user.id=139abd87c3e347d299314e22a7c95f3f) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:25.456377 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479aced-aa79-474c-8dec-e1a531ae8355 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:25.458134 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479aced-aa79-474c-8dec-e1a531ae8355 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:25.464874 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:25.467721 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 49/90] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:41:25 2022] GET /identity/v3/role_assignments?user.id=139abd87c3e347d299314e22a7c95f3f&scope.project.id=963ff5e1d9f74853b35cd0babec573b9&role.id=980cae90acae42189f92fd6dd42867a5 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:25.468877 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479aced-aa79-474c-8dec-e1a531ae8355 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:25.543614 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020abf7-ba93-44e7-b2eb-a633b3769dd8 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:25.597550 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a35802-4413-441b-b537-b3a763dc868c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:25.598215 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a35802-4413-441b-b537-b3a763dc868c None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:25.598494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a35802-4413-441b-b537-b3a763dc868c None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:25.598766 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a35802-4413-441b-b537-b3a763dc868c None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:25.602512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a35802-4413-441b-b537-b3a763dc868c None admin] RBAC: Authorizing `identity:get_project(project_id=963ff5e1d9f74853b35cd0babec573b9)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:25.605357 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a35802-4413-441b-b537-b3a763dc868c None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:25.607160 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 42/91] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:25 2022] GET /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:25.607946 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a35802-4413-441b-b537-b3a763dc868c None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:25.719926 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:25.731045 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479aced-aa79-474c-8dec-e1a531ae8355 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:25.746306 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a35802-4413-441b-b537-b3a763dc868c None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:25.749348 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:25.784586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85159edc-644e-4089-9e89-dd8981b3a76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:25.785245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85159edc-644e-4089-9e89-dd8981b3a76b None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:25.785530 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85159edc-644e-4089-9e89-dd8981b3a76b None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:25.785811 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85159edc-644e-4089-9e89-dd8981b3a76b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:25.786782 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85159edc-644e-4089-9e89-dd8981b3a76b None admin] RBAC: Adding query filter params (role.id=1e9bc5b431414d62a974beb13a8f83c7, scope.project.id=963ff5e1d9f74853b35cd0babec573b9, user.id=8f485e8f65e54640b471926b42d2c321) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:25.787138 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85159edc-644e-4089-9e89-dd8981b3a76b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:25.788757 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85159edc-644e-4089-9e89-dd8981b3a76b None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:25.795165 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 43/92] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:41:25 2022] GET /identity/v3/role_assignments?user.id=8f485e8f65e54640b471926b42d2c321&scope.project.id=963ff5e1d9f74853b35cd0babec573b9&role.id=1e9bc5b431414d62a974beb13a8f83c7 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:25.796013 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85159edc-644e-4089-9e89-dd8981b3a76b None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:25.866193 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa1774-0f02-4d44-a79a-7983d8940e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:25.866889 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa1774-0f02-4d44-a79a-7983d8940e56 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:25.867181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa1774-0f02-4d44-a79a-7983d8940e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:25.867466 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa1774-0f02-4d44-a79a-7983d8940e56 None admin] PATH_INFO: `/v3/users/8f485e8f65e54640b471926b42d2c321` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:25.868773 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa1774-0f02-4d44-a79a-7983d8940e56 None admin] RBAC: Authorizing `identity:get_user(user_id=8f485e8f65e54640b471926b42d2c321)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:25.870285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa1774-0f02-4d44-a79a-7983d8940e56 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:25.872090 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 50/93] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:25 2022] GET /identity/v3/users/8f485e8f65e54640b471926b42d2c321 => generated 275 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:25.877773 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa1774-0f02-4d44-a79a-7983d8940e56 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:25.908251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85159edc-644e-4089-9e89-dd8981b3a76b None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:25.954005 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085fa7d-c262-4a4e-9934-b3c2c99d31bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:25.954640 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085fa7d-c262-4a4e-9934-b3c2c99d31bc None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:25.954917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085fa7d-c262-4a4e-9934-b3c2c99d31bc None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:25.955188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085fa7d-c262-4a4e-9934-b3c2c99d31bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:25.955986 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085fa7d-c262-4a4e-9934-b3c2c99d31bc None admin] RBAC: Adding query filter params (role.id=5b95c3aebc8041c7885a9234a9e54d7c, scope.project.id=963ff5e1d9f74853b35cd0babec573b9, user.id=8f485e8f65e54640b471926b42d2c321) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:25.956291 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085fa7d-c262-4a4e-9934-b3c2c99d31bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:25.957922 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085fa7d-c262-4a4e-9934-b3c2c99d31bc None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:25.965003 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 44/94] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:41:25 2022] GET /identity/v3/role_assignments?user.id=8f485e8f65e54640b471926b42d2c321&scope.project.id=963ff5e1d9f74853b35cd0babec573b9&role.id=5b95c3aebc8041c7885a9234a9e54d7c => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:26.104909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa1774-0f02-4d44-a79a-7983d8940e56 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:26.143399 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b89497-199b-415e-bf62-e4163c19fda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:26.144035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b89497-199b-415e-bf62-e4163c19fda7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:26.144316 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b89497-199b-415e-bf62-e4163c19fda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:26.144589 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b89497-199b-415e-bf62-e4163c19fda7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:26.187459 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:26.224438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b89497-199b-415e-bf62-e4163c19fda7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:26.226205 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b89497-199b-415e-bf62-e4163c19fda7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:26.346605 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 51/95] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:41:26.352195 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085fa7d-c262-4a4e-9934-b3c2c99d31bc None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:26.401684 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:26.494263 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085fa7d-c262-4a4e-9934-b3c2c99d31bc None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:26.531421 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd77ed-b84d-4ef1-be26-5ada70671b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:26.532081 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd77ed-b84d-4ef1-be26-5ada70671b66 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:26.532361 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd77ed-b84d-4ef1-be26-5ada70671b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:26.532638 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd77ed-b84d-4ef1-be26-5ada70671b66 None admin] PATH_INFO: `/v3/projects/fdf1bc163f9645af9b60ecd0c3157bd4` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:26.533895 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd77ed-b84d-4ef1-be26-5ada70671b66 None admin] RBAC: Authorizing `identity:get_project(project_id=fdf1bc163f9645af9b60ecd0c3157bd4)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:26.535366 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd77ed-b84d-4ef1-be26-5ada70671b66 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:26.537088 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 45/96] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:26 2022] GET /identity/v3/projects/fdf1bc163f9645af9b60ecd0c3157bd4 => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:26.543269 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b89497-199b-415e-bf62-e4163c19fda7 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:26.646864 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:26.693447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b89497-199b-415e-bf62-e4163c19fda7 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:26.743973 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca814a-9f5d-4afc-bb31-6f160c22e2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:26.744621 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca814a-9f5d-4afc-bb31-6f160c22e2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:26.744913 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca814a-9f5d-4afc-bb31-6f160c22e2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:26.745214 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca814a-9f5d-4afc-bb31-6f160c22e2f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:26.746024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca814a-9f5d-4afc-bb31-6f160c22e2f2 None admin] RBAC: Adding query filter params (role.id=1e9bc5b431414d62a974beb13a8f83c7, scope.project.id=fdf1bc163f9645af9b60ecd0c3157bd4, user.id=8f485e8f65e54640b471926b42d2c321) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:26.746338 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca814a-9f5d-4afc-bb31-6f160c22e2f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:26.747792 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca814a-9f5d-4afc-bb31-6f160c22e2f2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:26.757535 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 52/97] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:41:26 2022] GET /identity/v3/role_assignments?user.id=8f485e8f65e54640b471926b42d2c321&scope.project.id=fdf1bc163f9645af9b60ecd0c3157bd4&role.id=1e9bc5b431414d62a974beb13a8f83c7 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:27.521734 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d021c-8ef8-4dad-a48f-26b5c21df49d None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:27.522816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d021c-8ef8-4dad-a48f-26b5c21df49d None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:27.523295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d021c-8ef8-4dad-a48f-26b5c21df49d None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:27.525222 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 46/98] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:27.530298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf72b30-3828-489c-9866-a60477b310f0 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:27.531186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf72b30-3828-489c-9866-a60477b310f0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:27.531682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf72b30-3828-489c-9866-a60477b310f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:27.562056 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-fbf72b30-3828-489c-9866-a60477b310f0 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:27.563687 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fbf72b30-3828-489c-9866-a60477b310f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:27.638077 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 53/99] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:41:27.679777 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d021c-8ef8-4dad-a48f-26b5c21df49d None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:27.730218 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d8224-f388-4c2c-a1f7-54afd7d85b32 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:27.730855 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d8224-f388-4c2c-a1f7-54afd7d85b32 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:27.731328 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d8224-f388-4c2c-a1f7-54afd7d85b32 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:27.732919 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 54/100] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:41:27.737994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c0488-e8cc-4a37-a70e-d3a24337e8a1 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:27.738536 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c0488-e8cc-4a37-a70e-d3a24337e8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:27.739008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c0488-e8cc-4a37-a70e-d3a24337e8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:27.774147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7f6c0488-e8cc-4a37-a70e-d3a24337e8a1 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:27.775670 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7f6c0488-e8cc-4a37-a70e-d3a24337e8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:27.799520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:27.804363 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d021c-8ef8-4dad-a48f-26b5c21df49d None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:27.839864 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa90c6-f01b-437d-b211-8b25625226a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:27.840747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa90c6-f01b-437d-b211-8b25625226a1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:27.841220 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa90c6-f01b-437d-b211-8b25625226a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:27.841680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa90c6-f01b-437d-b211-8b25625226a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:27.853171 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa90c6-f01b-437d-b211-8b25625226a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:27.858292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-72aa90c6-f01b-437d-b211-8b25625226a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:41:27.858292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:27.858292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:27.858292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:27.858292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:27.858292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:27.858292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:27.858292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:27.858292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:27.858292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:27.858292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:27.858292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:27.858292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:27.858292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:27.858292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:27.858292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:27.859206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:27.859206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:27.859206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:27.859206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:27.859206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:27.859206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:27.859206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:27.859206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:27.859206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:27.859206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:27.859206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:27.859206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:27.859206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:27.859206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:27.859206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:27.859206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:27.859959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:27.859959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:27.859959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:27.859959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:27.859959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:27.859959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:27.859959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:27.859959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:27.859959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:27.859959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:27.859959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:41:27.859959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:27.862298 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 47/101] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:27.868528 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa90c6-f01b-437d-b211-8b25625226a1 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:27.987236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa90c6-f01b-437d-b211-8b25625226a1 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:27.990213 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:27.998681 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 55/102] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:41:28.026825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190558f-ad6c-4620-98ab-2ef9512f5ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:28.027532 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190558f-ad6c-4620-98ab-2ef9512f5ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:28.027908 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190558f-ad6c-4620-98ab-2ef9512f5ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:28.028276 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190558f-ad6c-4620-98ab-2ef9512f5ed6 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:28.031721 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190558f-ad6c-4620-98ab-2ef9512f5ed6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:28.031721 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190558f-ad6c-4620-98ab-2ef9512f5ed6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:28.031721 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190558f-ad6c-4620-98ab-2ef9512f5ed6 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:28.033114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c0488-e8cc-4a37-a70e-d3a24337e8a1 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:28.045149 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 48/103] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:28.047381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190558f-ad6c-4620-98ab-2ef9512f5ed6 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:28.080410 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:28.141748 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c0488-e8cc-4a37-a70e-d3a24337e8a1 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:28.184530 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb0d4d-933f-435a-9c78-90d0b40d85d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:28.185555 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb0d4d-933f-435a-9c78-90d0b40d85d2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:28.186116 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb0d4d-933f-435a-9c78-90d0b40d85d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:28.187669 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb0d4d-933f-435a-9c78-90d0b40d85d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:28.189315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb0d4d-933f-435a-9c78-90d0b40d85d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:28.193560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb0d4d-933f-435a-9c78-90d0b40d85d2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:28.196432 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 56/104] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:41:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:28.205859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb0d4d-933f-435a-9c78-90d0b40d85d2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:28.219037 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190558f-ad6c-4620-98ab-2ef9512f5ed6 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:28.280029 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582133f-5cfe-4408-bce6-b698355e8577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:28.280029 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582133f-5cfe-4408-bce6-b698355e8577 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:28.280029 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582133f-5cfe-4408-bce6-b698355e8577 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:28.280029 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582133f-5cfe-4408-bce6-b698355e8577 None admin] PATH_INFO: `/v3/users/d959a4e2c95b48b0ab5437aebd39b254` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:28.294257 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582133f-5cfe-4408-bce6-b698355e8577 None admin] RBAC: Authorizing `identity:get_user(user_id=d959a4e2c95b48b0ab5437aebd39b254)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:28.295917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582133f-5cfe-4408-bce6-b698355e8577 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:28.298083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 49/105] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:28 2022] GET /identity/v3/users/d959a4e2c95b48b0ab5437aebd39b254 => generated 289 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:28.303783 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582133f-5cfe-4408-bce6-b698355e8577 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:28.317410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:28.390584 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb0d4d-933f-435a-9c78-90d0b40d85d2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:28.391808 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:28.415924 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582133f-5cfe-4408-bce6-b698355e8577 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:28.453766 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2baf875-60b7-45f4-9638-937d8f38a6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:28.454415 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baf875-60b7-45f4-9638-937d8f38a6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:28.454697 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baf875-60b7-45f4-9638-937d8f38a6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:28.454969 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baf875-60b7-45f4-9638-937d8f38a6c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:28.490092 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4f4b2-367c-4945-b86d-a120fda14495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:28.491283 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4f4b2-367c-4945-b86d-a120fda14495 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:28.491771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4f4b2-367c-4945-b86d-a120fda14495 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:28.492242 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4f4b2-367c-4945-b86d-a120fda14495 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:28.493186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4f4b2-367c-4945-b86d-a120fda14495 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:28.494840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4f4b2-367c-4945-b86d-a120fda14495 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:28.540137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2baf875-60b7-45f4-9638-937d8f38a6c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:28.541750 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2baf875-60b7-45f4-9638-937d8f38a6c9 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:28.554331 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 57/106] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Jul 28 17:41:28 2022] POST /identity/v3/projects => generated 302 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:41:28.609053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da6b73-8945-4c24-a890-bf311aa78b72 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:28.609600 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da6b73-8945-4c24-a890-bf311aa78b72 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:28.610016 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da6b73-8945-4c24-a890-bf311aa78b72 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:28.616567 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 58/107] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:28.618503 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194134a-557e-4a2f-944b-80058b182930 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:28.618993 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194134a-557e-4a2f-944b-80058b182930 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:28.619409 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194134a-557e-4a2f-944b-80058b182930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:28.633397 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:28.674369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-9194134a-557e-4a2f-944b-80058b182930 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:28.676059 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9194134a-557e-4a2f-944b-80058b182930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:28.703842 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 50/108] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:41:28.709996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2baf875-60b7-45f4-9638-937d8f38a6c9 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:28.805480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 59/109] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:28.826314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194134a-557e-4a2f-944b-80058b182930 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:28.891860 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:28.926227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2baf875-60b7-45f4-9638-937d8f38a6c9 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:28.988689 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194134a-557e-4a2f-944b-80058b182930 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:28.992926 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792a193-fab2-405d-8f07-85872089a5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:28.993830 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792a193-fab2-405d-8f07-85872089a5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:28.994322 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792a193-fab2-405d-8f07-85872089a5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:28.994841 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792a193-fab2-405d-8f07-85872089a5e8 None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:28.997040 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792a193-fab2-405d-8f07-85872089a5e8 None admin] RBAC: Authorizing `identity:get_project(project_id=963ff5e1d9f74853b35cd0babec573b9)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:28.998877 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792a193-fab2-405d-8f07-85872089a5e8 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:29.000771 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 51/110] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:28 2022] GET /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9 => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:29.007531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792a193-fab2-405d-8f07-85872089a5e8 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:29.050326 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91fbff-fcb7-43a4-beef-237737a7dde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:29.051389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91fbff-fcb7-43a4-beef-237737a7dde0 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:29.051887 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91fbff-fcb7-43a4-beef-237737a7dde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:29.052453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91fbff-fcb7-43a4-beef-237737a7dde0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:29.060462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:29.065808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91fbff-fcb7-43a4-beef-237737a7dde0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:29.072410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-0a91fbff-fcb7-43a4-beef-237737a7dde0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:41:29.072410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:29.072410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:29.072410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:29.072410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:29.072410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:29.072410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:29.072410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:29.072410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:29.072410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:29.072410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:29.072410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:29.072410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:29.072410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:29.072410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:29.072410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:29.073289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:29.073289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:29.073289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:29.073289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:29.073289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:29.073289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:29.073289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:29.073289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:29.073289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:29.073289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:29.073289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:29.073289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:29.073289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:29.073289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:29.073289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:29.073289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:29.074046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:29.074046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:29.074046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:29.074046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:29.074046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:29.074046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:29.074046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:29.074046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:29.074046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:29.074046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:29.074046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:41:29.074046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:41:29.076549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 60/111] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:41:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:41:29.082668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91fbff-fcb7-43a4-beef-237737a7dde0 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:29.119817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792a193-fab2-405d-8f07-85872089a5e8 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:29.155782 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c26e0-59d5-4b3d-8fea-fbdd2c010582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:29.156427 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c26e0-59d5-4b3d-8fea-fbdd2c010582 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:29.156729 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c26e0-59d5-4b3d-8fea-fbdd2c010582 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:29.157000 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c26e0-59d5-4b3d-8fea-fbdd2c010582 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:29.157813 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c26e0-59d5-4b3d-8fea-fbdd2c010582 None admin] RBAC: Adding query filter params (role.id=3e04c82538344690a5a6591b125b6b86, scope.project.id=963ff5e1d9f74853b35cd0babec573b9, user.id=d959a4e2c95b48b0ab5437aebd39b254) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:29.158119 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c26e0-59d5-4b3d-8fea-fbdd2c010582 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:29.159628 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c26e0-59d5-4b3d-8fea-fbdd2c010582 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:29.165721 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 52/112] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:41:29 2022] GET /identity/v3/role_assignments?user.id=d959a4e2c95b48b0ab5437aebd39b254&scope.project.id=963ff5e1d9f74853b35cd0babec573b9&role.id=3e04c82538344690a5a6591b125b6b86 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:29.209853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91fbff-fcb7-43a4-beef-237737a7dde0 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:29.211930 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:29.251100 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0aac39-e42e-4510-9e35-a7b7de14f7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:29.252190 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0aac39-e42e-4510-9e35-a7b7de14f7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:29.252680 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0aac39-e42e-4510-9e35-a7b7de14f7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:29.253231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0aac39-e42e-4510-9e35-a7b7de14f7d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:29.254211 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0aac39-e42e-4510-9e35-a7b7de14f7d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:29.254745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0aac39-e42e-4510-9e35-a7b7de14f7d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:29.256459 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0aac39-e42e-4510-9e35-a7b7de14f7d2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:29.267082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 61/113] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:29.280196 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c26e0-59d5-4b3d-8fea-fbdd2c010582 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:29.428549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64710c97-0a6c-436a-98af-c7a7af9a78da None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:29.429390 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64710c97-0a6c-436a-98af-c7a7af9a78da None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:29.429875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64710c97-0a6c-436a-98af-c7a7af9a78da None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:29.431654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 62/114] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:29.434149 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c26e0-59d5-4b3d-8fea-fbdd2c010582 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:29.437606 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ad8c1-d833-4072-9874-757b0951f9e7 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:29.437893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ad8c1-d833-4072-9874-757b0951f9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:29.438196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ad8c1-d833-4072-9874-757b0951f9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:29.448182 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:29.494479 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e6dd9-0886-4f19-8b27-76bf6abcfefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:29.495166 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e6dd9-0886-4f19-8b27-76bf6abcfefa None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:29.495520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e6dd9-0886-4f19-8b27-76bf6abcfefa None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:29.495808 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e6dd9-0886-4f19-8b27-76bf6abcfefa None admin] PATH_INFO: `/v3/users/139abd87c3e347d299314e22a7c95f3f` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:29.497047 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e6dd9-0886-4f19-8b27-76bf6abcfefa None admin] RBAC: Authorizing `identity:get_user(user_id=139abd87c3e347d299314e22a7c95f3f)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:29.498561 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e6dd9-0886-4f19-8b27-76bf6abcfefa None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:29.500205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 53/115] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:29 2022] GET /identity/v3/users/139abd87c3e347d299314e22a7c95f3f => generated 247 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:29.502393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-381ad8c1-d833-4072-9874-757b0951f9e7 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:29.503653 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-381ad8c1-d833-4072-9874-757b0951f9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:29.506831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a9d35-fae4-48d0-955e-6dada593efb0 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:29.507121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a9d35-fae4-48d0-955e-6dada593efb0 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:29.507422 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a9d35-fae4-48d0-955e-6dada593efb0 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:29.508918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 54/116] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:29.514241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a9d35-fae4-48d0-955e-6dada593efb0 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:29.719063 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 63/117] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:41:29.720669 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebf82f-6451-48f8-879e-d41ae5b9d0bf None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:29.720669 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebf82f-6451-48f8-879e-d41ae5b9d0bf None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:29.720928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebf82f-6451-48f8-879e-d41ae5b9d0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:29.770350 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-13ebf82f-6451-48f8-879e-d41ae5b9d0bf None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:29.774602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-13ebf82f-6451-48f8-879e-d41ae5b9d0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:29.793797 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a9d35-fae4-48d0-955e-6dada593efb0 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:29.844332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08533f96-ba57-479e-8149-d050405f94b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:29.844993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08533f96-ba57-479e-8149-d050405f94b2 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:29.845303 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08533f96-ba57-479e-8149-d050405f94b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:29.845584 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08533f96-ba57-479e-8149-d050405f94b2 None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:29.846772 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08533f96-ba57-479e-8149-d050405f94b2 None admin] RBAC: Authorizing `identity:get_project(project_id=963ff5e1d9f74853b35cd0babec573b9)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:29.848230 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08533f96-ba57-479e-8149-d050405f94b2 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:29.859043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 55/118] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:29 2022] GET /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9 => generated 298 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:29.859887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08533f96-ba57-479e-8149-d050405f94b2 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:29.958534 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 64/119] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:29.959450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebf82f-6451-48f8-879e-d41ae5b9d0bf None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:29.971431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:30.013641 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:30.039300 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08533f96-ba57-479e-8149-d050405f94b2 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:30.081213 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453256cc-a885-4eeb-8c91-a1a4cd655a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:30.081871 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453256cc-a885-4eeb-8c91-a1a4cd655a1b None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:30.082151 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453256cc-a885-4eeb-8c91-a1a4cd655a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:30.082432 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453256cc-a885-4eeb-8c91-a1a4cd655a1b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:30.103536 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453256cc-a885-4eeb-8c91-a1a4cd655a1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:30.109253 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebf82f-6451-48f8-879e-d41ae5b9d0bf None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:30.110179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-453256cc-a885-4eeb-8c91-a1a4cd655a1b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:41:30.110179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:30.110179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:30.110179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:30.110179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:30.110179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:30.110179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:30.110179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:30.110179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:30.110179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:30.110179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:30.110179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:30.110179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:30.110179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:30.110179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:30.110179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:30.111240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:30.111240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:30.111240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:30.111240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:30.111240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:30.111240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:30.111240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:30.111240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:30.111240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:30.111240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:30.111240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:30.111240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:30.111240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:30.111240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:30.111240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:30.111240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:30.112152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:30.112152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:30.112152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:30.112152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:30.112152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:30.112152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:30.112152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:30.112152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:30.112152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:30.112152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:30.112152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:41:30.112152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:30.112152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 56/120] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:41:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:30.112798 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0972f-6c9f-4591-a1b5-c0b3ea22dcfe None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:30.113001 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0972f-6c9f-4591-a1b5-c0b3ea22dcfe None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:30.113312 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0972f-6c9f-4591-a1b5-c0b3ea22dcfe None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:30.115939 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 57/121] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:30.120158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0972f-6c9f-4591-a1b5-c0b3ea22dcfe None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:30.153747 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fc02b-bec9-40eb-8375-e599539c2369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:30.154998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fc02b-bec9-40eb-8375-e599539c2369 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:30.155485 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fc02b-bec9-40eb-8375-e599539c2369 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:30.155961 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fc02b-bec9-40eb-8375-e599539c2369 None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9/users/139abd87c3e347d299314e22a7c95f3f/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:30.158345 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fc02b-bec9-40eb-8375-e599539c2369 None admin] RBAC: Authorizing `identity:create_grant(project_id=963ff5e1d9f74853b35cd0babec573b9, user_id=139abd87c3e347d299314e22a7c95f3f, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:30.160075 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fc02b-bec9-40eb-8375-e599539c2369 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:30.176014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 65/122] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:41:29 2022] PUT /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9/users/139abd87c3e347d299314e22a7c95f3f/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:41:30.177210 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fc02b-bec9-40eb-8375-e599539c2369 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:30.313474 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0972f-6c9f-4591-a1b5-c0b3ea22dcfe None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:30.330580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:30.359181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:30.378225 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fc02b-bec9-40eb-8375-e599539c2369 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:30.378785 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed80e4-23b7-4388-83e8-e04abad92f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:30.379441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed80e4-23b7-4388-83e8-e04abad92f80 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:30.379725 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed80e4-23b7-4388-83e8-e04abad92f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:30.380001 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed80e4-23b7-4388-83e8-e04abad92f80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:30.392441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed80e4-23b7-4388-83e8-e04abad92f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:30.397862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-08ed80e4-23b7-4388-83e8-e04abad92f80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:30.397862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:30.397862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:30.397862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:30.397862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:30.397862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:30.397862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:30.397862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:30.397862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:30.397862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:30.397862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:30.397862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:30.397862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:30.397862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:30.397862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:30.397862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:30.398701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:30.398701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:30.398701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:30.398701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:30.398701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:30.398701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:30.398701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:30.398701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:30.398701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:30.398701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:30.398701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:30.398701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:30.398701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:30.398701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:30.398701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:30.398701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:30.399473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:30.399473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:30.399473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:30.399473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:30.399473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:30.399473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:30.399473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:30.399473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:30.399473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:30.399473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:30.399473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:30.399473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:30.399473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 58/123] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:30.400840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd45f6-e27d-4406-b929-d7fb8bdd6d94 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:30.405397 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd45f6-e27d-4406-b929-d7fb8bdd6d94 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:30.405724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd45f6-e27d-4406-b929-d7fb8bdd6d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:30.424500 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7b089-ea9b-4f87-8921-2d34f14215ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:30.425612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7b089-ea9b-4f87-8921-2d34f14215ac None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:30.426118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7b089-ea9b-4f87-8921-2d34f14215ac None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:30.426410 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-b8cd45f6-e27d-4406-b929-d7fb8bdd6d94 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:30.426846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7b089-ea9b-4f87-8921-2d34f14215ac None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:30.427694 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b8cd45f6-e27d-4406-b929-d7fb8bdd6d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:30.428119 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa7b089-ea9b-4f87-8921-2d34f14215ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:30.428632 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa7b089-ea9b-4f87-8921-2d34f14215ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:30.430465 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa7b089-ea9b-4f87-8921-2d34f14215ac None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:30.440319 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 66/124] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:41:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:30.441588 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7b089-ea9b-4f87-8921-2d34f14215ac None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:30.503533 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 59/125] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:30.504519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd45f6-e27d-4406-b929-d7fb8bdd6d94 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:30.587664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7b089-ea9b-4f87-8921-2d34f14215ac None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:30.635175 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:30.641856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd45f6-e27d-4406-b929-d7fb8bdd6d94 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:30.657475 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416be8d-cfb3-435a-a67f-dd6d4946b4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:30.658110 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416be8d-cfb3-435a-a67f-dd6d4946b4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:30.658391 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416be8d-cfb3-435a-a67f-dd6d4946b4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:30.658668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416be8d-cfb3-435a-a67f-dd6d4946b4f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:30.659481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416be8d-cfb3-435a-a67f-dd6d4946b4f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:30.659882 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416be8d-cfb3-435a-a67f-dd6d4946b4f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:30.661291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416be8d-cfb3-435a-a67f-dd6d4946b4f7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:30.676877 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93edd94-079f-4361-bdc0-187ee273b95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:30.677564 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93edd94-079f-4361-bdc0-187ee273b95c None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:30.677874 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93edd94-079f-4361-bdc0-187ee273b95c None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:30.678154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93edd94-079f-4361-bdc0-187ee273b95c None admin] PATH_INFO: `/v3/users/8f485e8f65e54640b471926b42d2c321` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:30.679335 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93edd94-079f-4361-bdc0-187ee273b95c None admin] RBAC: Authorizing `identity:get_user(user_id=8f485e8f65e54640b471926b42d2c321)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:30.680795 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93edd94-079f-4361-bdc0-187ee273b95c None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:30.680908 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 67/126] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:30.681686 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416be8d-cfb3-435a-a67f-dd6d4946b4f7 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:30.686933 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 60/127] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:30 2022] GET /identity/v3/users/8f485e8f65e54640b471926b42d2c321 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:30.688565 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93edd94-079f-4361-bdc0-187ee273b95c None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:30.703782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:30.796250 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93edd94-079f-4361-bdc0-187ee273b95c None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:30.831381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af371a-79dc-4f8f-b534-c341607bb538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:30.831932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af371a-79dc-4f8f-b534-c341607bb538 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:30.832217 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af371a-79dc-4f8f-b534-c341607bb538 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:30.832494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af371a-79dc-4f8f-b534-c341607bb538 None admin] PATH_INFO: `/v3/users/8f485e8f65e54640b471926b42d2c321` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:30.833706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af371a-79dc-4f8f-b534-c341607bb538 None admin] RBAC: Authorizing `identity:get_user(user_id=8f485e8f65e54640b471926b42d2c321)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:30.835506 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af371a-79dc-4f8f-b534-c341607bb538 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:30.837466 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 61/128] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:30 2022] GET /identity/v3/users/8f485e8f65e54640b471926b42d2c321 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:30.842037 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af371a-79dc-4f8f-b534-c341607bb538 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:30.875297 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:30.891217 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416be8d-cfb3-435a-a67f-dd6d4946b4f7 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:30.946777 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af371a-79dc-4f8f-b534-c341607bb538 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:30.981583 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59a272-498c-4e3a-9bb4-cbf9c339dc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:30.982235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59a272-498c-4e3a-9bb4-cbf9c339dc20 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:30.982525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59a272-498c-4e3a-9bb4-cbf9c339dc20 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:30.982905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59a272-498c-4e3a-9bb4-cbf9c339dc20 None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:30.984079 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59a272-498c-4e3a-9bb4-cbf9c339dc20 None admin] RBAC: Authorizing `identity:get_project(project_id=963ff5e1d9f74853b35cd0babec573b9)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:30.985563 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59a272-498c-4e3a-9bb4-cbf9c339dc20 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:30.987400 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 62/129] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:30 2022] GET /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:30.988287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59a272-498c-4e3a-9bb4-cbf9c339dc20 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:31.001803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e7889-563a-4405-a198-b6f8325595af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:31.002492 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e7889-563a-4405-a198-b6f8325595af None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:31.002780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e7889-563a-4405-a198-b6f8325595af None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:31.003061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e7889-563a-4405-a198-b6f8325595af None admin] PATH_INFO: `/v3/roles/member` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:31.061781 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e7889-563a-4405-a198-b6f8325595af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:31.067706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-1d8e7889-563a-4405-a198-b6f8325595af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:31.067706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:31.067706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:31.067706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:31.067706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:31.067706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:31.067706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:31.067706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:31.067706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:31.067706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:31.067706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:31.067706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:31.067706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:31.067706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:31.067706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:31.067706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:31.068630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:31.068630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:31.068630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:31.068630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:31.068630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:31.068630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:31.068630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:31.068630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:31.068630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:31.068630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:31.068630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:31.068630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:31.068630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:31.068630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:31.068630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:31.068630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:31.069419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:31.069419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:31.069419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:31.069419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:31.069419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:31.069419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:31.069419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:31.069419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:31.069419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:31.069419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:31.069419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:31.069419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:41:31.069419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 68/130] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:31.070576 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e7889-563a-4405-a198-b6f8325595af None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:31.093277 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59a272-498c-4e3a-9bb4-cbf9c339dc20 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:31.104583 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:31.129596 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e6abe-e3da-46f4-8cc8-5e8b4ac6bf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:31.130266 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e6abe-e3da-46f4-8cc8-5e8b4ac6bf9a None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:31.130549 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e6abe-e3da-46f4-8cc8-5e8b4ac6bf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:31.130926 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e6abe-e3da-46f4-8cc8-5e8b4ac6bf9a None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:31.132398 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e6abe-e3da-46f4-8cc8-5e8b4ac6bf9a None admin] RBAC: Authorizing `identity:get_project(project_id=963ff5e1d9f74853b35cd0babec573b9)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:31.134177 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e6abe-e3da-46f4-8cc8-5e8b4ac6bf9a None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:31.135659 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 63/131] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:30 2022] GET /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:31.141439 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e6abe-e3da-46f4-8cc8-5e8b4ac6bf9a None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:31.247326 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e6abe-e3da-46f4-8cc8-5e8b4ac6bf9a None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:31.274347 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:31.285746 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3ed49-c00f-47ba-bae4-ec744aa2c3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:31.286626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3ed49-c00f-47ba-bae4-ec744aa2c3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:31.287103 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3ed49-c00f-47ba-bae4-ec744aa2c3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:31.287575 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3ed49-c00f-47ba-bae4-ec744aa2c3e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:31.288432 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3ed49-c00f-47ba-bae4-ec744aa2c3e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:31.288886 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3ed49-c00f-47ba-bae4-ec744aa2c3e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:31.290456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3ed49-c00f-47ba-bae4-ec744aa2c3e1 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:31.299327 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 64/132] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:31.300422 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3ed49-c00f-47ba-bae4-ec744aa2c3e1 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:31.345596 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:31.403713 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3ed49-c00f-47ba-bae4-ec744aa2c3e1 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:31.407021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e7889-563a-4405-a198-b6f8325595af None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:31.446410 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe72c8-e61e-415c-b552-0579396b6dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:31.447421 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe72c8-e61e-415c-b552-0579396b6dcd None admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:31.447885 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe72c8-e61e-415c-b552-0579396b6dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:31.448335 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe72c8-e61e-415c-b552-0579396b6dcd None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9/users/8f485e8f65e54640b471926b42d2c321/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:31.450778 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe72c8-e61e-415c-b552-0579396b6dcd None admin] RBAC: Authorizing `identity:create_grant(project_id=963ff5e1d9f74853b35cd0babec573b9, user_id=8f485e8f65e54640b471926b42d2c321, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:31.453355 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe72c8-e61e-415c-b552-0579396b6dcd None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:31.489167 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 65/133] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:41:31 2022] PUT /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9/users/8f485e8f65e54640b471926b42d2c321/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:41:31.490830 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe72c8-e61e-415c-b552-0579396b6dcd None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:31.493492 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad7c27-c14e-4767-9ae3-a7b690129b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:31.495546 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad7c27-c14e-4767-9ae3-a7b690129b2b None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:31.496045 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad7c27-c14e-4767-9ae3-a7b690129b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:31.496499 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad7c27-c14e-4767-9ae3-a7b690129b2b None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9/users/8f485e8f65e54640b471926b42d2c321/roles/5b95c3aebc8041c7885a9234a9e54d7c` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:31.501730 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad7c27-c14e-4767-9ae3-a7b690129b2b None admin] RBAC: Authorizing `identity:create_grant(project_id=963ff5e1d9f74853b35cd0babec573b9, user_id=8f485e8f65e54640b471926b42d2c321, role_id=5b95c3aebc8041c7885a9234a9e54d7c)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:31.503861 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad7c27-c14e-4767-9ae3-a7b690129b2b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:31.531839 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 69/134] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:41:31 2022] PUT /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9/users/8f485e8f65e54640b471926b42d2c321/roles/5b95c3aebc8041c7885a9234a9e54d7c => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:41:31.533830 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc2d9c-a65e-419a-a8ce-c81faa2d05f7 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:31.534303 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc2d9c-a65e-419a-a8ce-c81faa2d05f7 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:31.534770 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc2d9c-a65e-419a-a8ce-c81faa2d05f7 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:31.536278 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 70/135] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:31.543455 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f2082-f8cd-4631-b130-0a1de094fbff None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:31.544022 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f2082-f8cd-4631-b130-0a1de094fbff None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:31.544875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f2082-f8cd-4631-b130-0a1de094fbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:31.583606 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-4b4f2082-f8cd-4631-b130-0a1de094fbff None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:31.585662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4b4f2082-f8cd-4631-b130-0a1de094fbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:31.675514 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:31.697976 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe72c8-e61e-415c-b552-0579396b6dcd None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:31.738249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 71/136] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:31.739561 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97d8ea-2bcd-41f1-ab24-fbab0ad4501e None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:31.739851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97d8ea-2bcd-41f1-ab24-fbab0ad4501e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:31.740155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97d8ea-2bcd-41f1-ab24-fbab0ad4501e None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:31.741855 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 72/137] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:31.747375 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a0e72-f8c3-4ec3-8c94-a226928e39c6 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:31.747659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a0e72-f8c3-4ec3-8c94-a226928e39c6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:31.747941 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a0e72-f8c3-4ec3-8c94-a226928e39c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:31.761023 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757c493-54c4-4a59-81ae-d1b741414546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:31.761724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757c493-54c4-4a59-81ae-d1b741414546 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:31.762007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757c493-54c4-4a59-81ae-d1b741414546 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:31.762293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757c493-54c4-4a59-81ae-d1b741414546 None admin] PATH_INFO: `/v3/users/8f485e8f65e54640b471926b42d2c321` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:31.763525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757c493-54c4-4a59-81ae-d1b741414546 None admin] RBAC: Authorizing `identity:get_user(user_id=8f485e8f65e54640b471926b42d2c321)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:31.765413 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757c493-54c4-4a59-81ae-d1b741414546 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:31.767263 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 66/138] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:31 2022] GET /identity/v3/users/8f485e8f65e54640b471926b42d2c321 => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:31.772928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757c493-54c4-4a59-81ae-d1b741414546 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:31.775896 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c21a0e72-f8c3-4ec3-8c94-a226928e39c6 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:31.777675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c21a0e72-f8c3-4ec3-8c94-a226928e39c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:31.853556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:31.877566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 73/139] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:41:31.878587 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a0e72-f8c3-4ec3-8c94-a226928e39c6 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:31.915158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757c493-54c4-4a59-81ae-d1b741414546 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:31.976265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e59f7-b594-4b14-bb1b-ac55a7d953d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:31.977416 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e59f7-b594-4b14-bb1b-ac55a7d953d2 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:31.985084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e59f7-b594-4b14-bb1b-ac55a7d953d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:31.985084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e59f7-b594-4b14-bb1b-ac55a7d953d2 None admin] PATH_INFO: `/v3/projects/fdf1bc163f9645af9b60ecd0c3157bd4` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:31.989111 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e59f7-b594-4b14-bb1b-ac55a7d953d2 None admin] RBAC: Authorizing `identity:get_project(project_id=fdf1bc163f9645af9b60ecd0c3157bd4)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:31.995324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e59f7-b594-4b14-bb1b-ac55a7d953d2 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:31.997646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 67/140] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:31 2022] GET /identity/v3/projects/fdf1bc163f9645af9b60ecd0c3157bd4 => generated 312 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:31.998551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e59f7-b594-4b14-bb1b-ac55a7d953d2 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:32.051879 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a0e72-f8c3-4ec3-8c94-a226928e39c6 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:32.063780 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:32.129782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed54b0-2a7e-494b-96c5-4684ddc974e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:32.130462 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed54b0-2a7e-494b-96c5-4684ddc974e6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:32.130876 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed54b0-2a7e-494b-96c5-4684ddc974e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:32.131183 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed54b0-2a7e-494b-96c5-4684ddc974e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:32.155747 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed54b0-2a7e-494b-96c5-4684ddc974e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:32.161585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-d6ed54b0-2a7e-494b-96c5-4684ddc974e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:41:32.161585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:32.161585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:32.161585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:32.161585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:32.161585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:32.161585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:32.161585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:32.161585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:32.161585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:32.161585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:32.161585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:32.161585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:32.161585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:32.161585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:32.161585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:32.162478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:32.162478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:32.162478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:32.162478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:32.162478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:32.162478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:32.162478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:32.162478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:32.162478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:32.162478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:32.162478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:32.162478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:32.162478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:32.162478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:32.162478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:32.162478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:32.163220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:32.163220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:32.163220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:32.163220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:32.163220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:32.163220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:32.163220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:32.163220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:32.163220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:32.163220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:32.163220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:41:32.163220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:41:32.165819 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 74/141] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:32.166675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed54b0-2a7e-494b-96c5-4684ddc974e6 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:32.203675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e59f7-b594-4b14-bb1b-ac55a7d953d2 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:32.257462 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:32.264928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ced90-4073-4a47-8096-d0dca43d6721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:32.265759 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ced90-4073-4a47-8096-d0dca43d6721 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:32.266175 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ced90-4073-4a47-8096-d0dca43d6721 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:32.266459 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ced90-4073-4a47-8096-d0dca43d6721 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:32.267692 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ced90-4073-4a47-8096-d0dca43d6721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:32.269195 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ced90-4073-4a47-8096-d0dca43d6721 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:32.270971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 68/142] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:41:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:32.271618 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ced90-4073-4a47-8096-d0dca43d6721 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:32.353687 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed54b0-2a7e-494b-96c5-4684ddc974e6 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:32.415314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b1149-8c15-4dca-9057-681527e74c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:32.416354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:32.416994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b1149-8c15-4dca-9057-681527e74c3e None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:32.417329 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b1149-8c15-4dca-9057-681527e74c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:32.417826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b1149-8c15-4dca-9057-681527e74c3e None admin] PATH_INFO: `/v3/projects/fdf1bc163f9645af9b60ecd0c3157bd4/users/8f485e8f65e54640b471926b42d2c321/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:32.423140 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b1149-8c15-4dca-9057-681527e74c3e None admin] RBAC: Authorizing `identity:create_grant(project_id=fdf1bc163f9645af9b60ecd0c3157bd4, user_id=8f485e8f65e54640b471926b42d2c321, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:32.424631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b1149-8c15-4dca-9057-681527e74c3e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:32.427214 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ced90-4073-4a47-8096-d0dca43d6721 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:32.450639 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 75/143] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:41:32 2022] PUT /identity/v3/projects/fdf1bc163f9645af9b60ecd0c3157bd4/users/8f485e8f65e54640b471926b42d2c321/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:41:32.451471 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b1149-8c15-4dca-9057-681527e74c3e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:32.495284 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862107b-eefc-4fa8-b348-41508e71bbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:32.496015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862107b-eefc-4fa8-b348-41508e71bbcc None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:32.496298 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862107b-eefc-4fa8-b348-41508e71bbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:32.497823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862107b-eefc-4fa8-b348-41508e71bbcc None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:32.498594 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862107b-eefc-4fa8-b348-41508e71bbcc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:32.498902 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862107b-eefc-4fa8-b348-41508e71bbcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:32.500599 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862107b-eefc-4fa8-b348-41508e71bbcc None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:32.521459 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 69/144] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:32.530914 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862107b-eefc-4fa8-b348-41508e71bbcc None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:32.653863 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b1149-8c15-4dca-9057-681527e74c3e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:32.669352 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:32.697756 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95556c15-8a06-47a6-92c5-2b6d2f8c75e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:32.698403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95556c15-8a06-47a6-92c5-2b6d2f8c75e3 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:32.698696 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95556c15-8a06-47a6-92c5-2b6d2f8c75e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:32.698981 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95556c15-8a06-47a6-92c5-2b6d2f8c75e3 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:32.699694 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95556c15-8a06-47a6-92c5-2b6d2f8c75e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:32.701459 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95556c15-8a06-47a6-92c5-2b6d2f8c75e3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:32.734589 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 76/145] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Jul 28 17:41:32 2022] POST /identity/v3/users => generated 283 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:41:32.743442 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862107b-eefc-4fa8-b348-41508e71bbcc None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:32.796939 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0cfcc-7f1e-4b56-a7b4-3a4458594ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:32.797555 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0cfcc-7f1e-4b56-a7b4-3a4458594ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:32.797840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0cfcc-7f1e-4b56-a7b4-3a4458594ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:32.799067 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0cfcc-7f1e-4b56-a7b4-3a4458594ea0 None admin] PATH_INFO: `/v3/users/d959a4e2c95b48b0ab5437aebd39b254` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:32.802101 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0cfcc-7f1e-4b56-a7b4-3a4458594ea0 None admin] RBAC: Authorizing `identity:get_user(user_id=d959a4e2c95b48b0ab5437aebd39b254)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:32.804476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0cfcc-7f1e-4b56-a7b4-3a4458594ea0 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:32.806391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 70/146] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:32 2022] GET /identity/v3/users/d959a4e2c95b48b0ab5437aebd39b254 => generated 289 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:32.811890 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95556c15-8a06-47a6-92c5-2b6d2f8c75e3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:32.940223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95556c15-8a06-47a6-92c5-2b6d2f8c75e3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:32.980065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a1de8-335c-40d5-ae8a-d7d36f838556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:32.980735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a1de8-335c-40d5-ae8a-d7d36f838556 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:32.981023 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a1de8-335c-40d5-ae8a-d7d36f838556 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:32.981330 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a1de8-335c-40d5-ae8a-d7d36f838556 None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:32.982522 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a1de8-335c-40d5-ae8a-d7d36f838556 None admin] RBAC: Authorizing `identity:get_project(project_id=963ff5e1d9f74853b35cd0babec573b9)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:32.983997 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a1de8-335c-40d5-ae8a-d7d36f838556 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:32.985751 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 77/147] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:32 2022] GET /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:32.992722 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0cfcc-7f1e-4b56-a7b4-3a4458594ea0 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:32.999311 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe131a-30ae-4ecc-acfc-985eb06b83e6 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:32.999631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe131a-30ae-4ecc-acfc-985eb06b83e6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:33.000273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe131a-30ae-4ecc-acfc-985eb06b83e6 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:33.002980 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 78/148] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:33.013322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ef03-642b-4e45-ad5c-b6bee439ad28 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:33.013604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ef03-642b-4e45-ad5c-b6bee439ad28 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:33.014222 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ef03-642b-4e45-ad5c-b6bee439ad28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:33.045715 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:33.048883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-8741ef03-642b-4e45-ad5c-b6bee439ad28 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:33.050006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8741ef03-642b-4e45-ad5c-b6bee439ad28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:33.115305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:33.192987 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 79/149] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:41:33.200178 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0cfcc-7f1e-4b56-a7b4-3a4458594ea0 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:33.234838 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741ef03-642b-4e45-ad5c-b6bee439ad28 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:33.259445 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccbf7f-1420-4d87-bd88-da27233d806a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:33.260120 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccbf7f-1420-4d87-bd88-da27233d806a None admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:33.260438 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccbf7f-1420-4d87-bd88-da27233d806a None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:33.260712 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccbf7f-1420-4d87-bd88-da27233d806a None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9/users/d959a4e2c95b48b0ab5437aebd39b254/roles/3e04c82538344690a5a6591b125b6b86` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:33.267052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccbf7f-1420-4d87-bd88-da27233d806a None admin] RBAC: Authorizing `identity:create_grant(project_id=963ff5e1d9f74853b35cd0babec573b9, user_id=d959a4e2c95b48b0ab5437aebd39b254, role_id=3e04c82538344690a5a6591b125b6b86)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:33.268636 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccbf7f-1420-4d87-bd88-da27233d806a None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:33.297368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 71/150] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:41:32 2022] PUT /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9/users/d959a4e2c95b48b0ab5437aebd39b254/roles/3e04c82538344690a5a6591b125b6b86 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:41:33.369586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741ef03-642b-4e45-ad5c-b6bee439ad28 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:33.409826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d47bd-b347-4685-b38f-da5257df4849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:33.410517 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d47bd-b347-4685-b38f-da5257df4849 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:33.410802 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d47bd-b347-4685-b38f-da5257df4849 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:33.411076 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d47bd-b347-4685-b38f-da5257df4849 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:33.423867 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d47bd-b347-4685-b38f-da5257df4849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:33.429129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-256d47bd-b347-4685-b38f-da5257df4849 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:41:33.429129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:33.429129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:33.429129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:33.429129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:33.429129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:33.429129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:33.429129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:33.429129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:33.429129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:33.429129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:33.429129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:33.429129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:33.429129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:33.429129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:33.429129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:33.430019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:33.430019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:33.430019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:33.430019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:33.430019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:33.430019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:33.430019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:33.430019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:33.430019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:33.430019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:33.430019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:33.430019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:33.430019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:33.430019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:33.430019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:33.430019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:33.430780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:33.430780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:33.430780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:33.430780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:33.430780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:33.430780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:33.430780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:33.430780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:33.430780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:33.430780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:33.430780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:41:33.430780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:41:33.430780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 80/151] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:41:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:41:33.437625 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccbf7f-1420-4d87-bd88-da27233d806a None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:33.564084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:33.581593 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccbf7f-1420-4d87-bd88-da27233d806a None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:33.622120 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da5595-8c97-494f-b84f-1328f44eb07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:33.622671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da5595-8c97-494f-b84f-1328f44eb07d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:33.622949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da5595-8c97-494f-b84f-1328f44eb07d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:33.623222 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da5595-8c97-494f-b84f-1328f44eb07d None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:33.623948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da5595-8c97-494f-b84f-1328f44eb07d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:33.624250 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da5595-8c97-494f-b84f-1328f44eb07d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:33.625692 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da5595-8c97-494f-b84f-1328f44eb07d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:33.637049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 72/152] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:33.643137 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d47bd-b347-4685-b38f-da5257df4849 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:33.672332 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:33.769852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d47bd-b347-4685-b38f-da5257df4849 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:33.810096 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857a11c-b2c3-4258-a86a-5a4f78d74a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:33.810747 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857a11c-b2c3-4258-a86a-5a4f78d74a0b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:33.811100 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857a11c-b2c3-4258-a86a-5a4f78d74a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:33.811296 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857a11c-b2c3-4258-a86a-5a4f78d74a0b None admin] PATH_INFO: `/v3/users/139abd87c3e347d299314e22a7c95f3f` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:33.817772 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857a11c-b2c3-4258-a86a-5a4f78d74a0b None admin] RBAC: Authorizing `identity:get_user(user_id=139abd87c3e347d299314e22a7c95f3f)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:33.819344 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857a11c-b2c3-4258-a86a-5a4f78d74a0b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:33.821004 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 81/153] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:33 2022] GET /identity/v3/users/139abd87c3e347d299314e22a7c95f3f => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:33.826884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da5595-8c97-494f-b84f-1328f44eb07d None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:33.960903 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da5595-8c97-494f-b84f-1328f44eb07d None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:34.005835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfbd6b-d82f-433b-aa7b-77c54087cdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:34.006654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfbd6b-d82f-433b-aa7b-77c54087cdd1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:34.006778 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfbd6b-d82f-433b-aa7b-77c54087cdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:34.007066 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfbd6b-d82f-433b-aa7b-77c54087cdd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:34.033411 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:34.103217 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfbd6b-d82f-433b-aa7b-77c54087cdd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:34.104690 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfbd6b-d82f-433b-aa7b-77c54087cdd1 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:34.177847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832da1fe-a5ca-435d-ad72-8ae67bc19a5a None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:34.178427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832da1fe-a5ca-435d-ad72-8ae67bc19a5a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:34.178427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832da1fe-a5ca-435d-ad72-8ae67bc19a5a None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:34.179745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 82/154] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:34.195778 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4241f-7207-4588-9ad3-2f1bb2021912 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:34.196081 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4241f-7207-4588-9ad3-2f1bb2021912 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:34.196331 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4241f-7207-4588-9ad3-2f1bb2021912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:34.225913 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-52c4241f-7207-4588-9ad3-2f1bb2021912 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:34.227049 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-52c4241f-7207-4588-9ad3-2f1bb2021912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:34.285472 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 73/155] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:41:34.291467 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfbd6b-d82f-433b-aa7b-77c54087cdd1 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:34.377473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:34.401567 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 83/156] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:34.444011 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4241f-7207-4588-9ad3-2f1bb2021912 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:34.472885 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfbd6b-d82f-433b-aa7b-77c54087cdd1 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:34.493541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:34.579140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f181529-9790-4bdb-8a95-fde2513c1f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:34.580184 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f181529-9790-4bdb-8a95-fde2513c1f23 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:34.580679 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f181529-9790-4bdb-8a95-fde2513c1f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:34.581201 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f181529-9790-4bdb-8a95-fde2513c1f23 None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:34.585899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f181529-9790-4bdb-8a95-fde2513c1f23 None admin] RBAC: Authorizing `identity:get_project(project_id=963ff5e1d9f74853b35cd0babec573b9)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:34.587611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f181529-9790-4bdb-8a95-fde2513c1f23 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:34.589659 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 74/157] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:34 2022] GET /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:34.595591 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f181529-9790-4bdb-8a95-fde2513c1f23 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:34.660620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4241f-7207-4588-9ad3-2f1bb2021912 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:34.721691 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ddf18-29cc-48d3-be53-1105aba63649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:34.722609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ddf18-29cc-48d3-be53-1105aba63649 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:34.722896 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ddf18-29cc-48d3-be53-1105aba63649 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:34.723173 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ddf18-29cc-48d3-be53-1105aba63649 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:34.744878 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ddf18-29cc-48d3-be53-1105aba63649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:34.751851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-ac9ddf18-29cc-48d3-be53-1105aba63649 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:41:34.751851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:34.751851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:34.751851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:34.751851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:34.751851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:34.751851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:34.751851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:34.751851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:34.751851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:34.751851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:34.751851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:34.751851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:34.751851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:34.751851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:34.751851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:34.752805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:34.752805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:34.752805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:34.752805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:34.752805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:34.752805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:34.752805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:34.752805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:34.752805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:34.752805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:34.752805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:34.752805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:34.752805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:34.752805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:34.752805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:34.752805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:34.753597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:34.753597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:34.753597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:34.753597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:34.753597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:34.753597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:34.753597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:34.753597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:34.753597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:34.753597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:34.753597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:41:34.753597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:41:34.753597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 84/158] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:41:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:41:34.759508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ddf18-29cc-48d3-be53-1105aba63649 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:34.834634 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f181529-9790-4bdb-8a95-fde2513c1f23 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:34.870701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:34.903070 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:34.925006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ddf18-29cc-48d3-be53-1105aba63649 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:34.960264 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a445fa-5187-484c-af44-9efb17b65c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:34.960937 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a445fa-5187-484c-af44-9efb17b65c87 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:34.961299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a445fa-5187-484c-af44-9efb17b65c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:34.961566 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a445fa-5187-484c-af44-9efb17b65c87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:34.962643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a445fa-5187-484c-af44-9efb17b65c87 None admin] RBAC: Adding query filter params (role.id=980cae90acae42189f92fd6dd42867a5, scope.project.id=963ff5e1d9f74853b35cd0babec573b9, user.id=139abd87c3e347d299314e22a7c95f3f) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:34.963122 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a445fa-5187-484c-af44-9efb17b65c87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:34.963228 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe3c83-fbfe-40b4-8a00-ce2ed9120cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:34.963940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe3c83-fbfe-40b4-8a00-ce2ed9120cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:34.964316 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe3c83-fbfe-40b4-8a00-ce2ed9120cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:34.964682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe3c83-fbfe-40b4-8a00-ce2ed9120cd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:34.965373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a445fa-5187-484c-af44-9efb17b65c87 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:34.965617 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe3c83-fbfe-40b4-8a00-ce2ed9120cd6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:34.966015 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe3c83-fbfe-40b4-8a00-ce2ed9120cd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:34.967577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe3c83-fbfe-40b4-8a00-ce2ed9120cd6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:34.977921 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 85/159] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:41:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:34.983925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe3c83-fbfe-40b4-8a00-ce2ed9120cd6 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:34.986197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 75/160] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:41:34 2022] GET /identity/v3/role_assignments?user.id=139abd87c3e347d299314e22a7c95f3f&scope.project.id=963ff5e1d9f74853b35cd0babec573b9&role.id=980cae90acae42189f92fd6dd42867a5 => generated 608 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:35.015067 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c59bec-3dde-4a44-a7fc-c35dfd8e7505 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:35.016116 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c59bec-3dde-4a44-a7fc-c35dfd8e7505 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:35.016585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c59bec-3dde-4a44-a7fc-c35dfd8e7505 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:35.018173 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 76/161] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:35.032173 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd2ae5-8e1c-4e18-8684-7f247cfa3caf None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:35.032778 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd2ae5-8e1c-4e18-8684-7f247cfa3caf None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:35.033283 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd2ae5-8e1c-4e18-8684-7f247cfa3caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:35.080938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-13cd2ae5-8e1c-4e18-8684-7f247cfa3caf None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:35.082502 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-13cd2ae5-8e1c-4e18-8684-7f247cfa3caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:35.126066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe3c83-fbfe-40b4-8a00-ce2ed9120cd6 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:35.179344 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b056612-3958-4bd0-beb1-b9a6aa12b8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:35.180010 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b056612-3958-4bd0-beb1-b9a6aa12b8ce None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:35.180288 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b056612-3958-4bd0-beb1-b9a6aa12b8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:35.180566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b056612-3958-4bd0-beb1-b9a6aa12b8ce None admin] PATH_INFO: `/v3/users/8f485e8f65e54640b471926b42d2c321` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:35.185090 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b056612-3958-4bd0-beb1-b9a6aa12b8ce None admin] RBAC: Authorizing `identity:get_user(user_id=8f485e8f65e54640b471926b42d2c321)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:35.185090 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b056612-3958-4bd0-beb1-b9a6aa12b8ce None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:35.185907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 86/162] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:34 2022] GET /identity/v3/users/8f485e8f65e54640b471926b42d2c321 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:35.191781 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b056612-3958-4bd0-beb1-b9a6aa12b8ce None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:35.229484 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:35.310760 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b056612-3958-4bd0-beb1-b9a6aa12b8ce None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:35.343383 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 77/163] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:35.347749 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024e4ac-8d5c-4fa3-8bf5-da2b816b35cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:35.348383 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024e4ac-8d5c-4fa3-8bf5-da2b816b35cf None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:35.348661 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024e4ac-8d5c-4fa3-8bf5-da2b816b35cf None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:35.348934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024e4ac-8d5c-4fa3-8bf5-da2b816b35cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:35.403871 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd2ae5-8e1c-4e18-8684-7f247cfa3caf None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:35.425784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024e4ac-8d5c-4fa3-8bf5-da2b816b35cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:35.427256 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024e4ac-8d5c-4fa3-8bf5-da2b816b35cf None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:35.441511 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:35.540793 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 87/164] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:41:35.547154 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024e4ac-8d5c-4fa3-8bf5-da2b816b35cf None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:35.663343 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024e4ac-8d5c-4fa3-8bf5-da2b816b35cf None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:35.686138 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:35.704903 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb3043-fbd4-459f-a6ca-b6d59a12e4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:35.705594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb3043-fbd4-459f-a6ca-b6d59a12e4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:35.705872 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb3043-fbd4-459f-a6ca-b6d59a12e4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:35.706144 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb3043-fbd4-459f-a6ca-b6d59a12e4a7 None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:35.707330 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb3043-fbd4-459f-a6ca-b6d59a12e4a7 None admin] RBAC: Authorizing `identity:get_project(project_id=963ff5e1d9f74853b35cd0babec573b9)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:35.708813 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb3043-fbd4-459f-a6ca-b6d59a12e4a7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:35.713083 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 88/165] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:35 2022] GET /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:35.717284 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb3043-fbd4-459f-a6ca-b6d59a12e4a7 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:35.748793 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd2ae5-8e1c-4e18-8684-7f247cfa3caf None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:35.768757 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:35.840209 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb3043-fbd4-459f-a6ca-b6d59a12e4a7 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:35.844538 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72825d4c-4adf-4c88-82dd-2f742150e02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:35.845620 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72825d4c-4adf-4c88-82dd-2f742150e02c None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:35.846091 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72825d4c-4adf-4c88-82dd-2f742150e02c None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:35.846545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72825d4c-4adf-4c88-82dd-2f742150e02c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:35.869334 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72825d4c-4adf-4c88-82dd-2f742150e02c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:35.878974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-72825d4c-4adf-4c88-82dd-2f742150e02c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:35.878974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:35.878974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:35.878974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:35.878974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:35.878974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:35.878974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:35.878974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:35.878974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:35.878974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:35.878974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:35.878974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:35.878974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:35.878974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:35.878974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:35.878974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:35.879817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:35.879817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:35.879817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:35.879817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:35.879817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:35.879817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:35.879817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:35.879817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:35.879817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:35.879817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:35.879817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:35.879817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:35.879817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:35.879817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:35.879817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:35.879817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:35.880868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:35.880868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:35.880868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:35.880868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:35.880868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:35.880868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:35.880868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:35.880868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:35.880868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:35.880868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:35.880868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:35.880868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:35.880868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 78/166] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 477 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:35.889423 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569349b-9576-4343-9bcc-84ef01a82f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:35.890061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569349b-9576-4343-9bcc-84ef01a82f02 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:35.890335 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569349b-9576-4343-9bcc-84ef01a82f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:35.890603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569349b-9576-4343-9bcc-84ef01a82f02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:35.891406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569349b-9576-4343-9bcc-84ef01a82f02 None admin] RBAC: Adding query filter params (role.id=5b95c3aebc8041c7885a9234a9e54d7c, scope.project.id=963ff5e1d9f74853b35cd0babec573b9, user.id=8f485e8f65e54640b471926b42d2c321) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:35.891713 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569349b-9576-4343-9bcc-84ef01a82f02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:35.893177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569349b-9576-4343-9bcc-84ef01a82f02 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:35.895320 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72825d4c-4adf-4c88-82dd-2f742150e02c None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:35.917672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 89/167] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:41:35 2022] GET /identity/v3/role_assignments?user.id=8f485e8f65e54640b471926b42d2c321&scope.project.id=963ff5e1d9f74853b35cd0babec573b9&role.id=5b95c3aebc8041c7885a9234a9e54d7c => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:36.062012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72825d4c-4adf-4c88-82dd-2f742150e02c None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:36.105019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f09908-8f5a-45d4-9391-50bc2f2e02d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:36.105681 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f09908-8f5a-45d4-9391-50bc2f2e02d0 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:36.105960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f09908-8f5a-45d4-9391-50bc2f2e02d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:36.106229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f09908-8f5a-45d4-9391-50bc2f2e02d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:36.106965 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f09908-8f5a-45d4-9391-50bc2f2e02d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:36.107267 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f09908-8f5a-45d4-9391-50bc2f2e02d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:36.108688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f09908-8f5a-45d4-9391-50bc2f2e02d0 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:36.121560 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 79/168] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:36.127288 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569349b-9576-4343-9bcc-84ef01a82f02 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:36.185805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:36.254273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569349b-9576-4343-9bcc-84ef01a82f02 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:36.293121 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04570270-6f2c-4707-9b42-38a7cbb3f22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:36.293785 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04570270-6f2c-4707-9b42-38a7cbb3f22e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:36.294061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04570270-6f2c-4707-9b42-38a7cbb3f22e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:36.294336 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04570270-6f2c-4707-9b42-38a7cbb3f22e None admin] PATH_INFO: `/v3/users/8f485e8f65e54640b471926b42d2c321` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:36.296195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04570270-6f2c-4707-9b42-38a7cbb3f22e None admin] RBAC: Authorizing `identity:get_user(user_id=8f485e8f65e54640b471926b42d2c321)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:36.298276 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04570270-6f2c-4707-9b42-38a7cbb3f22e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:36.300072 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 90/169] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:36 2022] GET /identity/v3/users/8f485e8f65e54640b471926b42d2c321 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:36.305690 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f09908-8f5a-45d4-9391-50bc2f2e02d0 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:36.339482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:36.345203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a69170-a816-44ee-af96-beb2f59d59ea None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:36.345490 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a69170-a816-44ee-af96-beb2f59d59ea None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:36.345768 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a69170-a816-44ee-af96-beb2f59d59ea None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:36.347318 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 91/170] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:41:36.352770 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c78bc-2dce-4507-8bbb-3a9da1ae4a6b None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:36.353359 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c78bc-2dce-4507-8bbb-3a9da1ae4a6b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:36.353834 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c78bc-2dce-4507-8bbb-3a9da1ae4a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:36.386190 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-177c78bc-2dce-4507-8bbb-3a9da1ae4a6b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:36.387935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-177c78bc-2dce-4507-8bbb-3a9da1ae4a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:36.441239 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f09908-8f5a-45d4-9391-50bc2f2e02d0 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:36.485611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbe542-083a-4667-b6cb-4fa48db35f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:36.486690 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbe542-083a-4667-b6cb-4fa48db35f37 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:36.487155 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbe542-083a-4667-b6cb-4fa48db35f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:36.487648 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbe542-083a-4667-b6cb-4fa48db35f37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:36.500921 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 92/171] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:36.546526 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c78bc-2dce-4507-8bbb-3a9da1ae4a6b None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:36.569303 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbe542-083a-4667-b6cb-4fa48db35f37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:36.572696 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbe542-083a-4667-b6cb-4fa48db35f37 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:36.608208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:36.647420 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:36.687915 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 80/172] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:41:36.698748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbe542-083a-4667-b6cb-4fa48db35f37 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:36.739681 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c78bc-2dce-4507-8bbb-3a9da1ae4a6b None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:36.775205 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fc04b-c810-42c4-8ab4-ae7c7c4ca3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:36.776086 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fc04b-c810-42c4-8ab4-ae7c7c4ca3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:36.776192 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fc04b-c810-42c4-8ab4-ae7c7c4ca3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:36.776415 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fc04b-c810-42c4-8ab4-ae7c7c4ca3d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:36.798316 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fc04b-c810-42c4-8ab4-ae7c7c4ca3d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:36.804234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-041fc04b-c810-42c4-8ab4-ae7c7c4ca3d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:36.804234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:36.804234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:36.804234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:36.804234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:36.804234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:36.804234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:36.804234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:36.804234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:36.804234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:36.804234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:36.804234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:36.804234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:36.804234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:36.804234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:36.804234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:36.805191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:36.805191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:36.805191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:36.805191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:36.805191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:36.805191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:36.805191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:36.805191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:36.805191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:36.805191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:36.805191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:36.805191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:36.805191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:36.805191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:36.805191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:36.805191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:36.806067 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:36.806067 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:36.806067 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:36.806067 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:36.806067 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:36.806067 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:36.806067 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:36.806067 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:36.806067 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:36.806067 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:36.806067 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:36.806067 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:41:36.806067 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 93/173] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:41:36.816542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fc04b-c810-42c4-8ab4-ae7c7c4ca3d9 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:36.915009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbe542-083a-4667-b6cb-4fa48db35f37 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:36.972438 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:36.980876 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15002e-d235-438a-9569-19e0e16351f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:36.981896 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15002e-d235-438a-9569-19e0e16351f2 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:36.989234 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15002e-d235-438a-9569-19e0e16351f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:36.989810 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15002e-d235-438a-9569-19e0e16351f2 None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:36.991535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15002e-d235-438a-9569-19e0e16351f2 None admin] RBAC: Authorizing `identity:get_project(project_id=963ff5e1d9f74853b35cd0babec573b9)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:36.993285 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15002e-d235-438a-9569-19e0e16351f2 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:36.995373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 81/174] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:36 2022] GET /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9 => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:37.010426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:37.014173 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15002e-d235-438a-9569-19e0e16351f2 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:37.014340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fc04b-c810-42c4-8ab4-ae7c7c4ca3d9 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:37.053295 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91beb028-2c51-4d23-bf8a-819a443d91f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:37.053966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91beb028-2c51-4d23-bf8a-819a443d91f5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:37.054246 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91beb028-2c51-4d23-bf8a-819a443d91f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:37.054522 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91beb028-2c51-4d23-bf8a-819a443d91f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:37.055241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91beb028-2c51-4d23-bf8a-819a443d91f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:37.055549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91beb028-2c51-4d23-bf8a-819a443d91f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:37.056964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91beb028-2c51-4d23-bf8a-819a443d91f5 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:37.067577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 94/175] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:37.074126 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91beb028-2c51-4d23-bf8a-819a443d91f5 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:37.216468 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15002e-d235-438a-9569-19e0e16351f2 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:37.268654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91beb028-2c51-4d23-bf8a-819a443d91f5 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:37.282837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5872e-9caa-4c46-ac10-c44d9167a62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:37.283632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5872e-9caa-4c46-ac10-c44d9167a62c None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:37.283924 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5872e-9caa-4c46-ac10-c44d9167a62c None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:37.284199 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5872e-9caa-4c46-ac10-c44d9167a62c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:37.285011 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5872e-9caa-4c46-ac10-c44d9167a62c None admin] RBAC: Adding query filter params (role.id=1e9bc5b431414d62a974beb13a8f83c7, scope.project.id=963ff5e1d9f74853b35cd0babec573b9, user.id=8f485e8f65e54640b471926b42d2c321) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:37.285350 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5872e-9caa-4c46-ac10-c44d9167a62c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:37.286801 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5872e-9caa-4c46-ac10-c44d9167a62c None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:37.301637 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 82/176] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:41:37 2022] GET /identity/v3/role_assignments?user.id=8f485e8f65e54640b471926b42d2c321&scope.project.id=963ff5e1d9f74853b35cd0babec573b9&role.id=1e9bc5b431414d62a974beb13a8f83c7 => generated 608 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:37.303650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780e738-25e9-4a09-b4b6-d53a90723822 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:37.305108 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780e738-25e9-4a09-b4b6-d53a90723822 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:37.305748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780e738-25e9-4a09-b4b6-d53a90723822 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:37.314335 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 83/177] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:37.316228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f676d6-172f-42af-aaff-295455a523c4 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:37.318880 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f676d6-172f-42af-aaff-295455a523c4 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:37.319452 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f676d6-172f-42af-aaff-295455a523c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:37.354432 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8e5e5-bccb-4da6-af84-ee243f31c7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:37.355494 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8e5e5-bccb-4da6-af84-ee243f31c7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:37.355965 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8e5e5-bccb-4da6-af84-ee243f31c7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:37.356490 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8e5e5-bccb-4da6-af84-ee243f31c7c9 None admin] PATH_INFO: `/v3/users/8f485e8f65e54640b471926b42d2c321` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:37.358452 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8e5e5-bccb-4da6-af84-ee243f31c7c9 None admin] RBAC: Authorizing `identity:get_user(user_id=8f485e8f65e54640b471926b42d2c321)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:37.359563 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-a4f676d6-172f-42af-aaff-295455a523c4 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:37.362350 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8e5e5-bccb-4da6-af84-ee243f31c7c9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:37.362741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-a4f676d6-172f-42af-aaff-295455a523c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:37.365257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 95/178] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:37 2022] GET /identity/v3/users/8f485e8f65e54640b471926b42d2c321 => generated 275 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:37.372097 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8e5e5-bccb-4da6-af84-ee243f31c7c9 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:37.439817 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:37.501262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:37.517664 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 84/179] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:37.518998 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec6440-4517-47a3-a562-e5caab8ad8e3 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:37.519225 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec6440-4517-47a3-a562-e5caab8ad8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:37.519500 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec6440-4517-47a3-a562-e5caab8ad8e3 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:37.520994 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 85/180] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:37.528688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b79e16-3f3e-4860-85e8-8c0710a276c5 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:37.528989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b79e16-3f3e-4860-85e8-8c0710a276c5 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:37.529252 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b79e16-3f3e-4860-85e8-8c0710a276c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:37.555280 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-82b79e16-3f3e-4860-85e8-8c0710a276c5 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:37.556595 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-82b79e16-3f3e-4860-85e8-8c0710a276c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:37.575469 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8e5e5-bccb-4da6-af84-ee243f31c7c9 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:37.618098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b98f2-d65d-4d97-a9e9-ff77003772f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:37.618814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b98f2-d65d-4d97-a9e9-ff77003772f5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:37.619095 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b98f2-d65d-4d97-a9e9-ff77003772f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:37.619371 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b98f2-d65d-4d97-a9e9-ff77003772f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:37.634208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 86/181] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:37.635142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b79e16-3f3e-4860-85e8-8c0710a276c5 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:37.688118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b98f2-d65d-4d97-a9e9-ff77003772f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:37.689681 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b98f2-d65d-4d97-a9e9-ff77003772f5 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:37.717906 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:37.732528 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b79e16-3f3e-4860-85e8-8c0710a276c5 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:37.756011 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:37.768491 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd8930-7100-4424-8618-47a88d660ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:37.769239 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd8930-7100-4424-8618-47a88d660ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:37.769470 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd8930-7100-4424-8618-47a88d660ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:37.769745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd8930-7100-4424-8618-47a88d660ec0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:37.780082 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd8930-7100-4424-8618-47a88d660ec0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:37.784992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-24bd8930-7100-4424-8618-47a88d660ec0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:41:37.784992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:37.784992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:37.784992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:37.784992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:37.784992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:37.784992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:37.784992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:37.784992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:37.784992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:37.784992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:37.784992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:37.784992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:37.784992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:37.784992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:37.784992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:37.785872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:37.785872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:37.785872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:37.785872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:37.785872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:37.785872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:37.785872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:37.785872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:37.785872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:37.785872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:37.785872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:37.785872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:37.785872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:37.785872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:37.785872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:37.785872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:37.786683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:37.786683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:37.786683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:37.786683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:37.786683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:37.786683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:37.786683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:37.786683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:37.786683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:37.786683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:37.786683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:41:37.786683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:37.786683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 87/182] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:37.787429 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20795b-87b7-4435-9ef7-329f7d3e612a None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:37.787684 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20795b-87b7-4435-9ef7-329f7d3e612a None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:37.787963 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20795b-87b7-4435-9ef7-329f7d3e612a None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:37.789500 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 88/183] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:37.790541 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c03c10-78f4-4071-afec-b1009f5e51ae None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:37.790818 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c03c10-78f4-4071-afec-b1009f5e51ae None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:37.791092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c03c10-78f4-4071-afec-b1009f5e51ae None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:37.792522 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 89/184] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:37.793434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c03c10-78f4-4071-afec-b1009f5e51ae None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:37.798581 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 96/185] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:41:37.799426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b98f2-d65d-4d97-a9e9-ff77003772f5 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:37.892966 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c03c10-78f4-4071-afec-b1009f5e51ae None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:37.898191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b98f2-d65d-4d97-a9e9-ff77003772f5 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:37.926601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf7fdb-3447-4b79-949e-491525dee990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:37.927237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf7fdb-3447-4b79-949e-491525dee990 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:37.927540 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf7fdb-3447-4b79-949e-491525dee990 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:37.927657 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:37.927923 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf7fdb-3447-4b79-949e-491525dee990 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:37.934726 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0058b-a9ac-4178-943c-4086f6a41b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:37.935360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0058b-a9ac-4178-943c-4086f6a41b6f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:37.935633 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0058b-a9ac-4178-943c-4086f6a41b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:37.935905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0058b-a9ac-4178-943c-4086f6a41b6f None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:37.936620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0058b-a9ac-4178-943c-4086f6a41b6f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:37.936922 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0058b-a9ac-4178-943c-4086f6a41b6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:37.938360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0058b-a9ac-4178-943c-4086f6a41b6f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:37.939053 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf7fdb-3447-4b79-949e-491525dee990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:37.944456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-69bf7fdb-3447-4b79-949e-491525dee990 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:41:37.944456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:37.944456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:37.944456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:37.944456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:37.944456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:37.944456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:37.944456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:37.944456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:37.944456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:37.944456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:37.944456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:37.944456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:37.944456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:37.944456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:37.944456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:37.945332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:37.945332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:37.945332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:37.945332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:37.945332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:37.945332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:37.945332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:37.945332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:37.945332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:37.945332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:37.945332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:37.945332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:37.945332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:37.945332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:37.945332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:37.945332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:37.946113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:37.946113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:37.946113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:37.946113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:37.946113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:37.946113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:37.946113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:37.946113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:37.946113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:37.946113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:37.946113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:41:37.946113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:37.946113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 90/186] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:41:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:37.946743 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 97/187] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:37.946898 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db694c-52b1-49af-a640-9a06e60894bd None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:37.947706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db694c-52b1-49af-a640-9a06e60894bd None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:37.947706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db694c-52b1-49af-a640-9a06e60894bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:37.947873 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc40231-3715-4a9d-888c-e62ad4467394 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:37.947941 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc40231-3715-4a9d-888c-e62ad4467394 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:37.948217 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc40231-3715-4a9d-888c-e62ad4467394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:37.965884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-d2db694c-52b1-49af-a640-9a06e60894bd None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:37.967319 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-dbc40231-3715-4a9d-888c-e62ad4467394 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:37.967641 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-d2db694c-52b1-49af-a640-9a06e60894bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:37.968485 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-dbc40231-3715-4a9d-888c-e62ad4467394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:38.003094 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:38.037892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 98/188] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:38.038783 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc40231-3715-4a9d-888c-e62ad4467394 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:38.038903 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 91/189] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:38.042464 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db694c-52b1-49af-a640-9a06e60894bd None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:38.150934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc40231-3715-4a9d-888c-e62ad4467394 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:38.161726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db694c-52b1-49af-a640-9a06e60894bd None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:38.173292 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:38.184593 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ea94f-de1b-4ded-b9ff-9c3d44c35ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:38.185265 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ea94f-de1b-4ded-b9ff-9c3d44c35ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:38.185543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ea94f-de1b-4ded-b9ff-9c3d44c35ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:38.185810 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ea94f-de1b-4ded-b9ff-9c3d44c35ad7 None admin] PATH_INFO: `/v3/projects/fdf1bc163f9645af9b60ecd0c3157bd4` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:38.186950 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ea94f-de1b-4ded-b9ff-9c3d44c35ad7 None admin] RBAC: Authorizing `identity:get_project(project_id=fdf1bc163f9645af9b60ecd0c3157bd4)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:38.188399 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ea94f-de1b-4ded-b9ff-9c3d44c35ad7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:38.190097 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 99/190] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:38 2022] GET /identity/v3/projects/fdf1bc163f9645af9b60ecd0c3157bd4 => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:38.190850 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ea94f-de1b-4ded-b9ff-9c3d44c35ad7 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:38.197727 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699cf5d-30da-4209-b91a-6c1cea74b275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:38.198380 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699cf5d-30da-4209-b91a-6c1cea74b275 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:38.198650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699cf5d-30da-4209-b91a-6c1cea74b275 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:38.198928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699cf5d-30da-4209-b91a-6c1cea74b275 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:38.199663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699cf5d-30da-4209-b91a-6c1cea74b275 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:38.200042 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699cf5d-30da-4209-b91a-6c1cea74b275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:38.201439 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699cf5d-30da-4209-b91a-6c1cea74b275 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:38.210052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 92/191] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:38.213940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699cf5d-30da-4209-b91a-6c1cea74b275 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:38.247778 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:38.295532 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ea94f-de1b-4ded-b9ff-9c3d44c35ad7 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:38.313045 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699cf5d-30da-4209-b91a-6c1cea74b275 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:38.331095 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205bfd6-1ec1-4b93-8bd7-00469e742415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:38.331745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205bfd6-1ec1-4b93-8bd7-00469e742415 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:38.332026 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205bfd6-1ec1-4b93-8bd7-00469e742415 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:38.332301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205bfd6-1ec1-4b93-8bd7-00469e742415 None admin] PATH_INFO: `/v3/users/d959a4e2c95b48b0ab5437aebd39b254` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:38.333502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205bfd6-1ec1-4b93-8bd7-00469e742415 None admin] RBAC: Authorizing `identity:get_user(user_id=d959a4e2c95b48b0ab5437aebd39b254)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:38.334998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205bfd6-1ec1-4b93-8bd7-00469e742415 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:38.336596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 100/192] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:38 2022] GET /identity/v3/users/d959a4e2c95b48b0ab5437aebd39b254 => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:38.337382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205bfd6-1ec1-4b93-8bd7-00469e742415 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:38.349559 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abed27f-6c69-4907-954f-a316060bd3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:38.350215 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abed27f-6c69-4907-954f-a316060bd3ec None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:38.350671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abed27f-6c69-4907-954f-a316060bd3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:38.351034 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abed27f-6c69-4907-954f-a316060bd3ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:38.361254 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abed27f-6c69-4907-954f-a316060bd3ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:38.367043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-6abed27f-6c69-4907-954f-a316060bd3ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:41:38.367043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:38.367043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:38.367043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:38.367043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:38.367043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:38.367043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:38.367043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:38.367043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:38.367043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:38.367043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:38.367043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:38.367043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:38.367043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:38.367043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:38.367043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:38.367905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:38.367905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:38.367905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:38.367905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:38.367905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:38.367905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:38.367905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:38.367905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:38.367905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:38.367905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:38.367905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:38.367905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:38.367905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:38.367905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:38.367905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:38.367905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:38.368676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:38.368676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:38.368676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:38.368676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:38.368676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:38.368676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:38.368676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:38.368676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:38.368676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:38.368676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:38.368676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:41:38.368676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:38.368676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 93/193] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:41:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:38.369340 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abed27f-6c69-4907-954f-a316060bd3ec None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:38.401970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:38.442893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205bfd6-1ec1-4b93-8bd7-00469e742415 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:38.460894 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:38.467743 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abed27f-6c69-4907-954f-a316060bd3ec None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:38.476795 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8704f-326b-44bc-8f5e-9fdbe5dc38bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:38.477465 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8704f-326b-44bc-8f5e-9fdbe5dc38bf None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:38.477744 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8704f-326b-44bc-8f5e-9fdbe5dc38bf None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:38.478016 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8704f-326b-44bc-8f5e-9fdbe5dc38bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:38.479178 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8704f-326b-44bc-8f5e-9fdbe5dc38bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:38.480650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8704f-326b-44bc-8f5e-9fdbe5dc38bf None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:38.482284 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 101/194] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:41:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:38.482284 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8704f-326b-44bc-8f5e-9fdbe5dc38bf None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:38.502382 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879253bf-4dcf-41bc-bcee-c913d2940e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:38.503019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879253bf-4dcf-41bc-bcee-c913d2940e03 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:38.503288 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879253bf-4dcf-41bc-bcee-c913d2940e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:38.503564 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879253bf-4dcf-41bc-bcee-c913d2940e03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:38.504366 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879253bf-4dcf-41bc-bcee-c913d2940e03 None admin] RBAC: Adding query filter params (role.id=1e9bc5b431414d62a974beb13a8f83c7, scope.project.id=fdf1bc163f9645af9b60ecd0c3157bd4, user.id=8f485e8f65e54640b471926b42d2c321) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:38.504677 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879253bf-4dcf-41bc-bcee-c913d2940e03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:38.506286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879253bf-4dcf-41bc-bcee-c913d2940e03 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:38.511918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 94/195] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:41:38 2022] GET /identity/v3/role_assignments?user.id=8f485e8f65e54640b471926b42d2c321&scope.project.id=fdf1bc163f9645af9b60ecd0c3157bd4&role.id=1e9bc5b431414d62a974beb13a8f83c7 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:38.512701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879253bf-4dcf-41bc-bcee-c913d2940e03 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:38.595692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8704f-326b-44bc-8f5e-9fdbe5dc38bf None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:38.625932 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:38.635959 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db058ac-1981-4eac-adb9-21510a73268b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:38.636525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db058ac-1981-4eac-adb9-21510a73268b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:38.636850 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db058ac-1981-4eac-adb9-21510a73268b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:38.637160 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db058ac-1981-4eac-adb9-21510a73268b None admin] PATH_INFO: `/v3/users/63b7effa31214744b9e1b1a5562424aa` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:38.645034 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879253bf-4dcf-41bc-bcee-c913d2940e03 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:38.656601 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db058ac-1981-4eac-adb9-21510a73268b None admin] RBAC: Authorizing `identity:get_user(user_id=63b7effa31214744b9e1b1a5562424aa)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:38.658123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db058ac-1981-4eac-adb9-21510a73268b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:38.665264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 102/196] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:38 2022] GET /identity/v3/users/63b7effa31214744b9e1b1a5562424aa => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:38.665264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db058ac-1981-4eac-adb9-21510a73268b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:38.689880 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2390cd-bd15-427f-9747-a48ac91accdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:38.691081 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2390cd-bd15-427f-9747-a48ac91accdb None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:38.691541 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2390cd-bd15-427f-9747-a48ac91accdb None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:38.691849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2390cd-bd15-427f-9747-a48ac91accdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:38.726335 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:38.769847 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2390cd-bd15-427f-9747-a48ac91accdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:38.771377 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2390cd-bd15-427f-9747-a48ac91accdb None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:38.778851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db058ac-1981-4eac-adb9-21510a73268b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:38.811780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394a7da-88db-40b3-b2a5-4a14a711b58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:38.812402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394a7da-88db-40b3-b2a5-4a14a711b58d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:38.812678 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394a7da-88db-40b3-b2a5-4a14a711b58d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:38.812952 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394a7da-88db-40b3-b2a5-4a14a711b58d None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:38.813699 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394a7da-88db-40b3-b2a5-4a14a711b58d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:38.814000 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394a7da-88db-40b3-b2a5-4a14a711b58d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:38.815414 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394a7da-88db-40b3-b2a5-4a14a711b58d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:38.823608 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 103/197] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:41:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:38.824371 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394a7da-88db-40b3-b2a5-4a14a711b58d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:38.870827 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 95/198] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:41:38.876170 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2390cd-bd15-427f-9747-a48ac91accdb None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:38.876295 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:38.926955 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394a7da-88db-40b3-b2a5-4a14a711b58d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:38.929565 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:38.962274 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7351e-9701-4fb6-b466-b9965d4b40f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:38.962890 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7351e-9701-4fb6-b466-b9965d4b40f8 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:38.963169 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7351e-9701-4fb6-b466-b9965d4b40f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:38.963443 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7351e-9701-4fb6-b466-b9965d4b40f8 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:38.964113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7351e-9701-4fb6-b466-b9965d4b40f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:38.965629 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7351e-9701-4fb6-b466-b9965d4b40f8 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:38.971063 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2390cd-bd15-427f-9747-a48ac91accdb None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:38.987682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 104/199] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Jul 28 17:41:38 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:41:38.988586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7351e-9701-4fb6-b466-b9965d4b40f8 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:39.011015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51315481-3bde-4fc0-9bfd-6f84c72bc4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:39.011803 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51315481-3bde-4fc0-9bfd-6f84c72bc4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:39.012095 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51315481-3bde-4fc0-9bfd-6f84c72bc4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:39.012366 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51315481-3bde-4fc0-9bfd-6f84c72bc4c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:39.097532 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51315481-3bde-4fc0-9bfd-6f84c72bc4c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:39.099104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51315481-3bde-4fc0-9bfd-6f84c72bc4c0 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:39.110347 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7351e-9701-4fb6-b466-b9965d4b40f8 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:39.112223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:39.150847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d98cf-5b00-4638-89c7-a894bae9c730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:39.151936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d98cf-5b00-4638-89c7-a894bae9c730 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:39.151936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d98cf-5b00-4638-89c7-a894bae9c730 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:39.152104 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d98cf-5b00-4638-89c7-a894bae9c730 None admin] PATH_INFO: `/v3/users/63b7effa31214744b9e1b1a5562424aa` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:39.153216 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d98cf-5b00-4638-89c7-a894bae9c730 None admin] RBAC: Authorizing `identity:get_user(user_id=63b7effa31214744b9e1b1a5562424aa)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:39.154682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d98cf-5b00-4638-89c7-a894bae9c730 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:39.156995 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 105/200] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:38 2022] GET /identity/v3/users/63b7effa31214744b9e1b1a5562424aa => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:39.157122 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d98cf-5b00-4638-89c7-a894bae9c730 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:39.170860 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:39.219586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 96/201] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:41:39.220448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51315481-3bde-4fc0-9bfd-6f84c72bc4c0 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:39.287189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d98cf-5b00-4638-89c7-a894bae9c730 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:39.336900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7246f-abb4-41cf-8f45-857a51c804f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:39.337663 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7246f-abb4-41cf-8f45-857a51c804f8 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:39.337868 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7246f-abb4-41cf-8f45-857a51c804f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:39.338155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7246f-abb4-41cf-8f45-857a51c804f8 None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:39.339331 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7246f-abb4-41cf-8f45-857a51c804f8 None admin] RBAC: Authorizing `identity:get_project(project_id=963ff5e1d9f74853b35cd0babec573b9)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:39.340805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7246f-abb4-41cf-8f45-857a51c804f8 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:39.342622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 106/202] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:39 2022] GET /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:39.343390 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7246f-abb4-41cf-8f45-857a51c804f8 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:39.355353 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51315481-3bde-4fc0-9bfd-6f84c72bc4c0 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:39.388218 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:39.404508 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3efc9-f242-451c-84d3-718a9d189fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:39.405240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3efc9-f242-451c-84d3-718a9d189fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:39.405606 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3efc9-f242-451c-84d3-718a9d189fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:39.405973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3efc9-f242-451c-84d3-718a9d189fe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:39.443421 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:39.465679 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7246f-abb4-41cf-8f45-857a51c804f8 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:39.486630 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3efc9-f242-451c-84d3-718a9d189fe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:39.488498 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3efc9-f242-451c-84d3-718a9d189fe3 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:39.502962 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e836d7d-f1eb-41ec-b229-895b1dc978de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:39.503836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e836d7d-f1eb-41ec-b229-895b1dc978de None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:39.504218 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e836d7d-f1eb-41ec-b229-895b1dc978de None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:39.504761 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e836d7d-f1eb-41ec-b229-895b1dc978de None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:39.506236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e836d7d-f1eb-41ec-b229-895b1dc978de None admin] RBAC: Authorizing `identity:get_project(project_id=a9647712d7a24fe1831a2c16cfba2abb)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:39.508224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e836d7d-f1eb-41ec-b229-895b1dc978de None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:39.510348 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 107/203] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:39 2022] GET /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:39.515498 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e836d7d-f1eb-41ec-b229-895b1dc978de None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:39.609669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 97/204] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:41:39.615501 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3efc9-f242-451c-84d3-718a9d189fe3 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:39.627152 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e836d7d-f1eb-41ec-b229-895b1dc978de None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:39.635512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:39.666158 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8bd8e-7413-44ea-b638-fd13ef75f6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:39.667011 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8bd8e-7413-44ea-b638-fd13ef75f6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:39.667436 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8bd8e-7413-44ea-b638-fd13ef75f6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:39.667845 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8bd8e-7413-44ea-b638-fd13ef75f6b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:39.668769 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8bd8e-7413-44ea-b638-fd13ef75f6b4 None admin] RBAC: Adding query filter params (role.id=3e04c82538344690a5a6591b125b6b86, scope.project.id=963ff5e1d9f74853b35cd0babec573b9, user.id=d959a4e2c95b48b0ab5437aebd39b254) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:39.669276 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8bd8e-7413-44ea-b638-fd13ef75f6b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:39.670868 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8bd8e-7413-44ea-b638-fd13ef75f6b4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:39.677159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 108/205] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:41:39 2022] GET /identity/v3/role_assignments?user.id=d959a4e2c95b48b0ab5437aebd39b254&scope.project.id=963ff5e1d9f74853b35cd0babec573b9&role.id=3e04c82538344690a5a6591b125b6b86 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:39.678829 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8bd8e-7413-44ea-b638-fd13ef75f6b4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:39.685914 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:39.819626 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8bd8e-7413-44ea-b638-fd13ef75f6b4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:39.823564 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3efc9-f242-451c-84d3-718a9d189fe3 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:39.871383 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a0cb3-1b25-4744-8f45-ad7a442713a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:39.872425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a0cb3-1b25-4744-8f45-ad7a442713a4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:39.872914 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a0cb3-1b25-4744-8f45-ad7a442713a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:39.873220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a0cb3-1b25-4744-8f45-ad7a442713a4 None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:39.874509 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a0cb3-1b25-4744-8f45-ad7a442713a4 None admin] RBAC: Authorizing `identity:get_project(project_id=a9647712d7a24fe1831a2c16cfba2abb)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:39.879342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a0cb3-1b25-4744-8f45-ad7a442713a4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:39.883706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 109/206] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:39 2022] GET /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:39.887156 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a0cb3-1b25-4744-8f45-ad7a442713a4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:39.903087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f35dcb-51ee-44b7-aa5d-3f251dcc38b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:39.903087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f35dcb-51ee-44b7-aa5d-3f251dcc38b5 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:39.903087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f35dcb-51ee-44b7-aa5d-3f251dcc38b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:39.903397 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f35dcb-51ee-44b7-aa5d-3f251dcc38b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:39.904923 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f35dcb-51ee-44b7-aa5d-3f251dcc38b5 None admin] RBAC: Adding query filter params (role.id=980cae90acae42189f92fd6dd42867a5, scope.project.id=a9647712d7a24fe1831a2c16cfba2abb, user.id=63b7effa31214744b9e1b1a5562424aa) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:39.904923 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f35dcb-51ee-44b7-aa5d-3f251dcc38b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:39.905954 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f35dcb-51ee-44b7-aa5d-3f251dcc38b5 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:39.920698 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 98/207] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:41:39 2022] GET /identity/v3/role_assignments?user.id=63b7effa31214744b9e1b1a5562424aa&scope.project.id=a9647712d7a24fe1831a2c16cfba2abb&role.id=980cae90acae42189f92fd6dd42867a5 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:39.946899 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:40.021868 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a0cb3-1b25-4744-8f45-ad7a442713a4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:40.063150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e189b-2112-43e9-abae-d76292bff9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:40.063799 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e189b-2112-43e9-abae-d76292bff9b8 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:40.064082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e189b-2112-43e9-abae-d76292bff9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:40.064357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e189b-2112-43e9-abae-d76292bff9b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:40.065189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e189b-2112-43e9-abae-d76292bff9b8 None admin] RBAC: Adding query filter params (role.id=5b95c3aebc8041c7885a9234a9e54d7c, scope.project.id=a9647712d7a24fe1831a2c16cfba2abb, user.id=63b7effa31214744b9e1b1a5562424aa) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:40.065508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e189b-2112-43e9-abae-d76292bff9b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:40.066965 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e189b-2112-43e9-abae-d76292bff9b8 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:40.075111 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 110/208] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:41:39 2022] GET /identity/v3/role_assignments?user.id=63b7effa31214744b9e1b1a5562424aa&scope.project.id=a9647712d7a24fe1831a2c16cfba2abb&role.id=5b95c3aebc8041c7885a9234a9e54d7c => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:41.191729 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356e3c7-a635-4f40-85fe-83c4007c35f1 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:41.192262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356e3c7-a635-4f40-85fe-83c4007c35f1 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:41.192338 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356e3c7-a635-4f40-85fe-83c4007c35f1 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:41.193999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 99/209] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:41.199732 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5952d6-1dc1-41f5-8b55-1ee74594353d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:41.200197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5952d6-1dc1-41f5-8b55-1ee74594353d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:41.200275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5952d6-1dc1-41f5-8b55-1ee74594353d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:41.220200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7a5952d6-1dc1-41f5-8b55-1ee74594353d None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:41.221450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7a5952d6-1dc1-41f5-8b55-1ee74594353d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:41.224397 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed120adc-1df4-4b59-a158-be9dab9ad5ea None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:41.224738 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed120adc-1df4-4b59-a158-be9dab9ad5ea None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:41.225101 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed120adc-1df4-4b59-a158-be9dab9ad5ea None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:41.227196 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 100/210] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:41.232224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75c2a2-e840-4f20-b9e9-3fa8b9ca2935 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:41.232508 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75c2a2-e840-4f20-b9e9-3fa8b9ca2935 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:41.232783 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75c2a2-e840-4f20-b9e9-3fa8b9ca2935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:41.251069 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-3a75c2a2-e840-4f20-b9e9-3fa8b9ca2935 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:41.252261 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-3a75c2a2-e840-4f20-b9e9-3fa8b9ca2935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:41.308990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 111/211] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:41.325665 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 101/212] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:41.334441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5952d6-1dc1-41f5-8b55-1ee74594353d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:41.348667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75c2a2-e840-4f20-b9e9-3fa8b9ca2935 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:41.369956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:41.417716 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:41.445295 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5952d6-1dc1-41f5-8b55-1ee74594353d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:41.481734 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75c2a2-e840-4f20-b9e9-3fa8b9ca2935 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:41.482051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba10012-fd8a-4a50-91db-df0c4c03a23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:41.482931 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba10012-fd8a-4a50-91db-df0c4c03a23f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:41.483491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba10012-fd8a-4a50-91db-df0c4c03a23f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:41.484061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba10012-fd8a-4a50-91db-df0c4c03a23f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:41.485510 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba10012-fd8a-4a50-91db-df0c4c03a23f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:41.487177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba10012-fd8a-4a50-91db-df0c4c03a23f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:41.489531 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 112/213] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:41:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:41.498470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba10012-fd8a-4a50-91db-df0c4c03a23f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:41.524092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48067c8-5400-4292-abcc-cfa35094f4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:41.524694 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48067c8-5400-4292-abcc-cfa35094f4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:41.524970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48067c8-5400-4292-abcc-cfa35094f4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:41.525287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48067c8-5400-4292-abcc-cfa35094f4c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:41.536654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48067c8-5400-4292-abcc-cfa35094f4c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:41.542134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-d48067c8-5400-4292-abcc-cfa35094f4c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:41.542134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:41.542134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:41.542134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:41.542134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:41.542134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:41.542134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:41.542134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:41.542134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:41.542134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:41.542134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:41.542134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:41.542134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:41.542134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:41.542134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:41.542134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:41.543056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:41.543056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:41.543056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:41.543056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:41.543056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:41.543056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:41.543056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:41.543056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:41.543056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:41.543056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:41.543056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:41.543056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:41.543056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:41.543056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:41.543056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:41.543056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:41.543844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:41.543844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:41.543844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:41.543844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:41.543844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:41.543844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:41.543844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:41.543844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:41.543844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:41.543844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:41.543844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:41.543844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:41.543844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 102/214] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:41:41.551216 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48067c8-5400-4292-abcc-cfa35094f4c5 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:41.612909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:41.616505 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba10012-fd8a-4a50-91db-df0c4c03a23f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:41.654085 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0ff6b-c334-49a4-b99e-4493298acb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:41.655044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0ff6b-c334-49a4-b99e-4493298acb25 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:41.655587 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0ff6b-c334-49a4-b99e-4493298acb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:41.656040 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0ff6b-c334-49a4-b99e-4493298acb25 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:41.656890 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0ff6b-c334-49a4-b99e-4493298acb25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:41.658704 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0ff6b-c334-49a4-b99e-4493298acb25 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:41.661585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48067c8-5400-4292-abcc-cfa35094f4c5 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:41.677518 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:41.692769 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 113/215] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Jul 28 17:41:41 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:41:41.708361 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440360bb-42e9-4838-a0d7-309bd030faa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:41.709039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440360bb-42e9-4838-a0d7-309bd030faa7 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:41.709566 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440360bb-42e9-4838-a0d7-309bd030faa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:41.709973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440360bb-42e9-4838-a0d7-309bd030faa7 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:41.710695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440360bb-42e9-4838-a0d7-309bd030faa7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:41.711005 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440360bb-42e9-4838-a0d7-309bd030faa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:41.712508 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440360bb-42e9-4838-a0d7-309bd030faa7 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:41.723123 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 103/216] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:41.729491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0ff6b-c334-49a4-b99e-4493298acb25 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:41.847479 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0ff6b-c334-49a4-b99e-4493298acb25 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:41.885697 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92726a2f-2a73-46c9-975d-10d1035483ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:41.886724 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92726a2f-2a73-46c9-975d-10d1035483ee None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:41.887243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92726a2f-2a73-46c9-975d-10d1035483ee None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:41.887727 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92726a2f-2a73-46c9-975d-10d1035483ee None admin] PATH_INFO: `/v3/users/4fc03903497d44018f7b2ccd496d4b7e` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:41.904231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92726a2f-2a73-46c9-975d-10d1035483ee None admin] RBAC: Authorizing `identity:get_user(user_id=4fc03903497d44018f7b2ccd496d4b7e)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:41.906129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92726a2f-2a73-46c9-975d-10d1035483ee None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:41.908388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 114/217] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:41 2022] GET /identity/v3/users/4fc03903497d44018f7b2ccd496d4b7e => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:41.914241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440360bb-42e9-4838-a0d7-309bd030faa7 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:41.994619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812b790-3822-47e4-8bf8-11b527896de1 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:41.994927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812b790-3822-47e4-8bf8-11b527896de1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:41.995169 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812b790-3822-47e4-8bf8-11b527896de1 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:41.997990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 115/218] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:41:42.002932 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb1f42-984e-4653-a2db-8d8a4dca70dc None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:42.003224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb1f42-984e-4653-a2db-8d8a4dca70dc None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:42.003496 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb1f42-984e-4653-a2db-8d8a4dca70dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:42.028006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-1ecb1f42-984e-4653-a2db-8d8a4dca70dc None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:42.028935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1ecb1f42-984e-4653-a2db-8d8a4dca70dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:42.039535 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:42.045174 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440360bb-42e9-4838-a0d7-309bd030faa7 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:42.091397 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb12ed3-68dc-473d-87cf-849ea3b30852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:42.092548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb12ed3-68dc-473d-87cf-849ea3b30852 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:42.092973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb12ed3-68dc-473d-87cf-849ea3b30852 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:42.093490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb12ed3-68dc-473d-87cf-849ea3b30852 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:42.120264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 116/219] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:42.152636 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb1f42-984e-4653-a2db-8d8a4dca70dc None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:42.152803 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:42.185518 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb12ed3-68dc-473d-87cf-849ea3b30852 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:42.187027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb12ed3-68dc-473d-87cf-849ea3b30852 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:42.274582 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb1f42-984e-4653-a2db-8d8a4dca70dc None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:42.311217 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abb843-62ad-47cf-9673-434c9e249bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:42.311866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abb843-62ad-47cf-9673-434c9e249bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:42.312138 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abb843-62ad-47cf-9673-434c9e249bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:42.312407 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abb843-62ad-47cf-9673-434c9e249bc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:42.321121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 104/220] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:41:42.323328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222ca65-0bee-4521-a12f-831c01e0cd4f None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:42.323436 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abb843-62ad-47cf-9673-434c9e249bc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:42.323910 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222ca65-0bee-4521-a12f-831c01e0cd4f None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:42.324380 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222ca65-0bee-4521-a12f-831c01e0cd4f None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:42.325914 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 105/221] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:42.326821 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222ca65-0bee-4521-a12f-831c01e0cd4f None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:42.328628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-49abb843-62ad-47cf-9673-434c9e249bc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:41:42.328628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:42.328628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:42.328628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:42.328628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:42.328628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:42.328628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:42.328628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:42.328628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:42.328628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:42.328628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:42.328628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:42.328628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:42.328628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:42.328628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:42.328628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:42.329501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:42.329501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:42.329501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:42.329501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:42.329501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:42.329501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:42.329501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:42.329501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:42.329501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:42.329501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:42.329501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:42.329501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:42.329501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:42.329501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:42.329501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:42.329501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:42.330301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:42.330301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:42.330301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:42.330301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:42.330301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:42.330301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:42.330301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:42.330301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:42.330301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:42.330301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:42.330301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:41:42.330301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:41:42.330301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 117/222] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:41:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:42.336587 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45ffd5-76f3-4579-aa21-72c0d33c633a None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:42.336857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45ffd5-76f3-4579-aa21-72c0d33c633a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:42.337167 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45ffd5-76f3-4579-aa21-72c0d33c633a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:42.345566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:42.359808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-6b45ffd5-76f3-4579-aa21-72c0d33c633a None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:42.361916 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6b45ffd5-76f3-4579-aa21-72c0d33c633a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:42.418063 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:42.452660 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222ca65-0bee-4521-a12f-831c01e0cd4f None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:42.463829 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 118/223] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:42.465435 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45ffd5-76f3-4579-aa21-72c0d33c633a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:42.499148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af002a-be3d-4ebc-a1c0-3ebaebf37b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:42.499818 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af002a-be3d-4ebc-a1c0-3ebaebf37b40 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:42.500094 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af002a-be3d-4ebc-a1c0-3ebaebf37b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:42.500366 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af002a-be3d-4ebc-a1c0-3ebaebf37b40 None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:42.501594 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af002a-be3d-4ebc-a1c0-3ebaebf37b40 None admin] RBAC: Authorizing `identity:get_project(project_id=a9647712d7a24fe1831a2c16cfba2abb)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:42.503107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af002a-be3d-4ebc-a1c0-3ebaebf37b40 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:42.504784 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 106/224] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:42 2022] GET /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:42.505784 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af002a-be3d-4ebc-a1c0-3ebaebf37b40 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:42.589476 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45ffd5-76f3-4579-aa21-72c0d33c633a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:42.624110 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a5ec5-24ad-4319-a84a-04c21685e922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:42.624776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a5ec5-24ad-4319-a84a-04c21685e922 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:42.625049 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a5ec5-24ad-4319-a84a-04c21685e922 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:42.625360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a5ec5-24ad-4319-a84a-04c21685e922 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:42.626553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a5ec5-24ad-4319-a84a-04c21685e922 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:42.627084 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a5ec5-24ad-4319-a84a-04c21685e922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:42.629736 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a5ec5-24ad-4319-a84a-04c21685e922 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:42.632242 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:42.633299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af002a-be3d-4ebc-a1c0-3ebaebf37b40 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:42.647454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 119/225] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:42.652958 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a5ec5-24ad-4319-a84a-04c21685e922 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:42.674942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54974bb3-c8f6-4f73-8c60-acb4e14e5ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:42.675956 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54974bb3-c8f6-4f73-8c60-acb4e14e5ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:42.676454 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54974bb3-c8f6-4f73-8c60-acb4e14e5ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:42.676925 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54974bb3-c8f6-4f73-8c60-acb4e14e5ac9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:42.689478 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54974bb3-c8f6-4f73-8c60-acb4e14e5ac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:42.697274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-54974bb3-c8f6-4f73-8c60-acb4e14e5ac9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:41:42.697274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:42.697274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:42.697274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:42.697274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:42.697274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:42.697274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:42.697274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:42.697274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:42.697274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:42.697274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:42.697274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:42.697274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:42.697274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:42.697274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:42.697274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:42.698188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:42.698188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:42.698188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:42.698188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:42.698188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:42.698188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:42.698188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:42.698188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:42.698188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:42.698188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:42.698188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:42.698188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:42.698188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:42.698188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:42.698188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:42.698188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:42.698967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:42.698967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:42.698967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:42.698967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:42.698967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:42.698967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:42.698967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:42.698967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:42.698967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:42.698967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:42.698967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:41:42.698967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:42.701482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 107/226] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:41:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:42.702606 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54974bb3-c8f6-4f73-8c60-acb4e14e5ac9 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:42.706366 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:42.757712 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a5ec5-24ad-4319-a84a-04c21685e922 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:42.793609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f7831-7f13-44f7-9b34-a6d1090c4b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:42.794234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f7831-7f13-44f7-9b34-a6d1090c4b67 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:42.794508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f7831-7f13-44f7-9b34-a6d1090c4b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:42.794786 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f7831-7f13-44f7-9b34-a6d1090c4b67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:42.795859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f7831-7f13-44f7-9b34-a6d1090c4b67 None admin] RBAC: Adding query filter params (role.id=1e9bc5b431414d62a974beb13a8f83c7, scope.project.id=a9647712d7a24fe1831a2c16cfba2abb, user.id=4fc03903497d44018f7b2ccd496d4b7e) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:42.795859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f7831-7f13-44f7-9b34-a6d1090c4b67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:42.797437 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f7831-7f13-44f7-9b34-a6d1090c4b67 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:42.803308 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 120/227] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:41:42 2022] GET /identity/v3/role_assignments?user.id=4fc03903497d44018f7b2ccd496d4b7e&scope.project.id=a9647712d7a24fe1831a2c16cfba2abb&role.id=1e9bc5b431414d62a974beb13a8f83c7 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:42.804348 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f7831-7f13-44f7-9b34-a6d1090c4b67 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:42.816862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54974bb3-c8f6-4f73-8c60-acb4e14e5ac9 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:42.855682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b9bdb-07f8-47b6-889e-f8c8f95c23f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:42.856771 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b9bdb-07f8-47b6-889e-f8c8f95c23f5 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:42.857304 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b9bdb-07f8-47b6-889e-f8c8f95c23f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:42.857779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b9bdb-07f8-47b6-889e-f8c8f95c23f5 None admin] PATH_INFO: `/v3/users/63b7effa31214744b9e1b1a5562424aa` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:42.859484 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b9bdb-07f8-47b6-889e-f8c8f95c23f5 None admin] RBAC: Authorizing `identity:get_user(user_id=63b7effa31214744b9e1b1a5562424aa)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:42.861265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b9bdb-07f8-47b6-889e-f8c8f95c23f5 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:42.863319 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 108/228] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:42 2022] GET /identity/v3/users/63b7effa31214744b9e1b1a5562424aa => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:42.874583 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:42.876294 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b9bdb-07f8-47b6-889e-f8c8f95c23f5 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:42.919744 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f7831-7f13-44f7-9b34-a6d1090c4b67 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:42.962012 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a52b6e-c639-423f-8131-d09b66181b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:42.964024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a52b6e-c639-423f-8131-d09b66181b8e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:42.964301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a52b6e-c639-423f-8131-d09b66181b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:42.964570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a52b6e-c639-423f-8131-d09b66181b8e None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:42.966111 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a52b6e-c639-423f-8131-d09b66181b8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:42.966417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a52b6e-c639-423f-8131-d09b66181b8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:42.967843 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a52b6e-c639-423f-8131-d09b66181b8e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:42.990294 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 121/229] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:41:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:42.997361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a52b6e-c639-423f-8131-d09b66181b8e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:43.008194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:43.057955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b9bdb-07f8-47b6-889e-f8c8f95c23f5 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:43.095740 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f0cf7-0755-4954-8f99-eb4c7ff6e232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:43.096784 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f0cf7-0755-4954-8f99-eb4c7ff6e232 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:43.097301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f0cf7-0755-4954-8f99-eb4c7ff6e232 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:43.097773 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f0cf7-0755-4954-8f99-eb4c7ff6e232 None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:43.099153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f0cf7-0755-4954-8f99-eb4c7ff6e232 None admin] RBAC: Authorizing `identity:get_project(project_id=a9647712d7a24fe1831a2c16cfba2abb)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:43.101078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f0cf7-0755-4954-8f99-eb4c7ff6e232 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:43.103192 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 109/230] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:42 2022] GET /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:43.110876 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f0cf7-0755-4954-8f99-eb4c7ff6e232 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:43.159790 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a52b6e-c639-423f-8131-d09b66181b8e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:43.208616 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:43.242385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13e9fc-50da-4714-a1cf-5321016c766f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:43.242949 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13e9fc-50da-4714-a1cf-5321016c766f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:43.243231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13e9fc-50da-4714-a1cf-5321016c766f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:43.243503 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13e9fc-50da-4714-a1cf-5321016c766f None admin] PATH_INFO: `/v3/users/63b7effa31214744b9e1b1a5562424aa` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:43.249812 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13e9fc-50da-4714-a1cf-5321016c766f None admin] RBAC: Authorizing `identity:get_user(user_id=63b7effa31214744b9e1b1a5562424aa)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:43.251291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13e9fc-50da-4714-a1cf-5321016c766f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:43.253130 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 122/231] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:42 2022] GET /identity/v3/users/63b7effa31214744b9e1b1a5562424aa => generated 283 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:43.255937 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f0cf7-0755-4954-8f99-eb4c7ff6e232 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:43.258697 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13e9fc-50da-4714-a1cf-5321016c766f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:43.324177 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88076324-b640-4561-8eb9-cac4c89872bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:43.325643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88076324-b640-4561-8eb9-cac4c89872bf None admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:43.326694 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88076324-b640-4561-8eb9-cac4c89872bf None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:43.327198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88076324-b640-4561-8eb9-cac4c89872bf None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb/users/63b7effa31214744b9e1b1a5562424aa/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:43.334854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88076324-b640-4561-8eb9-cac4c89872bf None admin] RBAC: Authorizing `identity:create_grant(project_id=a9647712d7a24fe1831a2c16cfba2abb, user_id=63b7effa31214744b9e1b1a5562424aa, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:43.336491 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88076324-b640-4561-8eb9-cac4c89872bf None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:43.351870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:43.358610 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 110/232] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:41:43 2022] PUT /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb/users/63b7effa31214744b9e1b1a5562424aa/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:41:43.416957 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13e9fc-50da-4714-a1cf-5321016c766f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:43.454440 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554805d1-2b2c-4c93-825c-a7784d50a625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:43.455121 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554805d1-2b2c-4c93-825c-a7784d50a625 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:43.455401 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554805d1-2b2c-4c93-825c-a7784d50a625 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:43.455677 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554805d1-2b2c-4c93-825c-a7784d50a625 None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:43.456836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554805d1-2b2c-4c93-825c-a7784d50a625 None admin] RBAC: Authorizing `identity:get_project(project_id=a9647712d7a24fe1831a2c16cfba2abb)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:43.458396 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554805d1-2b2c-4c93-825c-a7784d50a625 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:43.460575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 123/233] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:43 2022] GET /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:43.466644 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88076324-b640-4561-8eb9-cac4c89872bf None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:43.590494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88076324-b640-4561-8eb9-cac4c89872bf None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:43.631650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83baa3-8d5e-4e5d-8aa0-b28a84417385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:43.632328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83baa3-8d5e-4e5d-8aa0-b28a84417385 None admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:43.632605 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83baa3-8d5e-4e5d-8aa0-b28a84417385 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:43.632877 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83baa3-8d5e-4e5d-8aa0-b28a84417385 None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb/users/63b7effa31214744b9e1b1a5562424aa/roles/5b95c3aebc8041c7885a9234a9e54d7c` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:43.635080 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83baa3-8d5e-4e5d-8aa0-b28a84417385 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9647712d7a24fe1831a2c16cfba2abb, user_id=63b7effa31214744b9e1b1a5562424aa, role_id=5b95c3aebc8041c7885a9234a9e54d7c)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:43.636575 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83baa3-8d5e-4e5d-8aa0-b28a84417385 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:43.659525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 111/234] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:41:43 2022] PUT /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb/users/63b7effa31214744b9e1b1a5562424aa/roles/5b95c3aebc8041c7885a9234a9e54d7c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:41:44.121746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe103020-8fb6-4b65-adc7-0e09f51d6cdb None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:44.122152 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe103020-8fb6-4b65-adc7-0e09f51d6cdb None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:44.122360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe103020-8fb6-4b65-adc7-0e09f51d6cdb None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:44.123757 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 124/235] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:44.129372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529614d9-1ffd-45ae-9e18-5ecabbc05f67 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:44.129657 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529614d9-1ffd-45ae-9e18-5ecabbc05f67 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:44.129933 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529614d9-1ffd-45ae-9e18-5ecabbc05f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:44.157357 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-529614d9-1ffd-45ae-9e18-5ecabbc05f67 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:44.158549 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-529614d9-1ffd-45ae-9e18-5ecabbc05f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:44.234589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:44.252057 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 112/236] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:44.290872 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe103020-8fb6-4b65-adc7-0e09f51d6cdb None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:44.363807 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:44.408667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973917c-190f-454b-8bd1-1a2e285b3569 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:44.409199 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973917c-190f-454b-8bd1-1a2e285b3569 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:44.409272 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973917c-190f-454b-8bd1-1a2e285b3569 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:44.411470 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 113/237] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:41:44.417699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370074c0-db6d-41e0-b6c3-64967b076c8e None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:44.418054 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370074c0-db6d-41e0-b6c3-64967b076c8e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:44.418400 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370074c0-db6d-41e0-b6c3-64967b076c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:44.426669 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe103020-8fb6-4b65-adc7-0e09f51d6cdb None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:44.439915 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-370074c0-db6d-41e0-b6c3-64967b076c8e None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:44.441892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-370074c0-db6d-41e0-b6c3-64967b076c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:44.495096 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507a067-5465-47c6-92c1-a4182421ae86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:44.495748 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507a067-5465-47c6-92c1-a4182421ae86 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:44.496024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507a067-5465-47c6-92c1-a4182421ae86 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:44.496295 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507a067-5465-47c6-92c1-a4182421ae86 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:44.524045 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 114/238] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:44.524414 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507a067-5465-47c6-92c1-a4182421ae86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:44.529942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-f507a067-5465-47c6-92c1-a4182421ae86 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:41:44.529942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:44.529942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:44.529942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:44.529942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:44.529942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:44.529942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:44.529942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:44.529942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:44.529942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:44.529942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:44.529942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:44.529942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:44.529942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:44.529942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:44.529942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:44.530788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:44.530788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:44.530788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:44.530788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:44.530788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:44.530788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:44.530788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:44.530788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:44.530788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:44.530788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:44.530788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:44.530788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:44.530788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:44.530788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:44.530788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:44.530788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:44.531575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:44.531575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:44.531575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:44.531575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:44.531575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:44.531575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:44.531575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:44.531575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:44.531575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:44.531575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:44.531575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:41:44.531575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:41:44.531575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 125/239] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:44.537092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370074c0-db6d-41e0-b6c3-64967b076c8e None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:44.553631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507a067-5465-47c6-92c1-a4182421ae86 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:44.733409 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370074c0-db6d-41e0-b6c3-64967b076c8e None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:44.739711 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507a067-5465-47c6-92c1-a4182421ae86 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:44.771544 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:44.773464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:44.805425 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5db4d6-784d-48d9-93e8-5c9bb0f3c5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:44.805978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5db4d6-784d-48d9-93e8-5c9bb0f3c5af None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:44.806263 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5db4d6-784d-48d9-93e8-5c9bb0f3c5af None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:44.806539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5db4d6-784d-48d9-93e8-5c9bb0f3c5af None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:44.807276 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5db4d6-784d-48d9-93e8-5c9bb0f3c5af None admin] RBAC: Adding query filter params (name=reader) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:44.807580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5db4d6-784d-48d9-93e8-5c9bb0f3c5af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:44.808969 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5db4d6-784d-48d9-93e8-5c9bb0f3c5af None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:44.809863 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ac15d-c04c-4cea-9f87-6fe2cd3555a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:44.810747 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ac15d-c04c-4cea-9f87-6fe2cd3555a4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:44.811243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ac15d-c04c-4cea-9f87-6fe2cd3555a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:44.811703 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ac15d-c04c-4cea-9f87-6fe2cd3555a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:44.813080 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ac15d-c04c-4cea-9f87-6fe2cd3555a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:44.814723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ac15d-c04c-4cea-9f87-6fe2cd3555a4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:44.825305 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 115/240] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:44.825469 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 126/241] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:41:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:44.826057 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5db4d6-784d-48d9-93e8-5c9bb0f3c5af None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:44.831293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ac15d-c04c-4cea-9f87-6fe2cd3555a4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:44.975645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5db4d6-784d-48d9-93e8-5c9bb0f3c5af None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:45.014190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20783063-5d81-43c0-8ffe-3dd96e1ea21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:45.015531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20783063-5d81-43c0-8ffe-3dd96e1ea21c None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:45.016159 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20783063-5d81-43c0-8ffe-3dd96e1ea21c None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:45.016620 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20783063-5d81-43c0-8ffe-3dd96e1ea21c None admin] PATH_INFO: `/v3/users/2f7647590050417f931a25eb37cb13e9` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:45.018725 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ac15d-c04c-4cea-9f87-6fe2cd3555a4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:45.046725 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20783063-5d81-43c0-8ffe-3dd96e1ea21c None admin] RBAC: Authorizing `identity:get_user(user_id=2f7647590050417f931a25eb37cb13e9)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:45.048602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20783063-5d81-43c0-8ffe-3dd96e1ea21c None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:45.050533 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 116/242] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:44 2022] GET /identity/v3/users/2f7647590050417f931a25eb37cb13e9 => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:45.057515 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20783063-5d81-43c0-8ffe-3dd96e1ea21c None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:45.084902 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3470b-29fe-4077-8158-87ec6cc68334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:45.085565 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3470b-29fe-4077-8158-87ec6cc68334 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:45.085842 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3470b-29fe-4077-8158-87ec6cc68334 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:45.086114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3470b-29fe-4077-8158-87ec6cc68334 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:45.086799 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3470b-29fe-4077-8158-87ec6cc68334 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:45.088353 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3470b-29fe-4077-8158-87ec6cc68334 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:45.111762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 127/243] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Jul 28 17:41:44 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:41:45.116112 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:45.118664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61258c-2425-45bc-965d-09d63655eb58 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:45.118958 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61258c-2425-45bc-965d-09d63655eb58 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:45.119256 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61258c-2425-45bc-965d-09d63655eb58 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:45.122043 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 128/244] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:45.140123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d558e-43f6-479a-bf9d-1da5fba85a1c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:45.140455 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d558e-43f6-479a-bf9d-1da5fba85a1c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:45.140670 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d558e-43f6-479a-bf9d-1da5fba85a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:45.186298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-643d558e-43f6-479a-bf9d-1da5fba85a1c None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:45.187508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-643d558e-43f6-479a-bf9d-1da5fba85a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:45.198478 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20783063-5d81-43c0-8ffe-3dd96e1ea21c None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:45.246554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7029c1-d06d-4d5f-86f9-d6018a120973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:45.247227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7029c1-d06d-4d5f-86f9-d6018a120973 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:45.247504 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7029c1-d06d-4d5f-86f9-d6018a120973 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:45.247774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7029c1-d06d-4d5f-86f9-d6018a120973 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:45.261449 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:45.316967 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 129/245] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:45.347842 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d558e-43f6-479a-bf9d-1da5fba85a1c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:45.373430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7029c1-d06d-4d5f-86f9-d6018a120973 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:45.375362 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7029c1-d06d-4d5f-86f9-d6018a120973 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:45.425990 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:45.482469 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d558e-43f6-479a-bf9d-1da5fba85a1c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:45.494801 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 117/246] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:41:45.501404 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7029c1-d06d-4d5f-86f9-d6018a120973 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:45.543448 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4243604-c118-4b02-a8e5-b7ea075daa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:45.544497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4243604-c118-4b02-a8e5-b7ea075daa04 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:45.545002 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4243604-c118-4b02-a8e5-b7ea075daa04 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:45.545632 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4243604-c118-4b02-a8e5-b7ea075daa04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:45.560545 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4243604-c118-4b02-a8e5-b7ea075daa04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:45.566197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-d4243604-c118-4b02-a8e5-b7ea075daa04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:45.566197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:45.566197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:45.566197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:45.566197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:45.566197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:45.566197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:45.566197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:45.566197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:45.566197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:45.566197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:45.566197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:45.566197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:45.566197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:45.566197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:45.566197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:45.567149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:45.567149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:45.567149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:45.567149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:45.567149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:45.567149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:45.567149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:45.567149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:45.567149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:45.567149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:45.567149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:45.567149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:45.567149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:45.567149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:45.567149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:45.567149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:45.567963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:45.567963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:45.567963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:45.567963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:45.567963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:45.567963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:45.567963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:45.567963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:45.567963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:45.567963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:45.567963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:45.567963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:41:45.567963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 130/247] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:41:45.575863 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4243604-c118-4b02-a8e5-b7ea075daa04 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:45.616188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:45.641807 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7029c1-d06d-4d5f-86f9-d6018a120973 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:45.693883 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff77f2-e744-4213-8436-d969d4d3788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:45.695046 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff77f2-e744-4213-8436-d969d4d3788e None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:45.695551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff77f2-e744-4213-8436-d969d4d3788e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:45.696005 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff77f2-e744-4213-8436-d969d4d3788e None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:45.697655 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff77f2-e744-4213-8436-d969d4d3788e None admin] RBAC: Authorizing `identity:get_project(project_id=a9647712d7a24fe1831a2c16cfba2abb)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:45.699398 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff77f2-e744-4213-8436-d969d4d3788e None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:45.701721 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 118/248] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:45 2022] GET /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:45.707181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4243604-c118-4b02-a8e5-b7ea075daa04 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:45.709695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff77f2-e744-4213-8436-d969d4d3788e None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:45.719118 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:45.751047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d282fb0-1ed1-46ed-b772-2699496cfc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:45.751996 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d282fb0-1ed1-46ed-b772-2699496cfc96 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:45.752503 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d282fb0-1ed1-46ed-b772-2699496cfc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:45.752965 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d282fb0-1ed1-46ed-b772-2699496cfc96 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:45.753891 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d282fb0-1ed1-46ed-b772-2699496cfc96 None admin] RBAC: Adding query filter params (name=member) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:45.754371 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d282fb0-1ed1-46ed-b772-2699496cfc96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:45.756497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d282fb0-1ed1-46ed-b772-2699496cfc96 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:45.771493 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 131/249] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:45.781852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d282fb0-1ed1-46ed-b772-2699496cfc96 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:45.840085 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff77f2-e744-4213-8436-d969d4d3788e None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:45.885342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70508009-7aa2-4400-bf7b-9819aecee36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:45.887879 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70508009-7aa2-4400-bf7b-9819aecee36c None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:45.887879 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70508009-7aa2-4400-bf7b-9819aecee36c None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:45.887879 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70508009-7aa2-4400-bf7b-9819aecee36c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:45.887879 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70508009-7aa2-4400-bf7b-9819aecee36c None admin] RBAC: Adding query filter params (role.id=3e04c82538344690a5a6591b125b6b86, scope.project.id=a9647712d7a24fe1831a2c16cfba2abb, user.id=2f7647590050417f931a25eb37cb13e9) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:45.887879 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70508009-7aa2-4400-bf7b-9819aecee36c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:45.889426 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70508009-7aa2-4400-bf7b-9819aecee36c None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:45.896416 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 119/250] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:41:45 2022] GET /identity/v3/role_assignments?user.id=2f7647590050417f931a25eb37cb13e9&scope.project.id=a9647712d7a24fe1831a2c16cfba2abb&role.id=3e04c82538344690a5a6591b125b6b86 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:45.907623 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:45.918201 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d282fb0-1ed1-46ed-b772-2699496cfc96 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:45.959192 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8b8a9-836a-4cab-b6c3-ad369f6f9ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:45.960322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8b8a9-836a-4cab-b6c3-ad369f6f9ebc None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:45.960850 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8b8a9-836a-4cab-b6c3-ad369f6f9ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:45.961358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8b8a9-836a-4cab-b6c3-ad369f6f9ebc None admin] PATH_INFO: `/v3/users/4fc03903497d44018f7b2ccd496d4b7e` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:45.963000 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8b8a9-836a-4cab-b6c3-ad369f6f9ebc None admin] RBAC: Authorizing `identity:get_user(user_id=4fc03903497d44018f7b2ccd496d4b7e)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:45.964759 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8b8a9-836a-4cab-b6c3-ad369f6f9ebc None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:45.966893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 132/251] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:45 2022] GET /identity/v3/users/4fc03903497d44018f7b2ccd496d4b7e => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:45.972928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70508009-7aa2-4400-bf7b-9819aecee36c None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:46.084396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:46.118242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70508009-7aa2-4400-bf7b-9819aecee36c None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:46.153398 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07ce3e-585c-489b-b7f8-962d4fd42307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:46.154048 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07ce3e-585c-489b-b7f8-962d4fd42307 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:46.154322 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07ce3e-585c-489b-b7f8-962d4fd42307 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:46.154591 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07ce3e-585c-489b-b7f8-962d4fd42307 None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:46.155740 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07ce3e-585c-489b-b7f8-962d4fd42307 None admin] RBAC: Authorizing `identity:get_project(project_id=a9647712d7a24fe1831a2c16cfba2abb)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:46.157228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07ce3e-585c-489b-b7f8-962d4fd42307 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:46.159264 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 120/252] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:45 2022] GET /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:46.165336 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8b8a9-836a-4cab-b6c3-ad369f6f9ebc None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:46.168929 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d0bbd-34ab-464e-bfcb-fe0e317f8dd4 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:46.169241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d0bbd-34ab-464e-bfcb-fe0e317f8dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:46.169515 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d0bbd-34ab-464e-bfcb-fe0e317f8dd4 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:46.171830 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 121/253] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:46.178129 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b6845-17d9-4432-99dc-85f136d3bf3d None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:46.178669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b6845-17d9-4432-99dc-85f136d3bf3d None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:46.179161 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b6845-17d9-4432-99dc-85f136d3bf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:46.206830 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-af8b6845-17d9-4432-99dc-85f136d3bf3d None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:46.208013 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-af8b6845-17d9-4432-99dc-85f136d3bf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:46.319356 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8b8a9-836a-4cab-b6c3-ad369f6f9ebc None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:46.322974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 122/254] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:41:46.324250 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4faf3-8465-4e35-83f0-6524a7c3945e None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:46.324537 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4faf3-8465-4e35-83f0-6524a7c3945e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:46.324808 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4faf3-8465-4e35-83f0-6524a7c3945e None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:46.326062 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 123/255] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:46.336613 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d67bef-9e46-4fd9-b809-731645cd2509 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:46.336887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d67bef-9e46-4fd9-b809-731645cd2509 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:46.337188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d67bef-9e46-4fd9-b809-731645cd2509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:46.376591 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-53d67bef-9e46-4fd9-b809-731645cd2509 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:46.377735 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-53d67bef-9e46-4fd9-b809-731645cd2509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:46.404666 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796f35a-27a4-41bf-9e56-efdae3a29372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:46.405534 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796f35a-27a4-41bf-9e56-efdae3a29372 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:46.405534 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796f35a-27a4-41bf-9e56-efdae3a29372 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:46.405929 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796f35a-27a4-41bf-9e56-efdae3a29372 None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb/users/4fc03903497d44018f7b2ccd496d4b7e/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:46.410611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796f35a-27a4-41bf-9e56-efdae3a29372 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9647712d7a24fe1831a2c16cfba2abb, user_id=4fc03903497d44018f7b2ccd496d4b7e, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:46.413041 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796f35a-27a4-41bf-9e56-efdae3a29372 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:46.436392 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 133/256] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:41:46 2022] PUT /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb/users/4fc03903497d44018f7b2ccd496d4b7e/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:41:46.438159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796f35a-27a4-41bf-9e56-efdae3a29372 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:46.493280 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:46.509325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:46.523853 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 124/257] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:46.566084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d67bef-9e46-4fd9-b809-731645cd2509 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:46.646380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796f35a-27a4-41bf-9e56-efdae3a29372 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:46.716780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa0086-cc73-41d2-be9d-75f75082e108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:46.717488 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa0086-cc73-41d2-be9d-75f75082e108 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:46.717763 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa0086-cc73-41d2-be9d-75f75082e108 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:46.718029 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa0086-cc73-41d2-be9d-75f75082e108 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:46.740942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa0086-cc73-41d2-be9d-75f75082e108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:46.748123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-7cfa0086-cc73-41d2-be9d-75f75082e108 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:41:46.748123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:46.748123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:46.748123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:46.748123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:46.748123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:46.748123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:46.748123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:46.748123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:46.748123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:46.748123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:46.748123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:46.748123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:46.748123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:46.748123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:46.748123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:46.749044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:46.749044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:46.749044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:46.749044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:46.749044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:46.749044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:46.749044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:46.749044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:46.749044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:46.749044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:46.749044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:46.749044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:46.749044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:46.749044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:46.749044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:46.749044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:46.749892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:46.749892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:46.749892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:46.749892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:46.749892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:46.749892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:46.749892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:46.749892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:46.749892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:46.749892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:46.749892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:41:46.749892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:41:46.752867 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 134/258] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:41:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:46.760223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa0086-cc73-41d2-be9d-75f75082e108 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:46.784422 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d67bef-9e46-4fd9-b809-731645cd2509 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:46.850652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1d5ef-bb18-46ce-8a80-b201ba2606aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:46.851305 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1d5ef-bb18-46ce-8a80-b201ba2606aa None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:46.851581 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1d5ef-bb18-46ce-8a80-b201ba2606aa None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:46.851848 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1d5ef-bb18-46ce-8a80-b201ba2606aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:46.870953 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1d5ef-bb18-46ce-8a80-b201ba2606aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:46.876052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-31f1d5ef-bb18-46ce-8a80-b201ba2606aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:41:46.876052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:46.876052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:46.876052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:46.876052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:46.876052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:46.876052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:46.876052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:46.876052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:46.876052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:46.876052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:46.876052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:46.876052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:46.876052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:46.876052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:46.876052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:46.876932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:46.876932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:46.876932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:46.876932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:46.876932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:46.876932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:46.876932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:46.876932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:46.876932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:46.876932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:46.876932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:46.876932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:46.876932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:46.876932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:46.876932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:46.876932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:46.877854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:46.877854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:46.877854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:46.877854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:46.877854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:46.877854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:46.877854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:46.877854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:46.877854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:46.877854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:46.877854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:41:46.877854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:46.877854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 125/259] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:41:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:41:46.885444 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1d5ef-bb18-46ce-8a80-b201ba2606aa None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:46.926670 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:46.962801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa0086-cc73-41d2-be9d-75f75082e108 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:46.969024 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:47.028736 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553ee3f-4c92-43fc-b910-b01a80447623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:47.029393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553ee3f-4c92-43fc-b910-b01a80447623 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:47.032223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553ee3f-4c92-43fc-b910-b01a80447623 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:47.032223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553ee3f-4c92-43fc-b910-b01a80447623 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:47.032223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553ee3f-4c92-43fc-b910-b01a80447623 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:47.032223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553ee3f-4c92-43fc-b910-b01a80447623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:47.032525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553ee3f-4c92-43fc-b910-b01a80447623 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:47.041380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 135/260] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:41:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:47.049423 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1d5ef-bb18-46ce-8a80-b201ba2606aa None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:47.050130 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553ee3f-4c92-43fc-b910-b01a80447623 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:47.125794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c0dcd-e875-4679-a432-ffef94117fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:47.126455 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c0dcd-e875-4679-a432-ffef94117fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:47.126731 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c0dcd-e875-4679-a432-ffef94117fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:47.127002 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c0dcd-e875-4679-a432-ffef94117fe6 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:47.127753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c0dcd-e875-4679-a432-ffef94117fe6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:47.128056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c0dcd-e875-4679-a432-ffef94117fe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:47.129507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c0dcd-e875-4679-a432-ffef94117fe6 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:47.147460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 126/261] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:47.153561 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c0dcd-e875-4679-a432-ffef94117fe6 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:47.273431 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553ee3f-4c92-43fc-b910-b01a80447623 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:47.328990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3efdd-7947-47aa-838d-ac4245760713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:47.329725 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3efdd-7947-47aa-838d-ac4245760713 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:47.330012 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3efdd-7947-47aa-838d-ac4245760713 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:47.330286 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3efdd-7947-47aa-838d-ac4245760713 None admin] PATH_INFO: `/v3/users/63b7effa31214744b9e1b1a5562424aa` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:47.331454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3efdd-7947-47aa-838d-ac4245760713 None admin] RBAC: Authorizing `identity:get_user(user_id=63b7effa31214744b9e1b1a5562424aa)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:47.332899 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3efdd-7947-47aa-838d-ac4245760713 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:47.334891 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 136/262] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:47 2022] GET /identity/v3/users/63b7effa31214744b9e1b1a5562424aa => generated 283 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:47.342025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3efdd-7947-47aa-838d-ac4245760713 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:47.359028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c0dcd-e875-4679-a432-ffef94117fe6 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:47.364524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:47.400144 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:47.432961 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a91aa-9c13-4898-808f-4557c165856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:47.434365 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a91aa-9c13-4898-808f-4557c165856e None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:47.435125 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a91aa-9c13-4898-808f-4557c165856e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:47.435863 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a91aa-9c13-4898-808f-4557c165856e None admin] PATH_INFO: `/v3/users/63b7effa31214744b9e1b1a5562424aa` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:47.437799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a91aa-9c13-4898-808f-4557c165856e None admin] RBAC: Authorizing `identity:get_user(user_id=63b7effa31214744b9e1b1a5562424aa)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:47.442771 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a91aa-9c13-4898-808f-4557c165856e None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:47.444667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 127/263] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:47 2022] GET /identity/v3/users/63b7effa31214744b9e1b1a5562424aa => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:47.450371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a91aa-9c13-4898-808f-4557c165856e None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:47.505007 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3efdd-7947-47aa-838d-ac4245760713 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:47.557507 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18341f88-0abb-4278-9463-16f39faadea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:47.558056 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18341f88-0abb-4278-9463-16f39faadea4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:47.558337 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18341f88-0abb-4278-9463-16f39faadea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:47.558609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18341f88-0abb-4278-9463-16f39faadea4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:47.650706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18341f88-0abb-4278-9463-16f39faadea4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:47.652200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18341f88-0abb-4278-9463-16f39faadea4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:47.665007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a91aa-9c13-4898-808f-4557c165856e None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:47.681411 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:47.736216 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116f298-fb5b-471b-ac0a-f15ee3a21eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:47.736852 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116f298-fb5b-471b-ac0a-f15ee3a21eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:47.737158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116f298-fb5b-471b-ac0a-f15ee3a21eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:47.737429 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116f298-fb5b-471b-ac0a-f15ee3a21eb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:47.825155 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:47.839340 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116f298-fb5b-471b-ac0a-f15ee3a21eb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:47.841373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116f298-fb5b-471b-ac0a-f15ee3a21eb1 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:47.867431 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 137/264] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:41:47.873150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18341f88-0abb-4278-9463-16f39faadea4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:47.960817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 128/265] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:41:47.967011 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116f298-fb5b-471b-ac0a-f15ee3a21eb1 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:48.071125 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:48.089018 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116f298-fb5b-471b-ac0a-f15ee3a21eb1 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:48.134120 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18341f88-0abb-4278-9463-16f39faadea4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:48.149831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dcd83-3c44-45dc-b5df-0437a17d60ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:48.150487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dcd83-3c44-45dc-b5df-0437a17d60ce None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:48.150762 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dcd83-3c44-45dc-b5df-0437a17d60ce None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:48.151035 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dcd83-3c44-45dc-b5df-0437a17d60ce None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:48.153991 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725dcd83-3c44-45dc-b5df-0437a17d60ce None admin] RBAC: Authorizing `identity:get_project(project_id=a9647712d7a24fe1831a2c16cfba2abb)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:48.155442 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725dcd83-3c44-45dc-b5df-0437a17d60ce None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:48.157141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 129/266] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:47 2022] GET /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:48.163498 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dcd83-3c44-45dc-b5df-0437a17d60ce None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:48.166257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:48.225381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbb261-0e22-4d58-88f9-5f53633bff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:48.226038 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbb261-0e22-4d58-88f9-5f53633bff42 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:48.226322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbb261-0e22-4d58-88f9-5f53633bff42 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:48.226593 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbb261-0e22-4d58-88f9-5f53633bff42 None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:48.228434 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbb261-0e22-4d58-88f9-5f53633bff42 None admin] RBAC: Authorizing `identity:get_project(project_id=a9647712d7a24fe1831a2c16cfba2abb)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:48.229966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbb261-0e22-4d58-88f9-5f53633bff42 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:48.231675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 138/267] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:47 2022] GET /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb => generated 302 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:48.237795 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbb261-0e22-4d58-88f9-5f53633bff42 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:48.375261 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dcd83-3c44-45dc-b5df-0437a17d60ce None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:48.381303 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbb261-0e22-4d58-88f9-5f53633bff42 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:48.416531 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543530c-edbc-41df-8db4-468eeb369be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:48.417181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543530c-edbc-41df-8db4-468eeb369be3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:48.417457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543530c-edbc-41df-8db4-468eeb369be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:48.417724 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543530c-edbc-41df-8db4-468eeb369be3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:48.418502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543530c-edbc-41df-8db4-468eeb369be3 None admin] RBAC: Adding query filter params (role.id=5b95c3aebc8041c7885a9234a9e54d7c, scope.project.id=a9647712d7a24fe1831a2c16cfba2abb, user.id=63b7effa31214744b9e1b1a5562424aa) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:48.418919 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543530c-edbc-41df-8db4-468eeb369be3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:48.420522 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543530c-edbc-41df-8db4-468eeb369be3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:48.427136 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 139/268] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:41:48 2022] GET /identity/v3/role_assignments?user.id=63b7effa31214744b9e1b1a5562424aa&scope.project.id=a9647712d7a24fe1831a2c16cfba2abb&role.id=5b95c3aebc8041c7885a9234a9e54d7c => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:48.428491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92eae97-9a91-4066-ab9c-c37c0eded923 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:48.428846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92eae97-9a91-4066-ab9c-c37c0eded923 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:48.429146 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92eae97-9a91-4066-ab9c-c37c0eded923 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:48.430499 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 140/269] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:48.436786 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278152e-2f64-4d8d-9cdc-a0136d38da44 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:48.437136 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278152e-2f64-4d8d-9cdc-a0136d38da44 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:48.437364 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278152e-2f64-4d8d-9cdc-a0136d38da44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:48.456806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-6278152e-2f64-4d8d-9cdc-a0136d38da44 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:48.457833 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ab1bb-fbae-490a-9026-71b18acfada5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:48.458106 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6278152e-2f64-4d8d-9cdc-a0136d38da44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:48.458497 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ab1bb-fbae-490a-9026-71b18acfada5 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:48.458828 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ab1bb-fbae-490a-9026-71b18acfada5 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:48.459202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ab1bb-fbae-490a-9026-71b18acfada5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:48.460313 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ab1bb-fbae-490a-9026-71b18acfada5 None admin] RBAC: Adding query filter params (role.id=980cae90acae42189f92fd6dd42867a5, scope.project.id=a9647712d7a24fe1831a2c16cfba2abb, user.id=63b7effa31214744b9e1b1a5562424aa) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:48.460630 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ab1bb-fbae-490a-9026-71b18acfada5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:48.462149 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ab1bb-fbae-490a-9026-71b18acfada5 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:48.468808 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 130/270] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:41:48 2022] GET /identity/v3/role_assignments?user.id=63b7effa31214744b9e1b1a5562424aa&scope.project.id=a9647712d7a24fe1831a2c16cfba2abb&role.id=980cae90acae42189f92fd6dd42867a5 => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:48.509540 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:48.538902 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 141/271] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:48.585582 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ab1bb-fbae-490a-9026-71b18acfada5 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:48.619483 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:48.704090 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d901e39-ac45-4ecd-a2c2-aa95cbff007a None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:48.704711 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d901e39-ac45-4ecd-a2c2-aa95cbff007a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:48.705257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d901e39-ac45-4ecd-a2c2-aa95cbff007a None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:48.707139 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 142/272] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:48.714621 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3ee7f-7e59-45b7-9369-594363bb4d31 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:48.715508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3ee7f-7e59-45b7-9369-594363bb4d31 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:48.716024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3ee7f-7e59-45b7-9369-594363bb4d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:48.725088 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ab1bb-fbae-490a-9026-71b18acfada5 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:48.760013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-53a3ee7f-7e59-45b7-9369-594363bb4d31 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:48.761726 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-53a3ee7f-7e59-45b7-9369-594363bb4d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:48.774731 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa1ba7-83c6-4455-8740-4ed7ab9f92bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:48.775730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa1ba7-83c6-4455-8740-4ed7ab9f92bf None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:48.776013 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa1ba7-83c6-4455-8740-4ed7ab9f92bf None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:48.776287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa1ba7-83c6-4455-8740-4ed7ab9f92bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:48.797279 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa1ba7-83c6-4455-8740-4ed7ab9f92bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:48.803084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-07aa1ba7-83c6-4455-8740-4ed7ab9f92bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:48.803084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:48.803084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:48.803084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:48.803084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:48.803084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:48.803084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:48.803084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:48.803084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:48.803084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:48.803084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:48.803084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:48.803084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:48.803084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:48.803084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:48.803084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:48.803974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:48.803974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:48.803974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:48.803974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:48.803974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:48.803974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:48.803974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:48.803974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:48.803974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:48.803974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:48.803974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:48.803974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:48.803974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:48.803974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:48.803974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:48.803974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:48.805236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:48.805236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:48.805236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:48.805236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:48.805236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:48.805236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:48.805236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:48.805236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:48.805236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:48.805236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:48.805236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:48.805236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:48.805236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 131/273] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:48.812836 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa1ba7-83c6-4455-8740-4ed7ab9f92bf None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:48.860421 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 143/274] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:48.885407 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3ee7f-7e59-45b7-9369-594363bb4d31 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:48.942916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:48.966235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa1ba7-83c6-4455-8740-4ed7ab9f92bf None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:49.008139 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a192ae-16b8-4411-a0ce-72523ee16227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:49.008774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a192ae-16b8-4411-a0ce-72523ee16227 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:49.009051 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a192ae-16b8-4411-a0ce-72523ee16227 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:49.009365 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a192ae-16b8-4411-a0ce-72523ee16227 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:49.010130 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a192ae-16b8-4411-a0ce-72523ee16227 None admin] RBAC: Adding query filter params (name=member) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:49.010381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a192ae-16b8-4411-a0ce-72523ee16227 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:49.011807 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a192ae-16b8-4411-a0ce-72523ee16227 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:49.024185 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 132/275] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:49.030072 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a192ae-16b8-4411-a0ce-72523ee16227 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:49.032412 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3ee7f-7e59-45b7-9369-594363bb4d31 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:49.036326 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:49.083215 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de100820-b023-40e2-bfb2-671e41ed06c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:49.084699 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de100820-b023-40e2-bfb2-671e41ed06c2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:49.085203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de100820-b023-40e2-bfb2-671e41ed06c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:49.085979 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de100820-b023-40e2-bfb2-671e41ed06c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:49.087606 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de100820-b023-40e2-bfb2-671e41ed06c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:49.090181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de100820-b023-40e2-bfb2-671e41ed06c2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:49.092667 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 144/276] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:41:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:49.098326 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de100820-b023-40e2-bfb2-671e41ed06c2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:49.146030 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a192ae-16b8-4411-a0ce-72523ee16227 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:49.180705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f7fa7-59e4-4f1b-b810-d58e6c73e299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:49.181384 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f7fa7-59e4-4f1b-b810-d58e6c73e299 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:49.181661 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f7fa7-59e4-4f1b-b810-d58e6c73e299 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:49.181933 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f7fa7-59e4-4f1b-b810-d58e6c73e299 None admin] PATH_INFO: `/v3/users/aea112940235445399e3fb1d6ba3dd76` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:49.194294 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:49.197726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f7fa7-59e4-4f1b-b810-d58e6c73e299 None admin] RBAC: Authorizing `identity:get_user(user_id=aea112940235445399e3fb1d6ba3dd76)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:49.199299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f7fa7-59e4-4f1b-b810-d58e6c73e299 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:49.201954 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 133/277] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:49 2022] GET /identity/v3/users/aea112940235445399e3fb1d6ba3dd76 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:49.203085 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e6425-b87f-4fc0-baae-2edf486a662e None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:49.203370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e6425-b87f-4fc0-baae-2edf486a662e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:49.203640 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e6425-b87f-4fc0-baae-2edf486a662e None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:49.204963 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 134/278] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:49.209789 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e6425-b87f-4fc0-baae-2edf486a662e None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:49.212066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de100820-b023-40e2-bfb2-671e41ed06c2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:49.249884 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93409cc1-1f28-4372-8766-f66f47be808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:49.250430 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93409cc1-1f28-4372-8766-f66f47be808f None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:49.250703 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93409cc1-1f28-4372-8766-f66f47be808f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:49.250971 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93409cc1-1f28-4372-8766-f66f47be808f None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:49.251647 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93409cc1-1f28-4372-8766-f66f47be808f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:49.253107 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93409cc1-1f28-4372-8766-f66f47be808f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:49.278298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 145/279] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Jul 28 17:41:49 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:41:49.279603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4e584-6c53-4568-a6dd-76a405e0586f None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:49.279897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4e584-6c53-4568-a6dd-76a405e0586f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:49.280158 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4e584-6c53-4568-a6dd-76a405e0586f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:49.305420 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-bdf4e584-6c53-4568-a6dd-76a405e0586f None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:49.308588 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-bdf4e584-6c53-4568-a6dd-76a405e0586f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:49.336482 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:49.361189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e6425-b87f-4fc0-baae-2edf486a662e None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:49.391251 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 146/280] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:49.392588 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bb4a6-f89b-489a-b2bc-c7ffd400ffbc None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:49.392929 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bb4a6-f89b-489a-b2bc-c7ffd400ffbc None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:49.393291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bb4a6-f89b-489a-b2bc-c7ffd400ffbc None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:49.394622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 147/281] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:49.400604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29baa34-17be-4744-85ee-ef78e9b10c05 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:49.400886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29baa34-17be-4744-85ee-ef78e9b10c05 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:49.401193 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29baa34-17be-4744-85ee-ef78e9b10c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:49.408586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b297df1-5f50-4d33-9df8-1ba3d113765d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:49.409310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b297df1-5f50-4d33-9df8-1ba3d113765d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:49.409589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b297df1-5f50-4d33-9df8-1ba3d113765d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:49.409860 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b297df1-5f50-4d33-9df8-1ba3d113765d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:49.410668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b297df1-5f50-4d33-9df8-1ba3d113765d None admin] RBAC: Adding query filter params (role.id=1e9bc5b431414d62a974beb13a8f83c7, user.id=aea112940235445399e3fb1d6ba3dd76, scope.system=all) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:49.410985 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b297df1-5f50-4d33-9df8-1ba3d113765d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:49.412609 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b297df1-5f50-4d33-9df8-1ba3d113765d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:49.420403 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 135/282] 10.222.0.96 () {56 vars in 1308 bytes} [Thu Jul 28 17:41:49 2022] GET /identity/v3/role_assignments?user.id=aea112940235445399e3fb1d6ba3dd76&scope.system=all&role.id=1e9bc5b431414d62a974beb13a8f83c7 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:49.422373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b297df1-5f50-4d33-9df8-1ba3d113765d None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:49.423596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c29baa34-17be-4744-85ee-ef78e9b10c05 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:49.425555 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c29baa34-17be-4744-85ee-ef78e9b10c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:49.509046 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:49.540954 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 148/283] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:41:49.559987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b297df1-5f50-4d33-9df8-1ba3d113765d None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:49.564005 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29baa34-17be-4744-85ee-ef78e9b10c05 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:49.605417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95df341-ec4b-4708-8c98-e6d93400f83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:49.606881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95df341-ec4b-4708-8c98-e6d93400f83e None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:49.607361 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95df341-ec4b-4708-8c98-e6d93400f83e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:49.607836 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95df341-ec4b-4708-8c98-e6d93400f83e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:49.622802 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95df341-ec4b-4708-8c98-e6d93400f83e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:49.629179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-c95df341-ec4b-4708-8c98-e6d93400f83e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:41:49.629179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:49.629179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:49.629179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:49.629179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:49.629179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:49.629179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:49.629179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:49.629179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:49.629179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:49.629179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:49.629179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:49.629179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:49.629179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:49.629179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:49.629179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:49.630083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:49.630083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:49.630083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:49.630083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:49.630083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:49.630083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:49.630083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:49.630083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:49.630083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:49.630083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:49.630083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:49.630083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:49.630083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:49.630083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:49.630083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:49.630083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:49.631293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:49.631293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:49.631293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:49.631293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:49.631293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:49.631293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:49.631293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:49.631293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:49.631293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:49.631293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:49.631293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:41:49.631293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:49.631293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 136/284] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:49.640347 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95df341-ec4b-4708-8c98-e6d93400f83e None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:49.692202 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:49.718342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29baa34-17be-4744-85ee-ef78e9b10c05 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:49.765106 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca6793-f629-4d45-826c-4c8d6473ffb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:49.765706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca6793-f629-4d45-826c-4c8d6473ffb0 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:49.766239 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca6793-f629-4d45-826c-4c8d6473ffb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:49.766511 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca6793-f629-4d45-826c-4c8d6473ffb0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:49.778722 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95df341-ec4b-4708-8c98-e6d93400f83e None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:49.782449 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca6793-f629-4d45-826c-4c8d6473ffb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:49.787940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-a7ca6793-f629-4d45-826c-4c8d6473ffb0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:49.787940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:49.787940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:49.787940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:49.787940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:49.787940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:49.787940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:49.787940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:49.787940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:49.787940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:49.787940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:49.787940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:49.787940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:49.787940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:49.787940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:49.787940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:49.788852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:49.788852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:49.788852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:49.788852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:49.788852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:49.788852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:49.788852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:49.788852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:49.788852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:49.788852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:49.788852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:49.788852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:49.788852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:49.788852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:49.788852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:49.788852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:49.790150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:49.790150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:49.790150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:49.790150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:49.790150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:49.790150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:49.790150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:49.790150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:49.790150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:49.790150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:49.790150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:49.790150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:41:49.790150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 149/285] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:41:49.795668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca6793-f629-4d45-826c-4c8d6473ffb0 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:49.813944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:49.828893 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccafa4-bc0d-4778-b770-ae8692adf69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:49.829726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccafa4-bc0d-4778-b770-ae8692adf69f None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:49.830010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccafa4-bc0d-4778-b770-ae8692adf69f None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:49.830538 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccafa4-bc0d-4778-b770-ae8692adf69f None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:49.831690 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccafa4-bc0d-4778-b770-ae8692adf69f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:49.832001 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccafa4-bc0d-4778-b770-ae8692adf69f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:49.834139 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccafa4-bc0d-4778-b770-ae8692adf69f None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:49.846437 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 137/286] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:49.853440 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccafa4-bc0d-4778-b770-ae8692adf69f None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:49.967330 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca6793-f629-4d45-826c-4c8d6473ffb0 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:50.005201 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccafa4-bc0d-4778-b770-ae8692adf69f None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:50.044507 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8926c06-af29-46db-bcd8-a56794c9d16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:50.045267 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8926c06-af29-46db-bcd8-a56794c9d16f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:50.045470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8926c06-af29-46db-bcd8-a56794c9d16f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:50.045734 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8926c06-af29-46db-bcd8-a56794c9d16f None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:50.046460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8926c06-af29-46db-bcd8-a56794c9d16f None admin] RBAC: Adding query filter params (name=member) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:50.046763 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8926c06-af29-46db-bcd8-a56794c9d16f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:50.048166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8926c06-af29-46db-bcd8-a56794c9d16f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:50.057778 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188188d-107a-4177-ac57-220c294b6ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:50.058495 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188188d-107a-4177-ac57-220c294b6ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:50.058772 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188188d-107a-4177-ac57-220c294b6ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:50.059042 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188188d-107a-4177-ac57-220c294b6ec4 None admin] PATH_INFO: `/v3/users/2f7647590050417f931a25eb37cb13e9` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:50.061278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188188d-107a-4177-ac57-220c294b6ec4 None admin] RBAC: Authorizing `identity:get_user(user_id=2f7647590050417f931a25eb37cb13e9)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:50.062741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188188d-107a-4177-ac57-220c294b6ec4 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:50.064573 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 138/287] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:49 2022] GET /identity/v3/users/2f7647590050417f931a25eb37cb13e9 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:50.066689 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 150/288] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:50.070324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188188d-107a-4177-ac57-220c294b6ec4 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:50.071975 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8926c06-af29-46db-bcd8-a56794c9d16f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:50.095406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:50.184210 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:50.254714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8926c06-af29-46db-bcd8-a56794c9d16f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:50.276399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188188d-107a-4177-ac57-220c294b6ec4 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:50.319767 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98d430-5f6c-4cc8-b95f-965f415a16d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:50.320625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98d430-5f6c-4cc8-b95f-965f415a16d3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:50.320906 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98d430-5f6c-4cc8-b95f-965f415a16d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:50.321202 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98d430-5f6c-4cc8-b95f-965f415a16d3 None admin] PATH_INFO: `/v3/users/4fc03903497d44018f7b2ccd496d4b7e` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:50.324360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98d430-5f6c-4cc8-b95f-965f415a16d3 None admin] RBAC: Authorizing `identity:get_user(user_id=4fc03903497d44018f7b2ccd496d4b7e)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:50.325860 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98d430-5f6c-4cc8-b95f-965f415a16d3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:50.327476 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 151/289] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:50 2022] GET /identity/v3/users/4fc03903497d44018f7b2ccd496d4b7e => generated 297 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:50.334492 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98d430-5f6c-4cc8-b95f-965f415a16d3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:50.336754 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38120da-184d-452e-96e5-69ed3d077f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:50.338566 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38120da-184d-452e-96e5-69ed3d077f2d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:50.338847 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38120da-184d-452e-96e5-69ed3d077f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:50.339114 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38120da-184d-452e-96e5-69ed3d077f2d None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:50.341241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38120da-184d-452e-96e5-69ed3d077f2d None admin] RBAC: Authorizing `identity:get_project(project_id=a9647712d7a24fe1831a2c16cfba2abb)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:50.343601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38120da-184d-452e-96e5-69ed3d077f2d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:50.351153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 139/290] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:50 2022] GET /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:50.357918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38120da-184d-452e-96e5-69ed3d077f2d None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:50.457532 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:50.480079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98d430-5f6c-4cc8-b95f-965f415a16d3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:50.522468 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38120da-184d-452e-96e5-69ed3d077f2d None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:50.530097 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afe71d-6067-482a-8ead-e870b94e17ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:50.530676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afe71d-6067-482a-8ead-e870b94e17ff None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:50.531013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afe71d-6067-482a-8ead-e870b94e17ff None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:50.531321 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afe71d-6067-482a-8ead-e870b94e17ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:50.555729 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:50.563650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12410f-f87a-4261-8d1e-af51b793c9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:50.564328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12410f-f87a-4261-8d1e-af51b793c9ab None admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:50.564608 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12410f-f87a-4261-8d1e-af51b793c9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:50.564883 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12410f-f87a-4261-8d1e-af51b793c9ab None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb/users/2f7647590050417f931a25eb37cb13e9/roles/3e04c82538344690a5a6591b125b6b86` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:50.566864 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12410f-f87a-4261-8d1e-af51b793c9ab None admin] RBAC: Authorizing `identity:create_grant(project_id=a9647712d7a24fe1831a2c16cfba2abb, user_id=2f7647590050417f931a25eb37cb13e9, role_id=3e04c82538344690a5a6591b125b6b86)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:50.568343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12410f-f87a-4261-8d1e-af51b793c9ab None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:50.586428 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 140/291] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:41:50 2022] PUT /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb/users/2f7647590050417f931a25eb37cb13e9/roles/3e04c82538344690a5a6591b125b6b86 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:41:50.657229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afe71d-6067-482a-8ead-e870b94e17ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:50.658766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afe71d-6067-482a-8ead-e870b94e17ff None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:50.767589 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:50.796900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 152/292] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:41:50.802417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12410f-f87a-4261-8d1e-af51b793c9ab None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:50.908965 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12410f-f87a-4261-8d1e-af51b793c9ab None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:50.944410 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310b164-8120-4bf2-91e0-e2241740ad17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:50.945083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310b164-8120-4bf2-91e0-e2241740ad17 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:50.945374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310b164-8120-4bf2-91e0-e2241740ad17 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:50.945656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310b164-8120-4bf2-91e0-e2241740ad17 None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:50.946864 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310b164-8120-4bf2-91e0-e2241740ad17 None admin] RBAC: Authorizing `identity:get_project(project_id=a9647712d7a24fe1831a2c16cfba2abb)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:50.948327 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310b164-8120-4bf2-91e0-e2241740ad17 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:50.950352 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 141/293] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:50 2022] GET /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:50.959874 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afe71d-6067-482a-8ead-e870b94e17ff None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:51.111267 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afe71d-6067-482a-8ead-e870b94e17ff None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:51.159806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd31e4-40ef-44f3-8d82-c25fe1650865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:51.160443 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd31e4-40ef-44f3-8d82-c25fe1650865 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:51.160726 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd31e4-40ef-44f3-8d82-c25fe1650865 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:51.161006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd31e4-40ef-44f3-8d82-c25fe1650865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:51.161857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd31e4-40ef-44f3-8d82-c25fe1650865 None admin] RBAC: Adding query filter params (role.id=1e9bc5b431414d62a974beb13a8f83c7, scope.project.id=a9647712d7a24fe1831a2c16cfba2abb, user.id=4fc03903497d44018f7b2ccd496d4b7e) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:51.162219 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd31e4-40ef-44f3-8d82-c25fe1650865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:51.163614 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd31e4-40ef-44f3-8d82-c25fe1650865 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:51.173871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 153/294] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:41:50 2022] GET /identity/v3/role_assignments?user.id=4fc03903497d44018f7b2ccd496d4b7e&scope.project.id=a9647712d7a24fe1831a2c16cfba2abb&role.id=1e9bc5b431414d62a974beb13a8f83c7 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:51.770386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df90981-e7a8-4812-ba0e-c3c4df266e58 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:51.770790 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df90981-e7a8-4812-ba0e-c3c4df266e58 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:51.770958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df90981-e7a8-4812-ba0e-c3c4df266e58 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:51.772562 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 142/295] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:51.778704 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707e643-355f-49f4-bcc9-55eca9b2029b None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:51.779243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707e643-355f-49f4-bcc9-55eca9b2029b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:51.779243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707e643-355f-49f4-bcc9-55eca9b2029b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:51.801950 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-2707e643-355f-49f4-bcc9-55eca9b2029b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:51.803415 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2707e643-355f-49f4-bcc9-55eca9b2029b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:51.856653 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:51.900741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 154/296] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:51.914916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb8cf6-7ad5-4b9a-8719-c80f907bd500 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:51.915570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb8cf6-7ad5-4b9a-8719-c80f907bd500 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:51.915570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb8cf6-7ad5-4b9a-8719-c80f907bd500 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:51.916824 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 143/297] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:51.922502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8aa33-c0f4-4a9a-bae7-d8a13f5ecf3c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:51.922790 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8aa33-c0f4-4a9a-bae7-d8a13f5ecf3c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:51.923069 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8aa33-c0f4-4a9a-bae7-d8a13f5ecf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:51.927854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb8cf6-7ad5-4b9a-8719-c80f907bd500 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:51.947960 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-afb8aa33-c0f4-4a9a-bae7-d8a13f5ecf3c None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:51.949663 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-afb8aa33-c0f4-4a9a-bae7-d8a13f5ecf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:51.991280 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:52.041191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 155/298] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:52.041191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35669ac-3508-4132-aee1-9d971de51fe8 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:52.041191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35669ac-3508-4132-aee1-9d971de51fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:52.041661 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35669ac-3508-4132-aee1-9d971de51fe8 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:52.043057 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 156/299] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:52.050500 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f008e-0d04-4343-9aa2-3194ddd63ede None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:52.050894 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f008e-0d04-4343-9aa2-3194ddd63ede None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:52.051549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f008e-0d04-4343-9aa2-3194ddd63ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:52.055451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb8cf6-7ad5-4b9a-8719-c80f907bd500 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:52.069909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e44f008e-0d04-4343-9aa2-3194ddd63ede None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:52.071086 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e44f008e-0d04-4343-9aa2-3194ddd63ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:52.092559 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa644456-2cad-47c5-b2d1-0e18a301681d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:52.093324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa644456-2cad-47c5-b2d1-0e18a301681d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:52.093588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa644456-2cad-47c5-b2d1-0e18a301681d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:52.093784 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa644456-2cad-47c5-b2d1-0e18a301681d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:52.104769 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa644456-2cad-47c5-b2d1-0e18a301681d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:52.110324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-aa644456-2cad-47c5-b2d1-0e18a301681d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:52.110324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:52.110324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:52.110324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:52.110324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:52.110324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:52.110324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:52.110324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:52.110324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:52.110324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:52.110324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:52.110324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:52.110324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:52.110324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:52.110324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:52.110324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:52.111325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:52.111325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:52.111325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:52.111325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:52.111325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:52.111325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:52.111325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:52.111325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:52.111325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:52.111325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:52.111325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:52.111325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:52.111325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:52.111325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:52.111325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:52.111325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:52.112179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:52.112179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:52.112179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:52.112179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:52.112179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:52.112179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:52.112179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:52.112179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:52.112179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:52.112179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:52.112179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:52.112179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:52.112179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 144/300] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:41:52.112829 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa644456-2cad-47c5-b2d1-0e18a301681d None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:52.145419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 157/301] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:52.146546 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f008e-0d04-4343-9aa2-3194ddd63ede None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:52.176647 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:52.231662 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa644456-2cad-47c5-b2d1-0e18a301681d None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:52.242312 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:52.255284 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f008e-0d04-4343-9aa2-3194ddd63ede None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:52.268533 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b01081-0606-47ee-b306-77d9a1670785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:52.269235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b01081-0606-47ee-b306-77d9a1670785 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:52.269533 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b01081-0606-47ee-b306-77d9a1670785 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:52.269796 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b01081-0606-47ee-b306-77d9a1670785 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:52.282649 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b01081-0606-47ee-b306-77d9a1670785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:52.288911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-76b01081-0606-47ee-b306-77d9a1670785 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:41:52.288911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:52.288911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:52.288911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:52.288911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:52.288911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:52.288911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:52.288911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:52.288911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:52.288911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:52.288911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:52.288911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:52.288911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:52.288911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:52.288911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:52.288911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:52.289904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:52.289904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:52.289904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:52.289904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:52.289904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:52.289904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:52.289904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:52.289904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:52.289904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:52.289904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:52.289904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:52.289904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:52.289904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:52.289904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:52.289904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:52.289904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:52.290680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:52.290680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:52.290680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:52.290680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:52.290680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:52.290680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:52.290680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:52.290680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:52.290680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:52.290680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:52.290680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:41:52.290680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:52.290680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 145/302] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:52.291365 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b01081-0606-47ee-b306-77d9a1670785 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:52.304337 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105851d-d405-4980-a3df-cb6e43caf4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:52.304964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105851d-d405-4980-a3df-cb6e43caf4de None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:52.305271 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105851d-d405-4980-a3df-cb6e43caf4de None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:52.305542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105851d-d405-4980-a3df-cb6e43caf4de None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:52.306264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105851d-d405-4980-a3df-cb6e43caf4de None admin] RBAC: Adding query filter params (name=member) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:52.306867 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105851d-d405-4980-a3df-cb6e43caf4de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:52.307960 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105851d-d405-4980-a3df-cb6e43caf4de None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:52.322164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 158/303] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:52.322164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105851d-d405-4980-a3df-cb6e43caf4de None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:52.400950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b01081-0606-47ee-b306-77d9a1670785 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:52.421021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:52.429763 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105851d-d405-4980-a3df-cb6e43caf4de None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:52.437855 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b20aed-5cf0-4883-a035-adef84f02376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:52.438890 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b20aed-5cf0-4883-a035-adef84f02376 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:52.439174 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b20aed-5cf0-4883-a035-adef84f02376 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:52.439443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b20aed-5cf0-4883-a035-adef84f02376 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:52.440615 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b20aed-5cf0-4883-a035-adef84f02376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:52.442120 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b20aed-5cf0-4883-a035-adef84f02376 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:52.443882 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 146/304] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:41:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:52.444603 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b20aed-5cf0-4883-a035-adef84f02376 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:52.473423 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a556e9d-a139-43ae-86a7-28dd50659c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:52.474548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a556e9d-a139-43ae-86a7-28dd50659c16 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:52.475040 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a556e9d-a139-43ae-86a7-28dd50659c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:52.475492 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a556e9d-a139-43ae-86a7-28dd50659c16 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:52.476401 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a556e9d-a139-43ae-86a7-28dd50659c16 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:52.476876 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a556e9d-a139-43ae-86a7-28dd50659c16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:52.478457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a556e9d-a139-43ae-86a7-28dd50659c16 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:52.488786 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:52.489042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 159/305] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:52.494007 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a556e9d-a139-43ae-86a7-28dd50659c16 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:52.558992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b20aed-5cf0-4883-a035-adef84f02376 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:52.591951 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b87ced-09f3-469e-8641-0e73de43c22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:52.592598 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b87ced-09f3-469e-8641-0e73de43c22d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:52.592932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b87ced-09f3-469e-8641-0e73de43c22d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:52.593254 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b87ced-09f3-469e-8641-0e73de43c22d None admin] PATH_INFO: `/v3/users/aea112940235445399e3fb1d6ba3dd76` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:52.594422 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b87ced-09f3-469e-8641-0e73de43c22d None admin] RBAC: Authorizing `identity:get_user(user_id=aea112940235445399e3fb1d6ba3dd76)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:52.595944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b87ced-09f3-469e-8641-0e73de43c22d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:52.597858 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 147/306] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:52 2022] GET /identity/v3/users/aea112940235445399e3fb1d6ba3dd76 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:52.598505 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b87ced-09f3-469e-8641-0e73de43c22d None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:52.606009 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a556e9d-a139-43ae-86a7-28dd50659c16 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:52.643273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bac5e-13cf-4b73-a85f-244f7d848282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:52.643897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bac5e-13cf-4b73-a85f-244f7d848282 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:52.644269 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bac5e-13cf-4b73-a85f-244f7d848282 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:52.644560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bac5e-13cf-4b73-a85f-244f7d848282 None admin] PATH_INFO: `/v3/groups` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:52.645370 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bac5e-13cf-4b73-a85f-244f7d848282 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:52.647134 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bac5e-13cf-4b73-a85f-244f7d848282 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:52.666742 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 160/307] 10.222.0.96 () {60 vars in 1134 bytes} [Thu Jul 28 17:41:52 2022] POST /identity/v3/groups => generated 229 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:41:52.666742 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bac5e-13cf-4b73-a85f-244f7d848282 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:52.690075 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:52.721941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b87ced-09f3-469e-8641-0e73de43c22d None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:52.732388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:52.770068 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573e440-bb1a-46ec-bda5-ed543c422f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:52.771167 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573e440-bb1a-46ec-bda5-ed543c422f5b None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:52.771840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573e440-bb1a-46ec-bda5-ed543c422f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:52.772387 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573e440-bb1a-46ec-bda5-ed543c422f5b None admin] PATH_INFO: `/v3/users/78e5cece974c40f5aecf498dda349588` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:52.790031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573e440-bb1a-46ec-bda5-ed543c422f5b None admin] RBAC: Authorizing `identity:get_user(user_id=78e5cece974c40f5aecf498dda349588)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:52.791896 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573e440-bb1a-46ec-bda5-ed543c422f5b None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:52.793967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 148/308] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:52 2022] GET /identity/v3/users/78e5cece974c40f5aecf498dda349588 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:52.800198 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bac5e-13cf-4b73-a85f-244f7d848282 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:52.801019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573e440-bb1a-46ec-bda5-ed543c422f5b None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:52.842387 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab760b4-39c7-49db-80c5-999e0dc6cfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:52.842994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab760b4-39c7-49db-80c5-999e0dc6cfcc None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:52.843275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab760b4-39c7-49db-80c5-999e0dc6cfcc None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:52.843553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab760b4-39c7-49db-80c5-999e0dc6cfcc None admin] PATH_INFO: `/v3/system/users/aea112940235445399e3fb1d6ba3dd76/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:52.845101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab760b4-39c7-49db-80c5-999e0dc6cfcc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=aea112940235445399e3fb1d6ba3dd76, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:52.846712 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab760b4-39c7-49db-80c5-999e0dc6cfcc None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:52.857745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 161/309] 10.222.0.96 () {58 vars in 1334 bytes} [Thu Jul 28 17:41:52 2022] PUT /identity/v3/system/users/aea112940235445399e3fb1d6ba3dd76/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:41:52.925173 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573e440-bb1a-46ec-bda5-ed543c422f5b None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:52.927954 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c532717-ae7b-461c-b621-d56e31a33be7 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:52.928246 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c532717-ae7b-461c-b621-d56e31a33be7 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:52.928646 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c532717-ae7b-461c-b621-d56e31a33be7 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:52.930372 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 162/310] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:52.936090 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc210aed-d397-4531-a4fe-abf9950e651d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:52.936380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc210aed-d397-4531-a4fe-abf9950e651d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:52.936664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc210aed-d397-4531-a4fe-abf9950e651d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:52.957999 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-cc210aed-d397-4531-a4fe-abf9950e651d None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:52.959492 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-cc210aed-d397-4531-a4fe-abf9950e651d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:52.972226 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761cc55-3d65-4ca7-ac55-e62104abc272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:52.972919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761cc55-3d65-4ca7-ac55-e62104abc272 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:52.973232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761cc55-3d65-4ca7-ac55-e62104abc272 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:52.973859 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761cc55-3d65-4ca7-ac55-e62104abc272 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:52.975225 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4761cc55-3d65-4ca7-ac55-e62104abc272 None admin] RBAC: Adding query filter params (role.id=3e04c82538344690a5a6591b125b6b86, user.id=78e5cece974c40f5aecf498dda349588, scope.system=all) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:52.975540 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4761cc55-3d65-4ca7-ac55-e62104abc272 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:52.978790 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4761cc55-3d65-4ca7-ac55-e62104abc272 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:52.989252 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 149/311] 10.222.0.96 () {56 vars in 1308 bytes} [Thu Jul 28 17:41:52 2022] GET /identity/v3/role_assignments?user.id=78e5cece974c40f5aecf498dda349588&scope.system=all&role.id=3e04c82538344690a5a6591b125b6b86 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:53.052590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 163/312] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:41:53.076546 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761cc55-3d65-4ca7-ac55-e62104abc272 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:53.107999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:53.191667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761cc55-3d65-4ca7-ac55-e62104abc272 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:53.227334 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dae89e-4ab6-445e-9d0c-8819cb5b49af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:53.227980 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dae89e-4ab6-445e-9d0c-8819cb5b49af None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:53.228260 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dae89e-4ab6-445e-9d0c-8819cb5b49af None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:53.228535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dae89e-4ab6-445e-9d0c-8819cb5b49af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:53.239180 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dae89e-4ab6-445e-9d0c-8819cb5b49af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:53.244399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-f2dae89e-4ab6-445e-9d0c-8819cb5b49af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:41:53.244399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:53.244399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:53.244399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:53.244399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:53.244399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:53.244399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:53.244399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:53.244399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:53.244399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:53.244399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:53.244399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:53.244399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:53.244399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:53.244399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:53.244399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:53.245462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:53.245462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:53.245462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:53.245462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:53.245462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:53.245462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:53.245462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:53.245462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:53.245462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:53.245462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:53.245462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:53.245462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:53.245462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:53.245462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:53.245462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:53.245462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:53.246645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:53.246645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:53.246645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:53.246645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:53.246645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:53.246645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:53.246645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:53.246645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:53.246645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:53.246645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:53.246645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:41:53.246645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:53.246645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 150/313] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:53.251993 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc210aed-d397-4531-a4fe-abf9950e651d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:53.265874 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:53.360978 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc210aed-d397-4531-a4fe-abf9950e651d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:53.397622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd1485-eb19-4287-a4b6-7db1132415e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:53.398606 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd1485-eb19-4287-a4b6-7db1132415e7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:53.399123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd1485-eb19-4287-a4b6-7db1132415e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:53.399585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd1485-eb19-4287-a4b6-7db1132415e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:53.400486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd1485-eb19-4287-a4b6-7db1132415e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:53.400983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd1485-eb19-4287-a4b6-7db1132415e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:53.402595 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd1485-eb19-4287-a4b6-7db1132415e7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:53.411386 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 164/314] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:53.417342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dae89e-4ab6-445e-9d0c-8819cb5b49af None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:53.513767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:53.519649 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dae89e-4ab6-445e-9d0c-8819cb5b49af None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:53.555263 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e194717-aca1-4c12-9114-d0d018d5bae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:53.555910 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e194717-aca1-4c12-9114-d0d018d5bae9 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:53.556189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e194717-aca1-4c12-9114-d0d018d5bae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:53.556508 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e194717-aca1-4c12-9114-d0d018d5bae9 None admin] PATH_INFO: `/v3/users/2f7647590050417f931a25eb37cb13e9` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:53.557757 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e194717-aca1-4c12-9114-d0d018d5bae9 None admin] RBAC: Authorizing `identity:get_user(user_id=2f7647590050417f931a25eb37cb13e9)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:53.559220 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e194717-aca1-4c12-9114-d0d018d5bae9 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:53.561142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 151/315] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:53 2022] GET /identity/v3/users/2f7647590050417f931a25eb37cb13e9 => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:53.566815 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd1485-eb19-4287-a4b6-7db1132415e7 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:53.639037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:53.668537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd1485-eb19-4287-a4b6-7db1132415e7 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:53.703606 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e5ae4-9acb-4224-93a5-18ee1b4a7038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:53.704239 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e5ae4-9acb-4224-93a5-18ee1b4a7038 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:53.704516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e5ae4-9acb-4224-93a5-18ee1b4a7038 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:53.704791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e5ae4-9acb-4224-93a5-18ee1b4a7038 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:53.773779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e5ae4-9acb-4224-93a5-18ee1b4a7038 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:53.775232 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e5ae4-9acb-4224-93a5-18ee1b4a7038 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:53.843153 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:53.873990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 165/316] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:41:53.879683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e194717-aca1-4c12-9114-d0d018d5bae9 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:53.992440 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e194717-aca1-4c12-9114-d0d018d5bae9 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:54.028359 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529429a-158e-4a03-ba84-7be15df5f332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:54.029011 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529429a-158e-4a03-ba84-7be15df5f332 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:54.029320 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529429a-158e-4a03-ba84-7be15df5f332 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:54.029593 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529429a-158e-4a03-ba84-7be15df5f332 None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:54.037082 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529429a-158e-4a03-ba84-7be15df5f332 None admin] RBAC: Authorizing `identity:get_project(project_id=a9647712d7a24fe1831a2c16cfba2abb)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:54.037082 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529429a-158e-4a03-ba84-7be15df5f332 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:54.037082 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 152/317] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:53 2022] GET /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:54.040147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e5ae4-9acb-4224-93a5-18ee1b4a7038 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:54.152560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e5ae4-9acb-4224-93a5-18ee1b4a7038 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:54.186612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3daefd4-1519-4129-aa0a-8c41a5129857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:54.187243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daefd4-1519-4129-aa0a-8c41a5129857 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:54.187524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daefd4-1519-4129-aa0a-8c41a5129857 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:54.187802 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daefd4-1519-4129-aa0a-8c41a5129857 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:54.188580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3daefd4-1519-4129-aa0a-8c41a5129857 None admin] RBAC: Adding query filter params (role.id=3e04c82538344690a5a6591b125b6b86, scope.project.id=a9647712d7a24fe1831a2c16cfba2abb, user.id=2f7647590050417f931a25eb37cb13e9) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:54.188889 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3daefd4-1519-4129-aa0a-8c41a5129857 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:54.190427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3daefd4-1519-4129-aa0a-8c41a5129857 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:54.196702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 166/318] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:41:54 2022] GET /identity/v3/role_assignments?user.id=2f7647590050417f931a25eb37cb13e9&scope.project.id=a9647712d7a24fe1831a2c16cfba2abb&role.id=3e04c82538344690a5a6591b125b6b86 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:54.895880 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfd96a-fb72-4eb0-9baa-845c6b21d70f None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:54.896374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfd96a-fb72-4eb0-9baa-845c6b21d70f None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:54.896777 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfd96a-fb72-4eb0-9baa-845c6b21d70f None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:54.898370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 153/319] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:54.903747 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53f342-d805-40ae-bb02-5540668af5bb None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:54.904249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53f342-d805-40ae-bb02-5540668af5bb None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:54.904249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53f342-d805-40ae-bb02-5540668af5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:54.923324 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-ef53f342-d805-40ae-bb02-5540668af5bb None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:54.924513 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ef53f342-d805-40ae-bb02-5540668af5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:54.956587 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:54.962774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cc8c4-78ea-4fda-84a9-8d81c6537545 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:54.963057 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cc8c4-78ea-4fda-84a9-8d81c6537545 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:54.963354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cc8c4-78ea-4fda-84a9-8d81c6537545 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:54.964812 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 154/320] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:41:54.969611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21e62e-dac6-48df-9a10-9d42d4af03c2 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:54.969896 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21e62e-dac6-48df-9a10-9d42d4af03c2 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:54.970168 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21e62e-dac6-48df-9a10-9d42d4af03c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:54.989031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-cc21e62e-dac6-48df-9a10-9d42d4af03c2 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:54.990345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-cc21e62e-dac6-48df-9a10-9d42d4af03c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:55.002203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 167/321] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:55.008667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:55.029818 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53f342-d805-40ae-bb02-5540668af5bb None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:55.063993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 155/322] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:41:55.065242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b3fde-d559-4366-b79d-2514d78da3cb None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:55.065533 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b3fde-d559-4366-b79d-2514d78da3cb None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:55.065798 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b3fde-d559-4366-b79d-2514d78da3cb None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:55.067158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 156/323] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:55.074509 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b8cde-102e-4f7e-9ef8-6df36d2c502b None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:55.074789 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b8cde-102e-4f7e-9ef8-6df36d2c502b None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:55.075071 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b8cde-102e-4f7e-9ef8-6df36d2c502b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:55.093702 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-b09b8cde-102e-4f7e-9ef8-6df36d2c502b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:55.094943 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b09b8cde-102e-4f7e-9ef8-6df36d2c502b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:55.132811 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53f342-d805-40ae-bb02-5540668af5bb None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:55.162513 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 157/324] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:41:55.163267 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b8cde-102e-4f7e-9ef8-6df36d2c502b None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:55.177217 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320975a-a417-4502-b907-552c981ee0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:55.178386 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320975a-a417-4502-b907-552c981ee0ff None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:55.178665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320975a-a417-4502-b907-552c981ee0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:55.178937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320975a-a417-4502-b907-552c981ee0ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:55.180082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320975a-a417-4502-b907-552c981ee0ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:55.181630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320975a-a417-4502-b907-552c981ee0ff None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:55.187669 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 168/325] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:41:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:55.188522 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320975a-a417-4502-b907-552c981ee0ff None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:55.223222 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:55.244835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:55.260379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b8cde-102e-4f7e-9ef8-6df36d2c502b None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:55.289079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320975a-a417-4502-b907-552c981ee0ff None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:55.294240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c94faa-77a6-4a69-af98-ec9c4c2f8fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:55.294887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c94faa-77a6-4a69-af98-ec9c4c2f8fba None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:55.295165 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c94faa-77a6-4a69-af98-ec9c4c2f8fba None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:55.295436 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c94faa-77a6-4a69-af98-ec9c4c2f8fba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:55.306719 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c94faa-77a6-4a69-af98-ec9c4c2f8fba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:55.311656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-d0c94faa-77a6-4a69-af98-ec9c4c2f8fba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:55.311656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:55.311656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:55.311656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:55.311656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:55.311656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:55.311656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:55.311656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:55.311656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:55.311656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:55.311656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:55.311656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:55.311656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:55.311656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:55.311656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:55.311656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:55.312730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:55.312730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:55.312730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:55.312730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:55.312730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:55.312730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:55.312730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:55.312730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:55.312730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:55.312730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:55.312730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:55.312730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:55.312730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:55.312730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:55.312730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:55.312730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:55.313585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:55.313585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:55.313585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:55.313585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:55.313585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:55.313585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:55.313585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:55.313585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:55.313585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:55.313585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:55.313585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:55.313585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:55.313585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 158/326] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:55.313585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c94faa-77a6-4a69-af98-ec9c4c2f8fba None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:55.326915 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cc92c-8642-4af7-a9ec-9335763c02d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:55.327563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cc92c-8642-4af7-a9ec-9335763c02d7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:55.327841 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cc92c-8642-4af7-a9ec-9335763c02d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:55.328110 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cc92c-8642-4af7-a9ec-9335763c02d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:55.338034 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397cc92c-8642-4af7-a9ec-9335763c02d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:55.343024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-397cc92c-8642-4af7-a9ec-9335763c02d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:41:55.343024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:55.343024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:55.343024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:55.343024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:55.343024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:55.343024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:55.343024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:55.343024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:55.343024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:55.343024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:55.343024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:55.343024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:55.343024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:55.343024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:55.343024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:55.343956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:55.343956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:55.343956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:55.343956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:55.343956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:55.343956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:55.343956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:55.343956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:55.343956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:55.343956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:55.343956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:55.343956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:55.343956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:55.343956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:55.343956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:55.343956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:55.344745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:55.344745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:55.344745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:55.344745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:55.344745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:55.344745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:55.344745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:55.344745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:55.344745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:55.344745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:55.344745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:41:55.344745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:41:55.344745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 169/327] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:55.345425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cc92c-8642-4af7-a9ec-9335763c02d7 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:55.421360 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c94faa-77a6-4a69-af98-ec9c4c2f8fba None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:55.433778 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:55.440469 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cc92c-8642-4af7-a9ec-9335763c02d7 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:55.456000 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7941a8-bd9e-4b80-b87b-fe7bff676e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:55.456665 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7941a8-bd9e-4b80-b87b-fe7bff676e53 None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:55.456942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7941a8-bd9e-4b80-b87b-fe7bff676e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:55.457287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7941a8-bd9e-4b80-b87b-fe7bff676e53 None admin] PATH_INFO: `/v3/groups` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:55.457964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7941a8-bd9e-4b80-b87b-fe7bff676e53 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:55.459421 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7941a8-bd9e-4b80-b87b-fe7bff676e53 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:55.477356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 159/328] 10.222.0.96 () {60 vars in 1134 bytes} [Thu Jul 28 17:41:55 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:41:55.491737 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967d37e-1366-48c5-b927-17739825143f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:55.491737 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967d37e-1366-48c5-b927-17739825143f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:55.491974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7941a8-bd9e-4b80-b87b-fe7bff676e53 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:55.492060 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967d37e-1366-48c5-b927-17739825143f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:55.492060 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967d37e-1366-48c5-b927-17739825143f None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:55.492060 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967d37e-1366-48c5-b927-17739825143f None admin] RBAC: Adding query filter params (name=member) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:55.492060 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967d37e-1366-48c5-b927-17739825143f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:55.492060 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967d37e-1366-48c5-b927-17739825143f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:55.492408 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:55.502208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 170/329] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:55.508240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967d37e-1366-48c5-b927-17739825143f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:55.603031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7941a8-bd9e-4b80-b87b-fe7bff676e53 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:55.624682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967d37e-1366-48c5-b927-17739825143f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:55.644329 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2b1ad-d267-440d-a5ec-5cea82066330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:55.644969 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2b1ad-d267-440d-a5ec-5cea82066330 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:55.645294 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2b1ad-d267-440d-a5ec-5cea82066330 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:55.646287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2b1ad-d267-440d-a5ec-5cea82066330 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:55.646523 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2b1ad-d267-440d-a5ec-5cea82066330 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:55.646835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2b1ad-d267-440d-a5ec-5cea82066330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:55.648242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2b1ad-d267-440d-a5ec-5cea82066330 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:55.658096 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 160/330] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:55.663913 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2b1ad-d267-440d-a5ec-5cea82066330 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:55.670250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cb048-43ca-45b2-863a-a269b049b485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:55.670919 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cb048-43ca-45b2-863a-a269b049b485 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:55.671205 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cb048-43ca-45b2-863a-a269b049b485 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:55.671540 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cb048-43ca-45b2-863a-a269b049b485 None admin] PATH_INFO: `/v3/users/aea112940235445399e3fb1d6ba3dd76` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:55.672726 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cb048-43ca-45b2-863a-a269b049b485 None admin] RBAC: Authorizing `identity:get_user(user_id=aea112940235445399e3fb1d6ba3dd76)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:55.674288 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cb048-43ca-45b2-863a-a269b049b485 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:55.676555 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 171/331] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:55 2022] GET /identity/v3/users/aea112940235445399e3fb1d6ba3dd76 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:55.683737 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cb048-43ca-45b2-863a-a269b049b485 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:55.713860 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:55.754912 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:55.794714 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2b1ad-d267-440d-a5ec-5cea82066330 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:55.805840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cb048-43ca-45b2-863a-a269b049b485 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:55.833639 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23957b-1f48-4315-ba2b-0f936b1e56aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:55.834702 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23957b-1f48-4315-ba2b-0f936b1e56aa None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:55.835179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23957b-1f48-4315-ba2b-0f936b1e56aa None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:55.835627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23957b-1f48-4315-ba2b-0f936b1e56aa None admin] PATH_INFO: `/v3/users/78e5cece974c40f5aecf498dda349588` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:55.837035 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23957b-1f48-4315-ba2b-0f936b1e56aa None admin] RBAC: Authorizing `identity:get_user(user_id=78e5cece974c40f5aecf498dda349588)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:55.838679 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23957b-1f48-4315-ba2b-0f936b1e56aa None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:55.841111 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 161/332] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:41:55 2022] GET /identity/v3/users/78e5cece974c40f5aecf498dda349588 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:41:55.846115 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23957b-1f48-4315-ba2b-0f936b1e56aa None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:55.849005 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ff48b-768b-439b-becc-95cc5dc6a532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:55.850077 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ff48b-768b-439b-becc-95cc5dc6a532 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:55.850357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ff48b-768b-439b-becc-95cc5dc6a532 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:55.850627 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ff48b-768b-439b-becc-95cc5dc6a532 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:55.851425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ff48b-768b-439b-becc-95cc5dc6a532 None admin] RBAC: Adding query filter params (role.id=1e9bc5b431414d62a974beb13a8f83c7, user.id=aea112940235445399e3fb1d6ba3dd76, scope.system=all) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:55.851731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ff48b-768b-439b-becc-95cc5dc6a532 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:55.855453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ff48b-768b-439b-becc-95cc5dc6a532 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:55.867433 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 172/333] 10.222.0.96 () {56 vars in 1308 bytes} [Thu Jul 28 17:41:55 2022] GET /identity/v3/role_assignments?user.id=aea112940235445399e3fb1d6ba3dd76&scope.system=all&role.id=1e9bc5b431414d62a974beb13a8f83c7 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:55.968908 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23957b-1f48-4315-ba2b-0f936b1e56aa None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:56.010075 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944df76-56ce-4e0e-8828-f14f3a869c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:56.010864 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944df76-56ce-4e0e-8828-f14f3a869c39 None admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:56.011102 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944df76-56ce-4e0e-8828-f14f3a869c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:56.011379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944df76-56ce-4e0e-8828-f14f3a869c39 None admin] PATH_INFO: `/v3/system/users/78e5cece974c40f5aecf498dda349588/roles/3e04c82538344690a5a6591b125b6b86` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:56.012896 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944df76-56ce-4e0e-8828-f14f3a869c39 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=78e5cece974c40f5aecf498dda349588, role_id=3e04c82538344690a5a6591b125b6b86)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:56.014694 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944df76-56ce-4e0e-8828-f14f3a869c39 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:56.016744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:56.028353 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 162/334] 10.222.0.96 () {58 vars in 1334 bytes} [Thu Jul 28 17:41:55 2022] PUT /identity/v3/system/users/78e5cece974c40f5aecf498dda349588/roles/3e04c82538344690a5a6591b125b6b86 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:41:58.020619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc56f58-d19f-4e07-b2f1-9e9e37fac7fd None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:58.020997 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc56f58-d19f-4e07-b2f1-9e9e37fac7fd None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:58.021385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc56f58-d19f-4e07-b2f1-9e9e37fac7fd None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:58.025660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 173/335] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:58.028725 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6782ed-fd74-410e-8780-cef8b25acc78 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:58.029165 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6782ed-fd74-410e-8780-cef8b25acc78 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:58.029382 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6782ed-fd74-410e-8780-cef8b25acc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:58.054279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24854ae5-6903-4d75-a479-16e9808e7caa None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:58.054638 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-ea6782ed-fd74-410e-8780-cef8b25acc78 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:58.055034 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24854ae5-6903-4d75-a479-16e9808e7caa None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:58.055478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24854ae5-6903-4d75-a479-16e9808e7caa None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:58.055849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ea6782ed-fd74-410e-8780-cef8b25acc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:58.057562 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 174/336] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:58.072442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569650f-ba8d-41a1-9946-ecf5d9c6fc36 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:58.072994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569650f-ba8d-41a1-9946-ecf5d9c6fc36 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:58.073472 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569650f-ba8d-41a1-9946-ecf5d9c6fc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:58.102766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7569650f-ba8d-41a1-9946-ecf5d9c6fc36 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:58.104295 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7569650f-ba8d-41a1-9946-ecf5d9c6fc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:58.191720 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 163/337] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:58.200231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 175/338] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:41:58.218108 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6782ed-fd74-410e-8780-cef8b25acc78 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:58.238789 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569650f-ba8d-41a1-9946-ecf5d9c6fc36 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:58.258356 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:58.409182 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569650f-ba8d-41a1-9946-ecf5d9c6fc36 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:58.427862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6782ed-fd74-410e-8780-cef8b25acc78 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:58.460011 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c195e-6b6a-47a9-989e-b25fed8386eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:58.460680 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c195e-6b6a-47a9-989e-b25fed8386eb None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:58.460956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c195e-6b6a-47a9-989e-b25fed8386eb None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:58.461249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c195e-6b6a-47a9-989e-b25fed8386eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:58.471466 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:58.479471 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c195e-6b6a-47a9-989e-b25fed8386eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:58.484528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-6b4c195e-6b6a-47a9-989e-b25fed8386eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:58.484528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:58.484528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:58.484528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:58.484528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:58.484528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:58.484528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:58.484528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:58.484528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:58.484528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:58.484528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:58.484528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:58.484528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:58.484528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:58.484528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:58.484528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:58.485982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:58.485982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:58.485982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:58.485982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:58.485982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:58.485982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:58.485982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:58.485982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:58.485982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:58.485982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:58.485982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:58.485982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:58.485982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:58.485982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:58.485982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:58.485982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:58.486836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:58.486836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:58.486836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:58.486836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:58.486836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:58.486836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:58.486836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:58.486836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:58.486836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:58.486836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:58.486836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:58.486836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:41:58.486836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 176/339] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:41:58.486836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6f2ce-6910-4c32-b5fa-0f90bb9665ff None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:58.487538 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6f2ce-6910-4c32-b5fa-0f90bb9665ff None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:58.487538 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6f2ce-6910-4c32-b5fa-0f90bb9665ff None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:58.488772 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 177/340] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:58.494358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50535c82-094d-402b-ae07-4662d80f4829 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:58.494639 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50535c82-094d-402b-ae07-4662d80f4829 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:58.494913 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50535c82-094d-402b-ae07-4662d80f4829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:58.498428 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67741bc0-1ae6-4fbc-b1c7-59776a4cf4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:58.499340 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67741bc0-1ae6-4fbc-b1c7-59776a4cf4aa None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:58.499860 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67741bc0-1ae6-4fbc-b1c7-59776a4cf4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:58.500330 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67741bc0-1ae6-4fbc-b1c7-59776a4cf4aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:58.515898 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-50535c82-094d-402b-ae07-4662d80f4829 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:58.517126 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-50535c82-094d-402b-ae07-4662d80f4829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:58.529469 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67741bc0-1ae6-4fbc-b1c7-59776a4cf4aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:58.534447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-67741bc0-1ae6-4fbc-b1c7-59776a4cf4aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:41:58.534447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:58.534447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:58.534447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:58.534447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:58.534447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:58.534447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:58.534447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:58.534447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:58.534447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:58.534447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:58.534447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:58.534447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:58.534447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:58.534447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:58.534447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:58.535310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:58.535310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:58.535310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:58.535310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:58.535310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:58.535310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:58.535310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:58.535310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:58.535310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:58.535310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:58.535310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:58.535310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:58.535310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:58.535310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:58.535310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:58.535310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:58.536092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:58.536092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:58.536092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:58.536092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:58.536092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:58.536092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:58.536092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:58.536092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:58.536092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:58.536092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:58.536092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:41:58.536092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:41:58.536092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 164/341] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:41:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:58.536875 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67741bc0-1ae6-4fbc-b1c7-59776a4cf4aa None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:58.620242 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 178/342] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:58.621262 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50535c82-094d-402b-ae07-4662d80f4829 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:58.630160 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:58.753806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50535c82-094d-402b-ae07-4662d80f4829 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:58.792681 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ecd65-697c-45ea-a83a-08ca1fe202e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:58.793350 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ecd65-697c-45ea-a83a-08ca1fe202e1 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:58.793637 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ecd65-697c-45ea-a83a-08ca1fe202e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:58.793910 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ecd65-697c-45ea-a83a-08ca1fe202e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:58.794628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ecd65-697c-45ea-a83a-08ca1fe202e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:58.794934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ecd65-697c-45ea-a83a-08ca1fe202e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:58.796324 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ecd65-697c-45ea-a83a-08ca1fe202e1 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:58.805344 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 179/343] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:41:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:58.806206 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ecd65-697c-45ea-a83a-08ca1fe202e1 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:58.831476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67741bc0-1ae6-4fbc-b1c7-59776a4cf4aa None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:58.882924 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cad012-d31e-43da-84f5-b88836359d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:58.883575 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cad012-d31e-43da-84f5-b88836359d23 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:58.883856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cad012-d31e-43da-84f5-b88836359d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:58.884133 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cad012-d31e-43da-84f5-b88836359d23 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:58.884868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cad012-d31e-43da-84f5-b88836359d23 None admin] RBAC: Adding query filter params (name=member) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:58.885203 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cad012-d31e-43da-84f5-b88836359d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:58.886680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cad012-d31e-43da-84f5-b88836359d23 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:58.898817 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:58.906364 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 165/344] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:58.907382 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cad012-d31e-43da-84f5-b88836359d23 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:58.935221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ecd65-697c-45ea-a83a-08ca1fe202e1 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:58.971589 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b9c86-1a08-421a-bcd1-22c0fb8b2826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:58.972332 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b9c86-1a08-421a-bcd1-22c0fb8b2826 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:58.972584 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b9c86-1a08-421a-bcd1-22c0fb8b2826 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:58.972857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b9c86-1a08-421a-bcd1-22c0fb8b2826 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:58.992795 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b9c86-1a08-421a-bcd1-22c0fb8b2826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:41:59.000181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-f15b9c86-1a08-421a-bcd1-22c0fb8b2826 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:59.000181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:41:59.000181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:41:59.000181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:41:59.000181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:41:59.000181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:41:59.000181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:41:59.000181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:41:59.000181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:41:59.000181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:41:59.000181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:41:59.000181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:41:59.000181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:41:59.000181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:41:59.000181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:41:59.000181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:41:59.001159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:41:59.001159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:41:59.001159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:41:59.001159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:41:59.001159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:41:59.001159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:41:59.001159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:41:59.001159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:41:59.001159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:41:59.001159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:41:59.001159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:41:59.001159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:41:59.001159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:41:59.001159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:41:59.001159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:41:59.001159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:41:59.001970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:41:59.001970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:41:59.001970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:41:59.001970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:41:59.001970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:41:59.001970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:41:59.001970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:41:59.001970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:41:59.001970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:41:59.001970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:41:59.001970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:41:59.001970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:41:59.001970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 180/345] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:41:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:41:59.002627 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b9c86-1a08-421a-bcd1-22c0fb8b2826 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:59.040423 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:59.134177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b9c86-1a08-421a-bcd1-22c0fb8b2826 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:59.135242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cad012-d31e-43da-84f5-b88836359d23 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:59.165499 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:59.177419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e12fc-2301-47d1-ba09-e4d07a61b003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:59.178030 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d1a5c-01d6-48b2-a289-7a8cd9b8d132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:59.178706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d1a5c-01d6-48b2-a289-7a8cd9b8d132 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:59.178808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e12fc-2301-47d1-ba09-e4d07a61b003 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:59.179011 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d1a5c-01d6-48b2-a289-7a8cd9b8d132 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:59.179113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e12fc-2301-47d1-ba09-e4d07a61b003 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:59.179246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d1a5c-01d6-48b2-a289-7a8cd9b8d132 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:59.179332 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e12fc-2301-47d1-ba09-e4d07a61b003 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:59.259939 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e12fc-2301-47d1-ba09-e4d07a61b003 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:59.262207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e12fc-2301-47d1-ba09-e4d07a61b003 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:59.264063 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d1a5c-01d6-48b2-a289-7a8cd9b8d132 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:59.265583 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d1a5c-01d6-48b2-a289-7a8cd9b8d132 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:59.325576 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:59.381189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 166/346] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:41:59.382364 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d1a5c-01d6-48b2-a289-7a8cd9b8d132 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:59.387758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 181/347] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:41:59.389644 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f0b67-17bf-401d-9e74-bca78c927c23 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:59.389931 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f0b67-17bf-401d-9e74-bca78c927c23 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:59.390203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f0b67-17bf-401d-9e74-bca78c927c23 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:59.392280 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 182/348] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:59.398379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f0b67-17bf-401d-9e74-bca78c927c23 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:59.434315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:59.524531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d1a5c-01d6-48b2-a289-7a8cd9b8d132 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:59.536732 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f0b67-17bf-401d-9e74-bca78c927c23 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:59.571739 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c54d7b-b603-4427-99a4-e21a30d807e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:59.572778 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c54d7b-b603-4427-99a4-e21a30d807e9 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:59.573353 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c54d7b-b603-4427-99a4-e21a30d807e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:59.573830 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c54d7b-b603-4427-99a4-e21a30d807e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:59.574793 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c54d7b-b603-4427-99a4-e21a30d807e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:41:59.575314 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c54d7b-b603-4427-99a4-e21a30d807e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:59.577042 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c54d7b-b603-4427-99a4-e21a30d807e9 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:59.583376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18fae9-6944-41df-93b8-4dc6aebbab77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:59.584102 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18fae9-6944-41df-93b8-4dc6aebbab77 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:59.584376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18fae9-6944-41df-93b8-4dc6aebbab77 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:59.584643 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18fae9-6944-41df-93b8-4dc6aebbab77 None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:59.586259 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18fae9-6944-41df-93b8-4dc6aebbab77 None admin] RBAC: Authorizing `identity:get_project(project_id=963ff5e1d9f74853b35cd0babec573b9)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:59.587751 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18fae9-6944-41df-93b8-4dc6aebbab77 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:59.588611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 167/349] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:41:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:59.593450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c54d7b-b603-4427-99a4-e21a30d807e9 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:59.593580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 183/350] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:59 2022] GET /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:59.593580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6bfba-c871-4c25-8a59-4a23a93cd09d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:59.593580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6bfba-c871-4c25-8a59-4a23a93cd09d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:59.593580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6bfba-c871-4c25-8a59-4a23a93cd09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:59.611755 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-def6bfba-c871-4c25-8a59-4a23a93cd09d None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:41:59.613412 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-def6bfba-c871-4c25-8a59-4a23a93cd09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:41:59.620281 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:59.698460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 184/351] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:41:59.699731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e4211-d281-4325-8ac7-f7cf8ab1fe57 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:59.701100 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e4211-d281-4325-8ac7-f7cf8ab1fe57 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:59.701100 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e4211-d281-4325-8ac7-f7cf8ab1fe57 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:59.701675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 185/352] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:41:59.702215 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e4211-d281-4325-8ac7-f7cf8ab1fe57 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:59.731908 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:59.738178 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c54d7b-b603-4427-99a4-e21a30d807e9 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:59.782695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1a84e-c48c-4897-a7df-76bc318354e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:59.783358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1a84e-c48c-4897-a7df-76bc318354e3 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:59.783642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1a84e-c48c-4897-a7df-76bc318354e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:59.783920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1a84e-c48c-4897-a7df-76bc318354e3 None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:59.785368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1a84e-c48c-4897-a7df-76bc318354e3 None admin] RBAC: Authorizing `identity:get_project(project_id=963ff5e1d9f74853b35cd0babec573b9)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:59.787904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1a84e-c48c-4897-a7df-76bc318354e3 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:59.790793 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 168/353] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:41:59 2022] GET /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:41:59.790917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1a84e-c48c-4897-a7df-76bc318354e3 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:41:59.840218 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e4211-d281-4325-8ac7-f7cf8ab1fe57 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:59.891365 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96bbc6-4081-44f5-baa6-280c2f97aa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:59.891886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96bbc6-4081-44f5-baa6-280c2f97aa08 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:59.892160 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96bbc6-4081-44f5-baa6-280c2f97aa08 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:59.892425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96bbc6-4081-44f5-baa6-280c2f97aa08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:59.905519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:41:59.934026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1a84e-c48c-4897-a7df-76bc318354e3 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:41:59.980988 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba771930-c464-4407-92b0-9fbdb22bf3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:41:59.982343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba771930-c464-4407-92b0-9fbdb22bf3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:41:59.982343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba771930-c464-4407-92b0-9fbdb22bf3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:41:59.982343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba771930-c464-4407-92b0-9fbdb22bf3d3 None admin] PATH_INFO: `/v3/groups/627a8ca342ea408195b547e766c93a98` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:41:59.983978 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96bbc6-4081-44f5-baa6-280c2f97aa08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:59.985501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96bbc6-4081-44f5-baa6-280c2f97aa08 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:59.991103 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba771930-c464-4407-92b0-9fbdb22bf3d3 None admin] RBAC: Authorizing `identity:get_group(group_id=627a8ca342ea408195b547e766c93a98)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:41:59.992582 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba771930-c464-4407-92b0-9fbdb22bf3d3 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:41:59.999214 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 169/354] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Jul 28 17:41:59 2022] GET /identity/v3/groups/627a8ca342ea408195b547e766c93a98 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:00.000572 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102810b-a62b-4502-9094-f768f64d363c None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:00.000857 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102810b-a62b-4502-9094-f768f64d363c None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:00.001148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102810b-a62b-4502-9094-f768f64d363c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:00.012546 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:00.031153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-1102810b-a62b-4502-9094-f768f64d363c None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:00.032990 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1102810b-a62b-4502-9094-f768f64d363c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:00.123634 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 170/355] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:00.124353 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102810b-a62b-4502-9094-f768f64d363c None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:00.127983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 186/356] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:41:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:42:00.129148 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96bbc6-4081-44f5-baa6-280c2f97aa08 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:00.215746 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:00.242753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102810b-a62b-4502-9094-f768f64d363c None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:00.253529 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96bbc6-4081-44f5-baa6-280c2f97aa08 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:00.281105 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:00.286492 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed16f73-db6e-48d2-a63a-f419f62f8727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:00.287227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed16f73-db6e-48d2-a63a-f419f62f8727 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:00.287517 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed16f73-db6e-48d2-a63a-f419f62f8727 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:00.287796 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed16f73-db6e-48d2-a63a-f419f62f8727 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:00.297406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407957ee-f264-4ed7-9ad4-881e11c05cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:00.299222 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407957ee-f264-4ed7-9ad4-881e11c05cff None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:00.299222 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407957ee-f264-4ed7-9ad4-881e11c05cff None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:00.299222 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407957ee-f264-4ed7-9ad4-881e11c05cff None admin] PATH_INFO: `/v3/groups/627a8ca342ea408195b547e766c93a98` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:00.300008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407957ee-f264-4ed7-9ad4-881e11c05cff None admin] RBAC: Authorizing `identity:get_group(group_id=627a8ca342ea408195b547e766c93a98)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:00.303113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407957ee-f264-4ed7-9ad4-881e11c05cff None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:00.303242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed16f73-db6e-48d2-a63a-f419f62f8727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:00.306887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-eed16f73-db6e-48d2-a63a-f419f62f8727 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:42:00.306887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:00.306887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:00.306887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:00.306887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:00.306887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:00.306887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:00.306887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:00.306887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:00.306887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:00.306887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:00.306887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:00.306887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:00.306887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:00.306887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:00.306887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:00.307826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:00.307826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:00.307826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:00.307826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:00.307826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:00.307826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:00.307826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:00.307826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:00.307826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:00.307826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:00.307826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:00.307826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:00.307826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:00.307826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:00.307826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:00.307826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:00.308654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:00.308654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:00.308654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:00.308654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:00.308654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:00.308654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:00.308654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:00.308654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:00.308654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:00.308654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:00.308654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:42:00.308654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:00.308654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 171/358] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:42:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:00.309402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 187/358] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Jul 28 17:42:00 2022] GET /identity/v3/groups/627a8ca342ea408195b547e766c93a98 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:00.309472 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed16f73-db6e-48d2-a63a-f419f62f8727 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:00.310081 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d31ba2-ba63-4b2a-b24f-9fb4431dd9ee None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:00.310188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d31ba2-ba63-4b2a-b24f-9fb4431dd9ee None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:00.310480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d31ba2-ba63-4b2a-b24f-9fb4431dd9ee None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:00.311820 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 188/359] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:00.315212 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d31ba2-ba63-4b2a-b24f-9fb4431dd9ee None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:00.438250 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed16f73-db6e-48d2-a63a-f419f62f8727 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:00.446167 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d31ba2-ba63-4b2a-b24f-9fb4431dd9ee None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:00.489204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107407a-7aa4-47d7-82da-1289122aa3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:00.490036 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107407a-7aa4-47d7-82da-1289122aa3ff None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:00.490164 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107407a-7aa4-47d7-82da-1289122aa3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:00.490952 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107407a-7aa4-47d7-82da-1289122aa3ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:00.494360 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107407a-7aa4-47d7-82da-1289122aa3ff None admin] RBAC: Adding query filter params (group.id=627a8ca342ea408195b547e766c93a98, role.id=5b95c3aebc8041c7885a9234a9e54d7c, scope.project.id=963ff5e1d9f74853b35cd0babec573b9) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:00.494501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cdc34-5549-462c-82ad-8fca5692071c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:00.494608 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107407a-7aa4-47d7-82da-1289122aa3ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:00.494681 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cdc34-5549-462c-82ad-8fca5692071c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:00.494681 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cdc34-5549-462c-82ad-8fca5692071c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:00.494681 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cdc34-5549-462c-82ad-8fca5692071c None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:00.494884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107407a-7aa4-47d7-82da-1289122aa3ff None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:00.494956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cdc34-5549-462c-82ad-8fca5692071c None admin] RBAC: Authorizing `identity:get_project(project_id=a9647712d7a24fe1831a2c16cfba2abb)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:00.496203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cdc34-5549-462c-82ad-8fca5692071c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:00.496634 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:00.498433 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 189/360] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:42:00 2022] GET /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:00.499570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cdc34-5549-462c-82ad-8fca5692071c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:00.507434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 172/361] 10.222.0.96 () {56 vars in 1376 bytes} [Thu Jul 28 17:42:00 2022] GET /identity/v3/role_assignments?group.id=627a8ca342ea408195b547e766c93a98&scope.project.id=963ff5e1d9f74853b35cd0babec573b9&role.id=5b95c3aebc8041c7885a9234a9e54d7c => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:00.508287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107407a-7aa4-47d7-82da-1289122aa3ff None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:00.585470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:00.647927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cdc34-5549-462c-82ad-8fca5692071c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:00.661941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107407a-7aa4-47d7-82da-1289122aa3ff None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:00.693445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185403af-0e32-4950-8a0b-d39c2a8994df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:00.694518 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185403af-0e32-4950-8a0b-d39c2a8994df None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:00.694869 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185403af-0e32-4950-8a0b-d39c2a8994df None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:00.695361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185403af-0e32-4950-8a0b-d39c2a8994df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:00.704168 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ad572-21df-4d67-9ddf-ab83e70cd27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:00.704789 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ad572-21df-4d67-9ddf-ab83e70cd27d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:00.705098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ad572-21df-4d67-9ddf-ab83e70cd27d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:00.705377 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ad572-21df-4d67-9ddf-ab83e70cd27d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:00.706183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ad572-21df-4d67-9ddf-ab83e70cd27d None admin] RBAC: Adding query filter params (group.id=627a8ca342ea408195b547e766c93a98, role.id=1e9bc5b431414d62a974beb13a8f83c7, scope.project.id=963ff5e1d9f74853b35cd0babec573b9) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:00.706498 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ad572-21df-4d67-9ddf-ab83e70cd27d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:00.707567 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185403af-0e32-4950-8a0b-d39c2a8994df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:00.707944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ad572-21df-4d67-9ddf-ab83e70cd27d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:00.712602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-185403af-0e32-4950-8a0b-d39c2a8994df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:42:00.712602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:00.712602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:00.712602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:00.712602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:00.712602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:00.712602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:00.712602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:00.712602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:00.712602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:00.712602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:00.712602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:00.712602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:00.712602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:00.712602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:00.712602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:00.713502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:00.713502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:00.713502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:00.713502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:00.713502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:00.713502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:00.713502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:00.713502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:00.713502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:00.713502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:00.713502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:00.713502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:00.713502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:00.713502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:00.713502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:00.713502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:00.714291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:00.714291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:00.714291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:00.714291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:00.714291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:00.714291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:00.714291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:00.714291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:00.714291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:00.714291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:00.714291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:42:00.714291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:00.714291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 190/362] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:42:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:00.714975 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185403af-0e32-4950-8a0b-d39c2a8994df None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:00.720644 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 173/363] 10.222.0.96 () {56 vars in 1376 bytes} [Thu Jul 28 17:42:00 2022] GET /identity/v3/role_assignments?group.id=627a8ca342ea408195b547e766c93a98&scope.project.id=963ff5e1d9f74853b35cd0babec573b9&role.id=1e9bc5b431414d62a974beb13a8f83c7 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:00.722244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ef2f4-3e4c-4641-9538-c6b154248aa9 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:00.722534 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ef2f4-3e4c-4641-9538-c6b154248aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:00.722816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ef2f4-3e4c-4641-9538-c6b154248aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:00.743990 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-ec0ef2f4-3e4c-4641-9538-c6b154248aa9 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:00.745271 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ec0ef2f4-3e4c-4641-9538-c6b154248aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:00.831429 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:00.847276 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 174/364] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:00.848885 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ef2f4-3e4c-4641-9538-c6b154248aa9 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:00.857579 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185403af-0e32-4950-8a0b-d39c2a8994df None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:00.885530 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:00.910597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef4bc9-c3ee-4397-90f7-391040f0157b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:00.911872 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef4bc9-c3ee-4397-90f7-391040f0157b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:00.913021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef4bc9-c3ee-4397-90f7-391040f0157b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:00.913692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef4bc9-c3ee-4397-90f7-391040f0157b None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:00.914623 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef4bc9-c3ee-4397-90f7-391040f0157b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:00.915156 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef4bc9-c3ee-4397-90f7-391040f0157b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:00.917180 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef4bc9-c3ee-4397-90f7-391040f0157b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:00.931803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 191/365] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:42:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:00.932678 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef4bc9-c3ee-4397-90f7-391040f0157b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:00.974732 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ef2f4-3e4c-4641-9538-c6b154248aa9 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:01.016408 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706801a5-df3c-4eb2-b8d9-c233408acfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:01.017463 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706801a5-df3c-4eb2-b8d9-c233408acfb8 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:01.017961 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706801a5-df3c-4eb2-b8d9-c233408acfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:01.018441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706801a5-df3c-4eb2-b8d9-c233408acfb8 None admin] PATH_INFO: `/v3/groups/627a8ca342ea408195b547e766c93a98` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:01.019915 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706801a5-df3c-4eb2-b8d9-c233408acfb8 None admin] RBAC: Authorizing `identity:get_group(group_id=627a8ca342ea408195b547e766c93a98)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:01.021749 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706801a5-df3c-4eb2-b8d9-c233408acfb8 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:01.027122 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 175/366] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Jul 28 17:42:00 2022] GET /identity/v3/groups/627a8ca342ea408195b547e766c93a98 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:01.027122 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706801a5-df3c-4eb2-b8d9-c233408acfb8 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:01.064908 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef4bc9-c3ee-4397-90f7-391040f0157b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:01.106740 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:01.111513 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25c4c5-b5e2-4818-9147-0a99a68e8f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:01.112176 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25c4c5-b5e2-4818-9147-0a99a68e8f97 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:01.112457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25c4c5-b5e2-4818-9147-0a99a68e8f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:01.112732 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25c4c5-b5e2-4818-9147-0a99a68e8f97 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:01.113501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f25c4c5-b5e2-4818-9147-0a99a68e8f97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:01.113807 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f25c4c5-b5e2-4818-9147-0a99a68e8f97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:01.115326 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f25c4c5-b5e2-4818-9147-0a99a68e8f97 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:01.127503 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 192/367] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:01.128479 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25c4c5-b5e2-4818-9147-0a99a68e8f97 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:01.160688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706801a5-df3c-4eb2-b8d9-c233408acfb8 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:01.178360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:01.207722 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982be97-af57-4c55-bc57-3f4aab4b790a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:01.208375 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982be97-af57-4c55-bc57-3f4aab4b790a None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:01.208715 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982be97-af57-4c55-bc57-3f4aab4b790a None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:01.210060 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982be97-af57-4c55-bc57-3f4aab4b790a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:01.223520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982be97-af57-4c55-bc57-3f4aab4b790a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:01.230589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-e982be97-af57-4c55-bc57-3f4aab4b790a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:42:01.230589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:01.230589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:01.230589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:01.230589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:01.230589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:01.230589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:01.230589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:01.230589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:01.230589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:01.230589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:01.230589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:01.230589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:01.230589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:01.230589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:01.230589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:01.231979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:01.231979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:01.231979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:01.231979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:01.231979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:01.231979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:01.231979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:01.231979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:01.231979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:01.231979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:01.231979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:01.231979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:01.231979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:01.231979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:01.231979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:01.231979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:01.233934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:01.233934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:01.233934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:01.233934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:01.233934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:01.233934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:01.233934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:01.233934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:01.233934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:01.233934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:01.233934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:42:01.233934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:01.233934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 176/368] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:42:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:01.233934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982be97-af57-4c55-bc57-3f4aab4b790a None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:01.244690 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25c4c5-b5e2-4818-9147-0a99a68e8f97 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:01.284522 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde741d-beb2-4cfa-9430-87082179f4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:01.285362 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde741d-beb2-4cfa-9430-87082179f4da None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:01.285713 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde741d-beb2-4cfa-9430-87082179f4da None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:01.286051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde741d-beb2-4cfa-9430-87082179f4da None admin] PATH_INFO: `/v3/users/78e5cece974c40f5aecf498dda349588` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:01.288168 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde741d-beb2-4cfa-9430-87082179f4da None admin] RBAC: Authorizing `identity:get_user(user_id=78e5cece974c40f5aecf498dda349588)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:01.289689 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde741d-beb2-4cfa-9430-87082179f4da None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:01.292546 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 193/369] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:42:01 2022] GET /identity/v3/users/78e5cece974c40f5aecf498dda349588 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:01.293379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde741d-beb2-4cfa-9430-87082179f4da None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:01.357785 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982be97-af57-4c55-bc57-3f4aab4b790a None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:01.379261 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:01.397235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e129de-eab0-4e0f-9f85-869567dc2c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:01.397879 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e129de-eab0-4e0f-9f85-869567dc2c0f None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:01.398157 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e129de-eab0-4e0f-9f85-869567dc2c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:01.398440 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e129de-eab0-4e0f-9f85-869567dc2c0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:01.399254 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e129de-eab0-4e0f-9f85-869567dc2c0f None admin] RBAC: Adding query filter params (group.id=627a8ca342ea408195b547e766c93a98, role.id=1e9bc5b431414d62a974beb13a8f83c7, scope.project.id=a9647712d7a24fe1831a2c16cfba2abb) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:01.399568 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e129de-eab0-4e0f-9f85-869567dc2c0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:01.401866 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e129de-eab0-4e0f-9f85-869567dc2c0f None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:01.409089 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 177/370] 10.222.0.96 () {56 vars in 1376 bytes} [Thu Jul 28 17:42:01 2022] GET /identity/v3/role_assignments?group.id=627a8ca342ea408195b547e766c93a98&scope.project.id=a9647712d7a24fe1831a2c16cfba2abb&role.id=1e9bc5b431414d62a974beb13a8f83c7 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:01.409927 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e129de-eab0-4e0f-9f85-869567dc2c0f None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:01.456186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde741d-beb2-4cfa-9430-87082179f4da None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:01.475080 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:01.532461 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c54220-a0bd-4642-a220-2884e64a21b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:01.533494 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c54220-a0bd-4642-a220-2884e64a21b8 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:01.534162 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c54220-a0bd-4642-a220-2884e64a21b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:01.535896 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c54220-a0bd-4642-a220-2884e64a21b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:01.609530 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e129de-eab0-4e0f-9f85-869567dc2c0f None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:01.656468 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f79c4-4791-420b-95ca-47c188319a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:01.657571 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f79c4-4791-420b-95ca-47c188319a7f None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:01.658253 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f79c4-4791-420b-95ca-47c188319a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:01.658723 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f79c4-4791-420b-95ca-47c188319a7f None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:01.659654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f79c4-4791-420b-95ca-47c188319a7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:01.660564 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f79c4-4791-420b-95ca-47c188319a7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:01.662551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f79c4-4791-420b-95ca-47c188319a7f None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:01.670459 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c54220-a0bd-4642-a220-2884e64a21b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:01.671934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c54220-a0bd-4642-a220-2884e64a21b8 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:01.674609 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 178/371] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:42:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:01.675740 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f79c4-4791-420b-95ca-47c188319a7f None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:01.756557 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:01.833246 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 194/372] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:42:01.834695 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c54220-a0bd-4642-a220-2884e64a21b8 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:01.847699 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:01.892907 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f79c4-4791-420b-95ca-47c188319a7f None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:01.952063 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c54220-a0bd-4642-a220-2884e64a21b8 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:01.987177 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f6d1d-1fbd-45b5-8205-79efd56efec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:01.987804 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f6d1d-1fbd-45b5-8205-79efd56efec2 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:01.988088 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f6d1d-1fbd-45b5-8205-79efd56efec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:01.988370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f6d1d-1fbd-45b5-8205-79efd56efec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:01.989197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f6d1d-1fbd-45b5-8205-79efd56efec2 None admin] RBAC: Adding query filter params (role.id=3e04c82538344690a5a6591b125b6b86, user.id=78e5cece974c40f5aecf498dda349588, scope.system=all) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:01.989512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f6d1d-1fbd-45b5-8205-79efd56efec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:01.990630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207222e-758c-45be-b908-bd4b67d6750d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:01.991203 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f6d1d-1fbd-45b5-8205-79efd56efec2 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:01.991682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207222e-758c-45be-b908-bd4b67d6750d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:01.992168 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207222e-758c-45be-b908-bd4b67d6750d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:01.992647 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207222e-758c-45be-b908-bd4b67d6750d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:02.051726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 179/373] 10.222.0.96 () {56 vars in 1308 bytes} [Thu Jul 28 17:42:01 2022] GET /identity/v3/role_assignments?user.id=78e5cece974c40f5aecf498dda349588&scope.system=all&role.id=3e04c82538344690a5a6591b125b6b86 => generated 510 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:02.052789 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f6d1d-1fbd-45b5-8205-79efd56efec2 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:02.073517 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207222e-758c-45be-b908-bd4b67d6750d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:02.075494 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207222e-758c-45be-b908-bd4b67d6750d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:02.088807 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:02.206200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 195/374] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:42:02.212023 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207222e-758c-45be-b908-bd4b67d6750d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:02.301464 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f6d1d-1fbd-45b5-8205-79efd56efec2 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:02.308041 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:02.374978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725a309-d694-4ddb-a6aa-dc1042709310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:02.376087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725a309-d694-4ddb-a6aa-dc1042709310 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:02.376570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725a309-d694-4ddb-a6aa-dc1042709310 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:02.377034 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725a309-d694-4ddb-a6aa-dc1042709310 None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:02.379050 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725a309-d694-4ddb-a6aa-dc1042709310 None admin] RBAC: Authorizing `identity:get_project(project_id=a9647712d7a24fe1831a2c16cfba2abb)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:02.381040 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725a309-d694-4ddb-a6aa-dc1042709310 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:02.383279 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 180/375] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:42:02 2022] GET /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb => generated 302 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:02.397184 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725a309-d694-4ddb-a6aa-dc1042709310 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:02.455343 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207222e-758c-45be-b908-bd4b67d6750d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:02.476990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:02.528782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e00375-6dfc-4b0d-9bf8-7eb8d9a7a77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:02.530815 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e00375-6dfc-4b0d-9bf8-7eb8d9a7a77e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:02.533412 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e00375-6dfc-4b0d-9bf8-7eb8d9a7a77e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:02.533895 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e00375-6dfc-4b0d-9bf8-7eb8d9a7a77e None admin] PATH_INFO: `/v3/projects/84ce091dd3714924a52d3b36bdfb30f4` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:02.536018 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e00375-6dfc-4b0d-9bf8-7eb8d9a7a77e None admin] RBAC: Authorizing `identity:get_project(project_id=84ce091dd3714924a52d3b36bdfb30f4)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:02.538112 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e00375-6dfc-4b0d-9bf8-7eb8d9a7a77e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:02.543383 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 196/376] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:42:02 2022] GET /identity/v3/projects/84ce091dd3714924a52d3b36bdfb30f4 => generated 344 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:02.548483 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e00375-6dfc-4b0d-9bf8-7eb8d9a7a77e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:02.592363 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725a309-d694-4ddb-a6aa-dc1042709310 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:02.663078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abb67b-ce9f-4619-b01c-6928eb2374f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:02.665077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abb67b-ce9f-4619-b01c-6928eb2374f7 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:02.666993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abb67b-ce9f-4619-b01c-6928eb2374f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:02.667483 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abb67b-ce9f-4619-b01c-6928eb2374f7 None admin] PATH_INFO: `/v3/groups/627a8ca342ea408195b547e766c93a98` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:02.670211 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abb67b-ce9f-4619-b01c-6928eb2374f7 None admin] RBAC: Authorizing `identity:get_group(group_id=627a8ca342ea408195b547e766c93a98)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:02.672611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abb67b-ce9f-4619-b01c-6928eb2374f7 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:02.679580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 181/377] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Jul 28 17:42:02 2022] GET /identity/v3/groups/627a8ca342ea408195b547e766c93a98 => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:02.682681 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abb67b-ce9f-4619-b01c-6928eb2374f7 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:02.737452 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e00375-6dfc-4b0d-9bf8-7eb8d9a7a77e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:02.780640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda49f72-941b-4767-8b45-ee147815850d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:02.781720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda49f72-941b-4767-8b45-ee147815850d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:02.782207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda49f72-941b-4767-8b45-ee147815850d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:02.782667 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda49f72-941b-4767-8b45-ee147815850d None admin] PATH_INFO: `/v3/groups/a2d2831f733044ef8667a44a6131e676` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:02.789865 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda49f72-941b-4767-8b45-ee147815850d None admin] RBAC: Authorizing `identity:get_group(group_id=a2d2831f733044ef8667a44a6131e676)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:02.791153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:02.795689 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda49f72-941b-4767-8b45-ee147815850d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:02.798659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 197/378] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Jul 28 17:42:02 2022] GET /identity/v3/groups/a2d2831f733044ef8667a44a6131e676 => generated 229 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:02.804517 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda49f72-941b-4767-8b45-ee147815850d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:02.868411 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:02.945262 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda49f72-941b-4767-8b45-ee147815850d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:02.952008 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abb67b-ce9f-4619-b01c-6928eb2374f7 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:02.983482 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d08a5-eadf-4da9-9539-f8c28a9ebc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:02.984476 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d08a5-eadf-4da9-9539-f8c28a9ebc80 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:02.984758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d08a5-eadf-4da9-9539-f8c28a9ebc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:02.985034 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d08a5-eadf-4da9-9539-f8c28a9ebc80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:02.985910 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d08a5-eadf-4da9-9539-f8c28a9ebc80 None admin] RBAC: Adding query filter params (group.id=a2d2831f733044ef8667a44a6131e676, role.id=980cae90acae42189f92fd6dd42867a5, scope.project.id=84ce091dd3714924a52d3b36bdfb30f4) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:02.986227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d08a5-eadf-4da9-9539-f8c28a9ebc80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:02.987693 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d08a5-eadf-4da9-9539-f8c28a9ebc80 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:02.994261 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 198/379] 10.222.0.96 () {56 vars in 1376 bytes} [Thu Jul 28 17:42:02 2022] GET /identity/v3/role_assignments?group.id=a2d2831f733044ef8667a44a6131e676&scope.project.id=84ce091dd3714924a52d3b36bdfb30f4&role.id=980cae90acae42189f92fd6dd42867a5 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:02.995648 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1d1bd-85fd-4d32-9606-919d1a12f601 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:02.995936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1d1bd-85fd-4d32-9606-919d1a12f601 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:02.996211 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1d1bd-85fd-4d32-9606-919d1a12f601 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:02.997848 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 199/380] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:03.004063 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9ef11-6c9c-4c12-abb1-a1864273d225 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:03.004414 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9ef11-6c9c-4c12-abb1-a1864273d225 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:03.004613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9ef11-6c9c-4c12-abb1-a1864273d225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:03.034998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-23b9ef11-6c9c-4c12-abb1-a1864273d225 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:03.036245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-23b9ef11-6c9c-4c12-abb1-a1864273d225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:03.042526 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6cb6e-5f18-44d3-a8ce-85df37383f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:03.043485 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6cb6e-5f18-44d3-a8ce-85df37383f3a None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:03.043485 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6cb6e-5f18-44d3-a8ce-85df37383f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:03.043661 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6cb6e-5f18-44d3-a8ce-85df37383f3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:03.045124 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6cb6e-5f18-44d3-a8ce-85df37383f3a None admin] RBAC: Adding query filter params (group.id=627a8ca342ea408195b547e766c93a98, role.id=5b95c3aebc8041c7885a9234a9e54d7c, scope.project.id=a9647712d7a24fe1831a2c16cfba2abb) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:03.045124 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6cb6e-5f18-44d3-a8ce-85df37383f3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:03.046296 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6cb6e-5f18-44d3-a8ce-85df37383f3a None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:03.053779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 182/381] 10.222.0.96 () {56 vars in 1376 bytes} [Thu Jul 28 17:42:02 2022] GET /identity/v3/role_assignments?group.id=627a8ca342ea408195b547e766c93a98&scope.project.id=a9647712d7a24fe1831a2c16cfba2abb&role.id=5b95c3aebc8041c7885a9234a9e54d7c => generated 260 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:03.130065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 200/382] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:03.157886 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6cb6e-5f18-44d3-a8ce-85df37383f3a None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:03.307460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6cb6e-5f18-44d3-a8ce-85df37383f3a None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:03.309915 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:03.344606 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83a7ce-5c6c-44dd-8ffd-66321363e7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:03.345299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83a7ce-5c6c-44dd-8ffd-66321363e7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:03.345636 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83a7ce-5c6c-44dd-8ffd-66321363e7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:03.345919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83a7ce-5c6c-44dd-8ffd-66321363e7f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:03.357187 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83a7ce-5c6c-44dd-8ffd-66321363e7f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:03.362202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-1a83a7ce-5c6c-44dd-8ffd-66321363e7f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:42:03.362202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:03.362202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:03.362202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:03.362202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:03.362202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:03.362202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:03.362202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:03.362202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:03.362202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:03.362202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:03.362202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:03.362202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:03.362202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:03.362202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:03.362202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:03.363065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:03.363065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:03.363065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:03.363065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:03.363065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:03.363065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:03.363065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:03.363065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:03.363065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:03.363065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:03.363065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:03.363065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:03.363065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:03.363065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:03.363065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:03.363065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:03.363973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:03.363973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:03.363973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:03.363973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:03.363973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:03.363973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:03.363973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:03.363973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:03.363973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:03.363973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:03.363973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:42:03.363973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:03.363973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 183/383] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:42:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:03.371480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9ef11-6c9c-4c12-abb1-a1864273d225 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:03.408057 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:03.466595 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2baeb-54b7-4d1d-81aa-a418236df88f None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:03.467233 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2baeb-54b7-4d1d-81aa-a418236df88f None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:03.467741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2baeb-54b7-4d1d-81aa-a418236df88f None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:03.469552 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 184/384] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:03.475057 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d42303-b04f-4617-899e-8d20e6a475ad None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:03.475607 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d42303-b04f-4617-899e-8d20e6a475ad None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:03.476071 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d42303-b04f-4617-899e-8d20e6a475ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:03.495584 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-42d42303-b04f-4617-899e-8d20e6a475ad None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:03.495923 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9ef11-6c9c-4c12-abb1-a1864273d225 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:03.497666 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-42d42303-b04f-4617-899e-8d20e6a475ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:03.566016 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6c090-b2f1-4a66-b194-9343536ab837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:03.566591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6c090-b2f1-4a66-b194-9343536ab837 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:03.566873 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6c090-b2f1-4a66-b194-9343536ab837 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:03.567148 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6c090-b2f1-4a66-b194-9343536ab837 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:03.567938 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6c090-b2f1-4a66-b194-9343536ab837 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:03.568301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6c090-b2f1-4a66-b194-9343536ab837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:03.569826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6c090-b2f1-4a66-b194-9343536ab837 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:03.575806 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 185/385] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:03.587894 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 201/386] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:03.594014 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d42303-b04f-4617-899e-8d20e6a475ad None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:03.647214 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6c090-b2f1-4a66-b194-9343536ab837 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:03.702394 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:03.711495 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d42303-b04f-4617-899e-8d20e6a475ad None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:03.765769 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf915d-4eba-44ae-92d3-ee14c81bbe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:03.766803 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf915d-4eba-44ae-92d3-ee14c81bbe01 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:03.767281 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf915d-4eba-44ae-92d3-ee14c81bbe01 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:03.767762 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf915d-4eba-44ae-92d3-ee14c81bbe01 None admin] PATH_INFO: `/v3/groups/627a8ca342ea408195b547e766c93a98` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:03.769204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf915d-4eba-44ae-92d3-ee14c81bbe01 None admin] RBAC: Authorizing `identity:get_group(group_id=627a8ca342ea408195b547e766c93a98)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:03.770897 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf915d-4eba-44ae-92d3-ee14c81bbe01 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:03.773258 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 186/387] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Jul 28 17:42:03 2022] GET /identity/v3/groups/627a8ca342ea408195b547e766c93a98 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:03.778856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf915d-4eba-44ae-92d3-ee14c81bbe01 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:03.796402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:03.801037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6c090-b2f1-4a66-b194-9343536ab837 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:03.840042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30854cf2-5229-4ef8-b8e7-2d20b74c6945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:03.840796 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30854cf2-5229-4ef8-b8e7-2d20b74c6945 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:03.841157 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30854cf2-5229-4ef8-b8e7-2d20b74c6945 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:03.841487 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30854cf2-5229-4ef8-b8e7-2d20b74c6945 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:03.854320 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30854cf2-5229-4ef8-b8e7-2d20b74c6945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:03.860382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-30854cf2-5229-4ef8-b8e7-2d20b74c6945 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:42:03.860382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:03.860382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:03.860382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:03.860382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:03.860382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:03.860382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:03.860382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:03.860382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:03.860382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:03.860382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:03.860382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:03.860382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:03.860382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:03.860382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:03.860382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:03.861491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:03.861491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:03.861491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:03.861491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:03.861491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:03.861491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:03.861491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:03.861491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:03.861491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:03.861491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:03.861491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:03.861491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:03.861491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:03.861491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:03.861491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:03.861491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:03.862385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:03.862385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:03.862385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:03.862385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:03.862385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:03.862385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:03.862385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:03.862385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:03.862385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:03.862385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:03.862385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:42:03.862385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:03.863998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 202/388] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:42:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:42:03.870603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30854cf2-5229-4ef8-b8e7-2d20b74c6945 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:03.979540 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30854cf2-5229-4ef8-b8e7-2d20b74c6945 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:04.029022 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425e0ad-7ae6-4f2f-bdf7-bb20ebdfeed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:04.029835 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425e0ad-7ae6-4f2f-bdf7-bb20ebdfeed0 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:04.030116 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425e0ad-7ae6-4f2f-bdf7-bb20ebdfeed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:04.030659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425e0ad-7ae6-4f2f-bdf7-bb20ebdfeed0 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:04.031398 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425e0ad-7ae6-4f2f-bdf7-bb20ebdfeed0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:04.031699 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425e0ad-7ae6-4f2f-bdf7-bb20ebdfeed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:04.033617 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425e0ad-7ae6-4f2f-bdf7-bb20ebdfeed0 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:04.047737 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 203/389] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:42:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:04.047913 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf915d-4eba-44ae-92d3-ee14c81bbe01 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:04.049035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb700cb3-7a72-4079-af0f-fbd8b19bb08a None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:04.054923 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb700cb3-7a72-4079-af0f-fbd8b19bb08a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:04.055216 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb700cb3-7a72-4079-af0f-fbd8b19bb08a None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:04.056565 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 204/390] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:04.061393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb700cb3-7a72-4079-af0f-fbd8b19bb08a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:04.088810 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95159f51-c2ce-48d1-8f7e-75607f90e69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:04.089496 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95159f51-c2ce-48d1-8f7e-75607f90e69d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:04.089775 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95159f51-c2ce-48d1-8f7e-75607f90e69d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:04.090105 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95159f51-c2ce-48d1-8f7e-75607f90e69d None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:04.091224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95159f51-c2ce-48d1-8f7e-75607f90e69d None admin] RBAC: Authorizing `identity:get_project(project_id=963ff5e1d9f74853b35cd0babec573b9)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:04.092674 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95159f51-c2ce-48d1-8f7e-75607f90e69d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:04.093443 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:04.094727 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 187/391] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:42:03 2022] GET /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9 => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:04.095858 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb49a48-67f0-4a03-af94-8cee899319bf None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:04.096138 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb49a48-67f0-4a03-af94-8cee899319bf None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:04.096409 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb49a48-67f0-4a03-af94-8cee899319bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:04.114899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-9eb49a48-67f0-4a03-af94-8cee899319bf None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:04.116155 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9eb49a48-67f0-4a03-af94-8cee899319bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:04.145477 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:04.180818 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb700cb3-7a72-4079-af0f-fbd8b19bb08a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:04.201464 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 188/392] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:04.202446 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb49a48-67f0-4a03-af94-8cee899319bf None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:04.236888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4227a27-de7f-4217-93d3-0426332350de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:04.237576 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4227a27-de7f-4217-93d3-0426332350de None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:04.237850 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4227a27-de7f-4217-93d3-0426332350de None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:04.238123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4227a27-de7f-4217-93d3-0426332350de None admin] PATH_INFO: `/v3/groups/627a8ca342ea408195b547e766c93a98` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:04.239937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4227a27-de7f-4217-93d3-0426332350de None admin] RBAC: Authorizing `identity:get_group(group_id=627a8ca342ea408195b547e766c93a98)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:04.241769 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4227a27-de7f-4217-93d3-0426332350de None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:04.249597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 205/393] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Jul 28 17:42:04 2022] GET /identity/v3/groups/627a8ca342ea408195b547e766c93a98 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:04.251043 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4227a27-de7f-4217-93d3-0426332350de None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:04.336640 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb49a48-67f0-4a03-af94-8cee899319bf None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:04.369822 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:04.374774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f972d-ad11-4965-ac23-d57e807b595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:04.375703 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f972d-ad11-4965-ac23-d57e807b595e None admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:04.376149 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f972d-ad11-4965-ac23-d57e807b595e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:04.376565 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f972d-ad11-4965-ac23-d57e807b595e None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9/groups/627a8ca342ea408195b547e766c93a98/roles/5b95c3aebc8041c7885a9234a9e54d7c` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:04.379200 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f972d-ad11-4965-ac23-d57e807b595e None admin] RBAC: Authorizing `identity:create_grant(project_id=963ff5e1d9f74853b35cd0babec573b9, group_id=627a8ca342ea408195b547e766c93a98, role_id=5b95c3aebc8041c7885a9234a9e54d7c)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:04.381429 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f972d-ad11-4965-ac23-d57e807b595e None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:04.384475 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4227a27-de7f-4217-93d3-0426332350de None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:04.398253 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 189/394] 10.222.0.96 () {58 vars in 1442 bytes} [Thu Jul 28 17:42:04 2022] PUT /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9/groups/627a8ca342ea408195b547e766c93a98/roles/5b95c3aebc8041c7885a9234a9e54d7c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:42:04.399510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f972d-ad11-4965-ac23-d57e807b595e None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:04.424809 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:04.454594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d1cdb-c426-416b-b29a-eb37108cd94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:04.456245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d1cdb-c426-416b-b29a-eb37108cd94a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:04.456986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d1cdb-c426-416b-b29a-eb37108cd94a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:04.457776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d1cdb-c426-416b-b29a-eb37108cd94a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:04.481639 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d1cdb-c426-416b-b29a-eb37108cd94a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:04.490164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-965d1cdb-c426-416b-b29a-eb37108cd94a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:42:04.490164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:04.490164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:04.490164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:04.490164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:04.490164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:04.490164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:04.490164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:04.490164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:04.490164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:04.490164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:04.490164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:04.490164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:04.490164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:04.490164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:04.490164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:04.491293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:04.491293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:04.491293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:04.491293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:04.491293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:04.491293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:04.491293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:04.491293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:04.491293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:04.491293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:04.491293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:04.491293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:04.491293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:04.491293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:04.491293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:04.491293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:04.492065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:04.492065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:04.492065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:04.492065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:04.492065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:04.492065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:04.492065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:04.492065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:04.492065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:04.492065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:04.492065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:42:04.492065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:04.494309 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 206/395] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:42:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:04.502547 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d1cdb-c426-416b-b29a-eb37108cd94a None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:04.523889 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f972d-ad11-4965-ac23-d57e807b595e None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:04.564936 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bfba4-46e4-45e9-b4ba-84cf5915a4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:04.565645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bfba4-46e4-45e9-b4ba-84cf5915a4af None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:04.565929 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bfba4-46e4-45e9-b4ba-84cf5915a4af None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:04.566205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bfba4-46e4-45e9-b4ba-84cf5915a4af None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:04.567520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bfba4-46e4-45e9-b4ba-84cf5915a4af None admin] RBAC: Authorizing `identity:get_project(project_id=963ff5e1d9f74853b35cd0babec573b9)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:04.569649 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bfba4-46e4-45e9-b4ba-84cf5915a4af None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:04.571509 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 190/396] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:42:04 2022] GET /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:04.577391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bfba4-46e4-45e9-b4ba-84cf5915a4af None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:04.639068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d1cdb-c426-416b-b29a-eb37108cd94a None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:04.677165 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15ef11-5431-43c3-b1f4-a3965473ee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:04.678297 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15ef11-5431-43c3-b1f4-a3965473ee48 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:04.678719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15ef11-5431-43c3-b1f4-a3965473ee48 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:04.679128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15ef11-5431-43c3-b1f4-a3965473ee48 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:04.679987 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15ef11-5431-43c3-b1f4-a3965473ee48 None admin] RBAC: Adding query filter params (name=member) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:04.680437 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15ef11-5431-43c3-b1f4-a3965473ee48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:04.681638 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:04.682197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15ef11-5431-43c3-b1f4-a3965473ee48 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:04.691559 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 207/397] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:42:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:04.697750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15ef11-5431-43c3-b1f4-a3965473ee48 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:04.698604 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bfba4-46e4-45e9-b4ba-84cf5915a4af None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:04.711781 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:04.736218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76750e-1bb3-43bc-9d87-af5475b5e664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:04.736917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76750e-1bb3-43bc-9d87-af5475b5e664 None admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:04.737236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76750e-1bb3-43bc-9d87-af5475b5e664 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:04.737512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76750e-1bb3-43bc-9d87-af5475b5e664 None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9/groups/627a8ca342ea408195b547e766c93a98/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:04.740134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76750e-1bb3-43bc-9d87-af5475b5e664 None admin] RBAC: Authorizing `identity:create_grant(project_id=963ff5e1d9f74853b35cd0babec573b9, group_id=627a8ca342ea408195b547e766c93a98, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:04.741751 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76750e-1bb3-43bc-9d87-af5475b5e664 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:04.760541 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 191/398] 10.222.0.96 () {58 vars in 1442 bytes} [Thu Jul 28 17:42:04 2022] PUT /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9/groups/627a8ca342ea408195b547e766c93a98/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:42:04.819382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15ef11-5431-43c3-b1f4-a3965473ee48 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:04.859888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3082ca-1296-42e0-a794-17885f1e6d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:04.860858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3082ca-1296-42e0-a794-17885f1e6d05 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:04.861303 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3082ca-1296-42e0-a794-17885f1e6d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:04.861708 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3082ca-1296-42e0-a794-17885f1e6d05 None admin] PATH_INFO: `/v3/groups/627a8ca342ea408195b547e766c93a98` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:04.863099 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3082ca-1296-42e0-a794-17885f1e6d05 None admin] RBAC: Authorizing `identity:get_group(group_id=627a8ca342ea408195b547e766c93a98)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:04.864785 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3082ca-1296-42e0-a794-17885f1e6d05 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:04.866992 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 208/399] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Jul 28 17:42:04 2022] GET /identity/v3/groups/627a8ca342ea408195b547e766c93a98 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:04.873219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76750e-1bb3-43bc-9d87-af5475b5e664 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:05.013032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76750e-1bb3-43bc-9d87-af5475b5e664 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:05.050756 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3eac2-b2f8-46e9-a73d-8284d01c4689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:05.051431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3eac2-b2f8-46e9-a73d-8284d01c4689 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:05.051708 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3eac2-b2f8-46e9-a73d-8284d01c4689 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:05.051993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3eac2-b2f8-46e9-a73d-8284d01c4689 None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:05.053684 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3eac2-b2f8-46e9-a73d-8284d01c4689 None admin] RBAC: Authorizing `identity:get_project(project_id=a9647712d7a24fe1831a2c16cfba2abb)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:05.055163 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3eac2-b2f8-46e9-a73d-8284d01c4689 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:05.058271 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 192/400] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:42:04 2022] GET /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:05.064508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3082ca-1296-42e0-a794-17885f1e6d05 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:05.157758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:05.182612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3082ca-1296-42e0-a794-17885f1e6d05 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:05.220224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475c310-a5b0-43a4-a234-ef07b3e7eaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:05.221290 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475c310-a5b0-43a4-a234-ef07b3e7eaa9 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:05.221751 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475c310-a5b0-43a4-a234-ef07b3e7eaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:05.222241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475c310-a5b0-43a4-a234-ef07b3e7eaa9 None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb/groups/627a8ca342ea408195b547e766c93a98/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:05.224643 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475c310-a5b0-43a4-a234-ef07b3e7eaa9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9647712d7a24fe1831a2c16cfba2abb, group_id=627a8ca342ea408195b547e766c93a98, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:05.226623 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475c310-a5b0-43a4-a234-ef07b3e7eaa9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:05.251723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 209/401] 10.222.0.96 () {58 vars in 1442 bytes} [Thu Jul 28 17:42:05 2022] PUT /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb/groups/627a8ca342ea408195b547e766c93a98/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:42:05.517103 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bffe08-d6ce-4ce4-ab1b-874b9c95054e None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:05.518061 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bffe08-d6ce-4ce4-ab1b-874b9c95054e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:05.518516 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bffe08-d6ce-4ce4-ab1b-874b9c95054e None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:05.520502 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 193/402] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:05.526275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dae5b2-a61d-4911-92d1-04df14a55ca5 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:05.526778 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dae5b2-a61d-4911-92d1-04df14a55ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:05.526874 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dae5b2-a61d-4911-92d1-04df14a55ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:05.551748 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-61dae5b2-a61d-4911-92d1-04df14a55ca5 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:05.553074 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-61dae5b2-a61d-4911-92d1-04df14a55ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:05.624102 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 210/403] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:42:05.648243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bffe08-d6ce-4ce4-ab1b-874b9c95054e None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:05.670093 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:05.763821 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bffe08-d6ce-4ce4-ab1b-874b9c95054e None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:05.798948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b634c-5dac-471f-9eff-ec24d617dc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:05.799515 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b634c-5dac-471f-9eff-ec24d617dc8e None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:05.799794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b634c-5dac-471f-9eff-ec24d617dc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:05.800068 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b634c-5dac-471f-9eff-ec24d617dc8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:05.811209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b634c-5dac-471f-9eff-ec24d617dc8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:05.816121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-a11b634c-5dac-471f-9eff-ec24d617dc8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:42:05.816121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:05.816121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:05.816121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:05.816121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:05.816121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:05.816121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:05.816121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:05.816121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:05.816121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:05.816121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:05.816121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:05.816121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:05.816121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:05.816121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:05.816121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:05.817945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:05.817945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:05.817945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:05.817945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:05.817945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:05.817945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:05.817945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:05.817945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:05.817945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:05.817945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:05.817945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:05.817945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:05.817945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:05.817945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:05.817945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:05.817945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:05.819420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:05.819420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:05.819420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:05.819420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:05.819420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:05.819420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:05.819420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:05.819420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:05.819420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:05.819420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:05.819420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:42:05.819420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:05.819420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 194/404] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:42:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:05.823958 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dae5b2-a61d-4911-92d1-04df14a55ca5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:05.840552 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3491c-f8b1-412b-9abb-672ad63ab60a None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:05.841210 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3491c-f8b1-412b-9abb-672ad63ab60a None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:05.841691 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3491c-f8b1-412b-9abb-672ad63ab60a None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:05.843349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 195/405] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:42:05.849579 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9771c-6e98-4342-a115-66c3c3595a7c None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:05.850587 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9771c-6e98-4342-a115-66c3c3595a7c None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:05.851289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9771c-6e98-4342-a115-66c3c3595a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:05.882293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-aec9771c-6e98-4342-a115-66c3c3595a7c None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:05.883930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-aec9771c-6e98-4342-a115-66c3c3595a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:05.953711 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:06.006772 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 196/406] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:42:06.034578 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9771c-6e98-4342-a115-66c3c3595a7c None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:06.045710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:06.064774 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dae5b2-a61d-4911-92d1-04df14a55ca5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:06.136633 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b843a3-d58e-43b3-a458-d2d4acd1544b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:06.138200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b843a3-d58e-43b3-a458-d2d4acd1544b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:06.139037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b843a3-d58e-43b3-a458-d2d4acd1544b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:06.139510 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b843a3-d58e-43b3-a458-d2d4acd1544b None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:06.140460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b843a3-d58e-43b3-a458-d2d4acd1544b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:06.140959 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b843a3-d58e-43b3-a458-d2d4acd1544b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:06.142584 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b843a3-d58e-43b3-a458-d2d4acd1544b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:06.165123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 211/407] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:42:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:06.170693 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b843a3-d58e-43b3-a458-d2d4acd1544b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:06.262660 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9771c-6e98-4342-a115-66c3c3595a7c None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:06.368553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b843a3-d58e-43b3-a458-d2d4acd1544b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:06.395827 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a533c-b67f-4eb4-9fc2-64e22b4428c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:06.397406 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a533c-b67f-4eb4-9fc2-64e22b4428c7 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:06.398545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a533c-b67f-4eb4-9fc2-64e22b4428c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:06.399034 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a533c-b67f-4eb4-9fc2-64e22b4428c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:06.418447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a533c-b67f-4eb4-9fc2-64e22b4428c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:06.424519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-bb0a533c-b67f-4eb4-9fc2-64e22b4428c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:42:06.424519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:06.424519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:06.424519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:06.424519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:06.424519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:06.424519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:06.424519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:06.424519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:06.424519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:06.424519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:06.424519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:06.424519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:06.424519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:06.424519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:06.424519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:06.425414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:06.425414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:06.425414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:06.425414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:06.425414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:06.425414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:06.425414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:06.425414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:06.425414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:06.425414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:06.425414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:06.425414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:06.425414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:06.425414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:06.425414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:06.425414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:06.426545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:06.426545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:06.426545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:06.426545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:06.426545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:06.426545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:06.426545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:06.426545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:06.426545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:06.426545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:06.426545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:42:06.426545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:06.430844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 197/408] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:42:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:06.437413 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:06.444122 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9c5dd-7fcc-4c5f-b891-f543d7025902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:06.444342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a533c-b67f-4eb4-9fc2-64e22b4428c7 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:06.444909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9c5dd-7fcc-4c5f-b891-f543d7025902 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:06.445254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9c5dd-7fcc-4c5f-b891-f543d7025902 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:06.445543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9c5dd-7fcc-4c5f-b891-f543d7025902 None admin] PATH_INFO: `/v3/groups/a2d2831f733044ef8667a44a6131e676` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:06.446737 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9c5dd-7fcc-4c5f-b891-f543d7025902 None admin] RBAC: Authorizing `identity:get_group(group_id=a2d2831f733044ef8667a44a6131e676)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:06.448217 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9c5dd-7fcc-4c5f-b891-f543d7025902 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:06.450308 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 212/409] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Jul 28 17:42:06 2022] GET /identity/v3/groups/a2d2831f733044ef8667a44a6131e676 => generated 229 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:06.455903 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9c5dd-7fcc-4c5f-b891-f543d7025902 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:06.560136 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:06.612538 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a533c-b67f-4eb4-9fc2-64e22b4428c7 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:06.663720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9c5dd-7fcc-4c5f-b891-f543d7025902 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:06.664385 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3273a2c-795e-4d8a-b437-71de0bfb6167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:06.665027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3273a2c-795e-4d8a-b437-71de0bfb6167 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:06.665359 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3273a2c-795e-4d8a-b437-71de0bfb6167 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:06.665626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3273a2c-795e-4d8a-b437-71de0bfb6167 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:06.666337 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3273a2c-795e-4d8a-b437-71de0bfb6167 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:06.666642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3273a2c-795e-4d8a-b437-71de0bfb6167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:06.668055 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3273a2c-795e-4d8a-b437-71de0bfb6167 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:06.677588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 198/410] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:06.684282 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3273a2c-795e-4d8a-b437-71de0bfb6167 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:06.725241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a3c0c-08b2-4686-abd2-97b67b47b989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:06.727055 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a3c0c-08b2-4686-abd2-97b67b47b989 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:06.727346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a3c0c-08b2-4686-abd2-97b67b47b989 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:06.727624 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a3c0c-08b2-4686-abd2-97b67b47b989 None admin] PATH_INFO: `/v3/projects/84ce091dd3714924a52d3b36bdfb30f4` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:06.728877 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a3c0c-08b2-4686-abd2-97b67b47b989 None admin] RBAC: Authorizing `identity:get_project(project_id=84ce091dd3714924a52d3b36bdfb30f4)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:06.730371 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a3c0c-08b2-4686-abd2-97b67b47b989 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:06.738386 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 213/411] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:42:06 2022] GET /identity/v3/projects/84ce091dd3714924a52d3b36bdfb30f4 => generated 344 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:06.745777 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a3c0c-08b2-4686-abd2-97b67b47b989 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:06.842177 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3273a2c-795e-4d8a-b437-71de0bfb6167 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:06.892581 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a3c0c-08b2-4686-abd2-97b67b47b989 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:06.897893 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:06.913050 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f0458-9fcf-4a68-bb41-1f269945be9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:06.913475 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:06.913830 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f0458-9fcf-4a68-bb41-1f269945be9c None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:06.917141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f0458-9fcf-4a68-bb41-1f269945be9c None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:06.917437 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f0458-9fcf-4a68-bb41-1f269945be9c None admin] PATH_INFO: `/v3/groups/627a8ca342ea408195b547e766c93a98` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:06.918764 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f0458-9fcf-4a68-bb41-1f269945be9c None admin] RBAC: Authorizing `identity:get_group(group_id=627a8ca342ea408195b547e766c93a98)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:06.920225 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f0458-9fcf-4a68-bb41-1f269945be9c None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:06.923492 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 199/412] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Jul 28 17:42:06 2022] GET /identity/v3/groups/627a8ca342ea408195b547e766c93a98 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:06.929723 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f0458-9fcf-4a68-bb41-1f269945be9c None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:06.940816 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a4c3e-1823-4b28-a727-790515baaecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:06.941544 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a4c3e-1823-4b28-a727-790515baaecd None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:06.941924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a4c3e-1823-4b28-a727-790515baaecd None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:06.942204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a4c3e-1823-4b28-a727-790515baaecd None admin] PATH_INFO: `/v3/projects/84ce091dd3714924a52d3b36bdfb30f4/groups/a2d2831f733044ef8667a44a6131e676/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:06.950893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a4c3e-1823-4b28-a727-790515baaecd None admin] RBAC: Authorizing `identity:create_grant(project_id=84ce091dd3714924a52d3b36bdfb30f4, group_id=a2d2831f733044ef8667a44a6131e676, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:06.955390 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a4c3e-1823-4b28-a727-790515baaecd None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:06.981952 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 214/413] 10.222.0.96 () {58 vars in 1442 bytes} [Thu Jul 28 17:42:06 2022] PUT /identity/v3/projects/84ce091dd3714924a52d3b36bdfb30f4/groups/a2d2831f733044ef8667a44a6131e676/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:42:07.082049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f0458-9fcf-4a68-bb41-1f269945be9c None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:07.120132 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876f50e-b764-4062-bf9c-cb56a218356f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:07.120793 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876f50e-b764-4062-bf9c-cb56a218356f None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:07.121083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876f50e-b764-4062-bf9c-cb56a218356f None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:07.121372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876f50e-b764-4062-bf9c-cb56a218356f None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:07.122601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876f50e-b764-4062-bf9c-cb56a218356f None admin] RBAC: Authorizing `identity:get_project(project_id=a9647712d7a24fe1831a2c16cfba2abb)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:07.124064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876f50e-b764-4062-bf9c-cb56a218356f None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:07.126140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 200/414] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:42:06 2022] GET /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:07.133425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a4c3e-1823-4b28-a727-790515baaecd None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:07.162445 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac55a5-aa47-4343-ba75-6d1180ec1e98 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:07.162764 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac55a5-aa47-4343-ba75-6d1180ec1e98 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:07.163000 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac55a5-aa47-4343-ba75-6d1180ec1e98 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:07.164762 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 201/415] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:07.170694 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64caba23-f6db-4656-88bd-8124242e82ad None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:07.170982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64caba23-f6db-4656-88bd-8124242e82ad None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:07.171259 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64caba23-f6db-4656-88bd-8124242e82ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:07.193527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-64caba23-f6db-4656-88bd-8124242e82ad None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:07.195340 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-64caba23-f6db-4656-88bd-8124242e82ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:07.262080 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:07.274254 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 202/416] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:42:07.275633 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1e4df-37cd-4039-91c5-36ad2dc4555f None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:07.275915 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1e4df-37cd-4039-91c5-36ad2dc4555f None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:07.276186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1e4df-37cd-4039-91c5-36ad2dc4555f None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:07.277704 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 203/417] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:07.281794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a4c3e-1823-4b28-a727-790515baaecd None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:07.282893 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcbfbc-7975-49f5-afaa-f9a908acecf6 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:07.283179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcbfbc-7975-49f5-afaa-f9a908acecf6 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:07.283449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcbfbc-7975-49f5-afaa-f9a908acecf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:07.315432 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-8dbcbfbc-7975-49f5-afaa-f9a908acecf6 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:07.316848 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-8dbcbfbc-7975-49f5-afaa-f9a908acecf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:07.322329 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:07.334640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88890f91-1859-439d-bf47-c760c29d073b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:07.336582 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88890f91-1859-439d-bf47-c760c29d073b None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:07.337378 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88890f91-1859-439d-bf47-c760c29d073b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:07.338575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88890f91-1859-439d-bf47-c760c29d073b None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb/groups/627a8ca342ea408195b547e766c93a98/roles/5b95c3aebc8041c7885a9234a9e54d7c` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:07.342973 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88890f91-1859-439d-bf47-c760c29d073b None admin] RBAC: Authorizing `identity:create_grant(project_id=a9647712d7a24fe1831a2c16cfba2abb, group_id=627a8ca342ea408195b547e766c93a98, role_id=5b95c3aebc8041c7885a9234a9e54d7c)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:07.344442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88890f91-1859-439d-bf47-c760c29d073b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:07.362746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 215/418] 10.222.0.96 () {58 vars in 1442 bytes} [Thu Jul 28 17:42:07 2022] PUT /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb/groups/627a8ca342ea408195b547e766c93a98/roles/5b95c3aebc8041c7885a9234a9e54d7c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:42:07.363741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88890f91-1859-439d-bf47-c760c29d073b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:07.413186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 204/419] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:42:07.440395 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcbfbc-7975-49f5-afaa-f9a908acecf6 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:07.483666 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88890f91-1859-439d-bf47-c760c29d073b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:07.520909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15f037-fded-40e4-9175-22ac6af86215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:07.521845 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15f037-fded-40e4-9175-22ac6af86215 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:07.522185 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15f037-fded-40e4-9175-22ac6af86215 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:07.522523 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15f037-fded-40e4-9175-22ac6af86215 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:07.534746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15f037-fded-40e4-9175-22ac6af86215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:07.541241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-bf15f037-fded-40e4-9175-22ac6af86215 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:42:07.541241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:07.541241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:07.541241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:07.541241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:07.541241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:07.541241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:07.541241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:07.541241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:07.541241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:07.541241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:07.541241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:07.541241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:07.541241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:07.541241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:07.541241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:07.542224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:07.542224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:07.542224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:07.542224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:07.542224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:07.542224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:07.542224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:07.542224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:07.542224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:07.542224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:07.542224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:07.542224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:07.542224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:07.542224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:07.542224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:07.542224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:07.543021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:07.543021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:07.543021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:07.543021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:07.543021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:07.543021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:07.543021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:07.543021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:07.543021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:07.543021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:07.543021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:42:07.543021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:07.543021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 216/420] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:42:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:07.548673 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15f037-fded-40e4-9175-22ac6af86215 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:07.565766 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcbfbc-7975-49f5-afaa-f9a908acecf6 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:07.593896 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:07.602815 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:07.608535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bcb1d-9581-4635-9cc9-c2a655ddb0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:07.609547 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bcb1d-9581-4635-9cc9-c2a655ddb0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:07.610963 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bcb1d-9581-4635-9cc9-c2a655ddb0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:07.611521 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bcb1d-9581-4635-9cc9-c2a655ddb0e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:07.623680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698bcb1d-9581-4635-9cc9-c2a655ddb0e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:07.629289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-698bcb1d-9581-4635-9cc9-c2a655ddb0e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:42:07.629289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:07.629289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:07.629289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:07.629289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:07.629289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:07.629289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:07.629289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:07.629289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:07.629289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:07.629289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:07.629289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:07.629289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:07.629289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:07.629289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:07.629289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:07.630243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:07.630243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:07.630243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:07.630243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:07.630243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:07.630243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:07.630243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:07.630243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:07.630243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:07.630243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:07.630243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:07.630243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:07.630243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:07.630243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:07.630243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:07.630243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:07.631137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:07.631137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:07.631137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:07.631137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:07.631137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:07.631137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:07.631137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:07.631137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:07.631137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:07.631137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:07.631137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:42:07.631137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:07.634005 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 205/421] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:42:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:07.640417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bcb1d-9581-4635-9cc9-c2a655ddb0e1 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:07.695669 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15f037-fded-40e4-9175-22ac6af86215 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:07.744187 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c72e5-8107-494d-8a79-46546648b299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:07.744865 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c72e5-8107-494d-8a79-46546648b299 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:07.745209 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c72e5-8107-494d-8a79-46546648b299 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:07.745488 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c72e5-8107-494d-8a79-46546648b299 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:07.746476 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c72e5-8107-494d-8a79-46546648b299 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:07.746782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c72e5-8107-494d-8a79-46546648b299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:07.748345 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c72e5-8107-494d-8a79-46546648b299 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:07.759090 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 217/422] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:07.764715 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c72e5-8107-494d-8a79-46546648b299 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:07.770242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bcb1d-9581-4635-9cc9-c2a655ddb0e1 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:07.812126 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc31039-c16a-48be-baef-aef3e4db0e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:07.813238 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc31039-c16a-48be-baef-aef3e4db0e8b None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:07.813813 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc31039-c16a-48be-baef-aef3e4db0e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:07.814280 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc31039-c16a-48be-baef-aef3e4db0e8b None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:07.815198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc31039-c16a-48be-baef-aef3e4db0e8b None admin] RBAC: Adding query filter params (name=member) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:07.815735 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc31039-c16a-48be-baef-aef3e4db0e8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:07.817361 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc31039-c16a-48be-baef-aef3e4db0e8b None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:07.827699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 206/423] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:42:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:07.833960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc31039-c16a-48be-baef-aef3e4db0e8b None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:07.887057 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:07.982034 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc31039-c16a-48be-baef-aef3e4db0e8b None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:07.985257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c72e5-8107-494d-8a79-46546648b299 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:08.001211 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:08.032611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6755f79-1b65-44f2-a601-c2d733199c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:08.033265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6755f79-1b65-44f2-a601-c2d733199c6d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:08.033542 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6755f79-1b65-44f2-a601-c2d733199c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:08.033918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6755f79-1b65-44f2-a601-c2d733199c6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:08.043565 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018226a7-d1d6-41a7-b033-61dafc661949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:08.044592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018226a7-d1d6-41a7-b033-61dafc661949 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:08.045087 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018226a7-d1d6-41a7-b033-61dafc661949 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:08.045571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018226a7-d1d6-41a7-b033-61dafc661949 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:08.102006 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6755f79-1b65-44f2-a601-c2d733199c6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:08.103520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6755f79-1b65-44f2-a601-c2d733199c6d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:08.118719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018226a7-d1d6-41a7-b033-61dafc661949 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:08.120563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018226a7-d1d6-41a7-b033-61dafc661949 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:08.149299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:08.209363 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 207/424] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:42:08.215301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6755f79-1b65-44f2-a601-c2d733199c6d None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:08.260036 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 218/425] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:42:08.262702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fd7ea-e1bb-4b70-b9ec-719a40cd49dd None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:08.262984 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fd7ea-e1bb-4b70-b9ec-719a40cd49dd None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:08.263564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fd7ea-e1bb-4b70-b9ec-719a40cd49dd None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:08.264950 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 219/426] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:08.271052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fd7ea-e1bb-4b70-b9ec-719a40cd49dd None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:08.283465 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:08.340317 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6755f79-1b65-44f2-a601-c2d733199c6d None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:08.374876 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b0b48-8e08-407a-aab2-6e6f397e781c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:08.375520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0b48-8e08-407a-aab2-6e6f397e781c None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:08.375795 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0b48-8e08-407a-aab2-6e6f397e781c None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:08.376059 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0b48-8e08-407a-aab2-6e6f397e781c None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:08.377809 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b0b48-8e08-407a-aab2-6e6f397e781c None admin] RBAC: Authorizing `identity:get_project(project_id=963ff5e1d9f74853b35cd0babec573b9)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:08.379526 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b0b48-8e08-407a-aab2-6e6f397e781c None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:08.386273 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 208/427] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:42:08 2022] GET /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:08.386273 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda07a9-d8c9-4eab-a867-170241247ed8 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:08.386273 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda07a9-d8c9-4eab-a867-170241247ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:08.386273 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda07a9-d8c9-4eab-a867-170241247ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:08.390613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fd7ea-e1bb-4b70-b9ec-719a40cd49dd None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:08.405527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-2eda07a9-d8c9-4eab-a867-170241247ed8 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:08.406958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-2eda07a9-d8c9-4eab-a867-170241247ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:08.421673 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:08.433266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d8214-c68b-48af-b0c2-d86e32ac2434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:08.434269 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d8214-c68b-48af-b0c2-d86e32ac2434 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:08.434850 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d8214-c68b-48af-b0c2-d86e32ac2434 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:08.435307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d8214-c68b-48af-b0c2-d86e32ac2434 None admin] PATH_INFO: `/v3/projects/963ff5e1d9f74853b35cd0babec573b9` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:08.436652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d8214-c68b-48af-b0c2-d86e32ac2434 None admin] RBAC: Authorizing `identity:get_project(project_id=963ff5e1d9f74853b35cd0babec573b9)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:08.438525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d8214-c68b-48af-b0c2-d86e32ac2434 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:08.445330 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 220/428] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:42:08 2022] GET /identity/v3/projects/963ff5e1d9f74853b35cd0babec573b9 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:08.446760 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d8214-c68b-48af-b0c2-d86e32ac2434 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:08.493866 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 209/429] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:08.501325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda07a9-d8c9-4eab-a867-170241247ed8 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:08.562425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:08.594642 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d8214-c68b-48af-b0c2-d86e32ac2434 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:08.611519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda07a9-d8c9-4eab-a867-170241247ed8 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:08.642017 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02486d2c-62df-4ccb-96ec-15ac208938da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:08.642678 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02486d2c-62df-4ccb-96ec-15ac208938da None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:08.642960 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02486d2c-62df-4ccb-96ec-15ac208938da None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:08.643258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02486d2c-62df-4ccb-96ec-15ac208938da None admin] PATH_INFO: `/v3/groups/627a8ca342ea408195b547e766c93a98` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:08.645097 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02486d2c-62df-4ccb-96ec-15ac208938da None admin] RBAC: Authorizing `identity:get_group(group_id=627a8ca342ea408195b547e766c93a98)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:08.646727 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02486d2c-62df-4ccb-96ec-15ac208938da None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:08.653453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 221/430] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Jul 28 17:42:08 2022] GET /identity/v3/groups/627a8ca342ea408195b547e766c93a98 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:08.653453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02486d2c-62df-4ccb-96ec-15ac208938da None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:08.653638 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8d5b9-3736-45c5-adbd-2b76064fb6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:08.654027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8d5b9-3736-45c5-adbd-2b76064fb6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:08.654183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8d5b9-3736-45c5-adbd-2b76064fb6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:08.654427 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8d5b9-3736-45c5-adbd-2b76064fb6f5 None admin] PATH_INFO: `/v3/groups/627a8ca342ea408195b547e766c93a98` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:08.656053 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8d5b9-3736-45c5-adbd-2b76064fb6f5 None admin] RBAC: Authorizing `identity:get_group(group_id=627a8ca342ea408195b547e766c93a98)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:08.657818 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8d5b9-3736-45c5-adbd-2b76064fb6f5 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:08.665448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 210/431] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Jul 28 17:42:08 2022] GET /identity/v3/groups/627a8ca342ea408195b547e766c93a98 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:08.665448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8d5b9-3736-45c5-adbd-2b76064fb6f5 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:08.681735 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:08.767754 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02486d2c-62df-4ccb-96ec-15ac208938da None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:08.799541 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8d5b9-3736-45c5-adbd-2b76064fb6f5 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:08.804125 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9236d-dfa8-4d4c-a2bd-288ad296cef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:08.804777 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9236d-dfa8-4d4c-a2bd-288ad296cef2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:08.805052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9236d-dfa8-4d4c-a2bd-288ad296cef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:08.805367 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9236d-dfa8-4d4c-a2bd-288ad296cef2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:08.819036 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9236d-dfa8-4d4c-a2bd-288ad296cef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:08.825779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-21a9236d-dfa8-4d4c-a2bd-288ad296cef2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:42:08.825779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:08.825779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:08.825779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:08.825779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:08.825779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:08.825779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:08.825779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:08.825779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:08.825779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:08.825779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:08.825779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:08.825779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:08.825779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:08.825779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:08.825779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:08.826665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:08.826665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:08.826665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:08.826665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:08.826665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:08.826665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:08.826665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:08.826665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:08.826665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:08.826665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:08.826665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:08.826665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:08.826665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:08.826665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:08.826665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:08.826665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:08.827445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:08.827445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:08.827445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:08.827445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:08.827445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:08.827445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:08.827445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:08.827445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:08.827445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:08.827445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:08.827445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:42:08.827445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:08.832026 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 222/432] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:42:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:08.833444 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9236d-dfa8-4d4c-a2bd-288ad296cef2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:08.839789 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:08.848419 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca599b-075e-4597-bf01-6837d8b5f33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:08.850396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca599b-075e-4597-bf01-6837d8b5f33f None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:08.850899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca599b-075e-4597-bf01-6837d8b5f33f None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:08.851724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca599b-075e-4597-bf01-6837d8b5f33f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:08.852999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca599b-075e-4597-bf01-6837d8b5f33f None admin] RBAC: Adding query filter params (group.id=627a8ca342ea408195b547e766c93a98, role.id=1e9bc5b431414d62a974beb13a8f83c7, scope.project.id=963ff5e1d9f74853b35cd0babec573b9) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:08.853561 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca599b-075e-4597-bf01-6837d8b5f33f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:08.856054 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca599b-075e-4597-bf01-6837d8b5f33f None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:08.864331 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 211/433] 10.222.0.96 () {56 vars in 1376 bytes} [Thu Jul 28 17:42:08 2022] GET /identity/v3/role_assignments?group.id=627a8ca342ea408195b547e766c93a98&scope.project.id=963ff5e1d9f74853b35cd0babec573b9&role.id=1e9bc5b431414d62a974beb13a8f83c7 => generated 611 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:08.866105 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca599b-075e-4597-bf01-6837d8b5f33f None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:08.987546 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9236d-dfa8-4d4c-a2bd-288ad296cef2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:09.036614 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d9020-5c77-456a-b581-5ba45f4b6052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:09.037475 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d9020-5c77-456a-b581-5ba45f4b6052 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:09.037754 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d9020-5c77-456a-b581-5ba45f4b6052 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:09.038023 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d9020-5c77-456a-b581-5ba45f4b6052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:09.038822 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d9020-5c77-456a-b581-5ba45f4b6052 None admin] RBAC: Adding query filter params (group.id=627a8ca342ea408195b547e766c93a98, role.id=5b95c3aebc8041c7885a9234a9e54d7c, scope.project.id=963ff5e1d9f74853b35cd0babec573b9) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:09.039126 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d9020-5c77-456a-b581-5ba45f4b6052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:09.040562 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d9020-5c77-456a-b581-5ba45f4b6052 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:09.049813 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 223/434] 10.222.0.96 () {56 vars in 1376 bytes} [Thu Jul 28 17:42:08 2022] GET /identity/v3/role_assignments?group.id=627a8ca342ea408195b547e766c93a98&scope.project.id=963ff5e1d9f74853b35cd0babec573b9&role.id=5b95c3aebc8041c7885a9234a9e54d7c => generated 611 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:09.064699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:09.093052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca599b-075e-4597-bf01-6837d8b5f33f None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:09.130108 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f370d-fc10-4a92-bb90-7f7f45a510c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:09.130797 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f370d-fc10-4a92-bb90-7f7f45a510c6 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:09.131078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f370d-fc10-4a92-bb90-7f7f45a510c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:09.131353 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f370d-fc10-4a92-bb90-7f7f45a510c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:09.132087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f370d-fc10-4a92-bb90-7f7f45a510c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:09.132395 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f370d-fc10-4a92-bb90-7f7f45a510c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:09.133832 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f370d-fc10-4a92-bb90-7f7f45a510c6 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:09.143837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 212/435] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:42:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:09.150107 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d9020-5c77-456a-b581-5ba45f4b6052 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:09.248799 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:09.285960 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d9020-5c77-456a-b581-5ba45f4b6052 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:09.321183 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847fe7a-05ce-4f5f-9df1-8861f3e0e5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:09.321882 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847fe7a-05ce-4f5f-9df1-8861f3e0e5fb None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:09.322225 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847fe7a-05ce-4f5f-9df1-8861f3e0e5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:09.322499 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847fe7a-05ce-4f5f-9df1-8861f3e0e5fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:09.367159 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7c8e2-3049-4364-a5ca-1e321515f092 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:09.367517 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7c8e2-3049-4364-a5ca-1e321515f092 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:09.367719 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7c8e2-3049-4364-a5ca-1e321515f092 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:09.369239 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 213/436] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:09.375752 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb749612-6440-4f96-9af7-4ca1deb94562 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:09.376025 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb749612-6440-4f96-9af7-4ca1deb94562 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:09.376301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb749612-6440-4f96-9af7-4ca1deb94562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:09.395842 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847fe7a-05ce-4f5f-9df1-8861f3e0e5fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:09.397540 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847fe7a-05ce-4f5f-9df1-8861f3e0e5fb None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:09.399167 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-bb749612-6440-4f96-9af7-4ca1deb94562 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:09.400601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-bb749612-6440-4f96-9af7-4ca1deb94562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:09.474141 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:09.495640 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 214/437] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:09.510290 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 224/438] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:42:09.516195 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb749612-6440-4f96-9af7-4ca1deb94562 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:09.521488 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847fe7a-05ce-4f5f-9df1-8861f3e0e5fb None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:09.603327 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:09.652605 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847fe7a-05ce-4f5f-9df1-8861f3e0e5fb None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:09.655072 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb749612-6440-4f96-9af7-4ca1deb94562 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:09.700141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1d684-a7ac-4de1-8517-36cac5f1a69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:09.700820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1d684-a7ac-4de1-8517-36cac5f1a69e None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:09.701273 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1d684-a7ac-4de1-8517-36cac5f1a69e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:09.701557 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1d684-a7ac-4de1-8517-36cac5f1a69e None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:09.703055 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1d684-a7ac-4de1-8517-36cac5f1a69e None admin] RBAC: Authorizing `identity:get_project(project_id=a9647712d7a24fe1831a2c16cfba2abb)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:09.704828 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1d684-a7ac-4de1-8517-36cac5f1a69e None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:09.706579 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1329e40-3abf-4d6d-90d5-fad8a84305e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:09.706732 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 215/439] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:42:09 2022] GET /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:09.707383 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1329e40-3abf-4d6d-90d5-fad8a84305e8 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:09.707669 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1329e40-3abf-4d6d-90d5-fad8a84305e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:09.708054 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1329e40-3abf-4d6d-90d5-fad8a84305e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:09.714073 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1d684-a7ac-4de1-8517-36cac5f1a69e None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:09.722089 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1329e40-3abf-4d6d-90d5-fad8a84305e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:09.727750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-d1329e40-3abf-4d6d-90d5-fad8a84305e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:42:09.727750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:09.727750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:09.727750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:09.727750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:09.727750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:09.727750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:09.727750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:09.727750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:09.727750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:09.727750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:09.727750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:09.727750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:09.727750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:09.727750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:09.727750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:09.728631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:09.728631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:09.728631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:09.728631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:09.728631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:09.728631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:09.728631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:09.728631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:09.728631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:09.728631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:09.728631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:09.728631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:09.728631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:09.728631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:09.728631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:09.728631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:09.729468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:09.729468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:09.729468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:09.729468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:09.729468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:09.729468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:09.729468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:09.729468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:09.729468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:09.729468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:09.729468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:42:09.729468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:09.729468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 225/440] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:42:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:09.735825 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1329e40-3abf-4d6d-90d5-fad8a84305e8 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:09.769193 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:09.834839 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1d684-a7ac-4de1-8517-36cac5f1a69e None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:09.854833 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1329e40-3abf-4d6d-90d5-fad8a84305e8 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:09.875168 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c389b-a8fd-4e13-95f1-299429c4b98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:09.875849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c389b-a8fd-4e13-95f1-299429c4b98e None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:09.876124 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c389b-a8fd-4e13-95f1-299429c4b98e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:09.876395 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c389b-a8fd-4e13-95f1-299429c4b98e None admin] PATH_INFO: `/v3/groups/627a8ca342ea408195b547e766c93a98` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:09.877560 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c389b-a8fd-4e13-95f1-299429c4b98e None admin] RBAC: Authorizing `identity:get_group(group_id=627a8ca342ea408195b547e766c93a98)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:09.878988 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c389b-a8fd-4e13-95f1-299429c4b98e None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:09.880762 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 216/441] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Jul 28 17:42:09 2022] GET /identity/v3/groups/627a8ca342ea408195b547e766c93a98 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:09.886494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c389b-a8fd-4e13-95f1-299429c4b98e None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:09.890659 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:09.895231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71188b14-88fc-4446-bf03-73e15b187e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:09.895934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71188b14-88fc-4446-bf03-73e15b187e87 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:09.896224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71188b14-88fc-4446-bf03-73e15b187e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:09.896539 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71188b14-88fc-4446-bf03-73e15b187e87 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:09.897355 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71188b14-88fc-4446-bf03-73e15b187e87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:09.897658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71188b14-88fc-4446-bf03-73e15b187e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:09.899048 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71188b14-88fc-4446-bf03-73e15b187e87 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:09.907327 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 226/442] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:42:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:09.908455 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ddcd3-5e73-4980-bd2d-515c163a18a1 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:09.908944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ddcd3-5e73-4980-bd2d-515c163a18a1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:09.909180 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ddcd3-5e73-4980-bd2d-515c163a18a1 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:09.910342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 227/443] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:09.913457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ddcd3-5e73-4980-bd2d-515c163a18a1 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:09.986892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c389b-a8fd-4e13-95f1-299429c4b98e None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:10.007557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:10.018657 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ddcd3-5e73-4980-bd2d-515c163a18a1 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:10.024986 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3affe66-e5bd-43b1-baa7-18ed88a0ac6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:10.025648 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3affe66-e5bd-43b1-baa7-18ed88a0ac6b None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:10.025927 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3affe66-e5bd-43b1-baa7-18ed88a0ac6b None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:10.026200 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3affe66-e5bd-43b1-baa7-18ed88a0ac6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:10.027026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3affe66-e5bd-43b1-baa7-18ed88a0ac6b None admin] RBAC: Adding query filter params (group.id=627a8ca342ea408195b547e766c93a98, role.id=1e9bc5b431414d62a974beb13a8f83c7, scope.project.id=a9647712d7a24fe1831a2c16cfba2abb) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:10.027344 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3affe66-e5bd-43b1-baa7-18ed88a0ac6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:10.028811 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3affe66-e5bd-43b1-baa7-18ed88a0ac6b None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:10.034931 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 217/444] 10.222.0.96 () {56 vars in 1376 bytes} [Thu Jul 28 17:42:09 2022] GET /identity/v3/role_assignments?group.id=627a8ca342ea408195b547e766c93a98&scope.project.id=a9647712d7a24fe1831a2c16cfba2abb&role.id=1e9bc5b431414d62a974beb13a8f83c7 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:10.036150 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fafbc-97e6-4c9c-969d-a5137b548518 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:10.036453 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fafbc-97e6-4c9c-969d-a5137b548518 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:10.036750 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fafbc-97e6-4c9c-969d-a5137b548518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:10.056736 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-f42fafbc-97e6-4c9c-969d-a5137b548518 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:10.058276 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f42fafbc-97e6-4c9c-969d-a5137b548518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:10.063160 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd055484-1630-413b-8de9-d9103510cf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:10.063806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd055484-1630-413b-8de9-d9103510cf94 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:10.064085 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd055484-1630-413b-8de9-d9103510cf94 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:10.064358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd055484-1630-413b-8de9-d9103510cf94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:10.129165 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:10.136223 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 218/445] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:10.140669 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd055484-1630-413b-8de9-d9103510cf94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:10.142199 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd055484-1630-413b-8de9-d9103510cf94 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:10.159802 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fafbc-97e6-4c9c-969d-a5137b548518 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:10.253689 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:10.269912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 228/446] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:42:10.270481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fafbc-97e6-4c9c-969d-a5137b548518 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:10.275542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd055484-1630-413b-8de9-d9103510cf94 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:10.309353 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59c6f0-9565-4363-b8c1-5c75c75c0568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:10.310013 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59c6f0-9565-4363-b8c1-5c75c75c0568 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:10.310293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59c6f0-9565-4363-b8c1-5c75c75c0568 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:10.310570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59c6f0-9565-4363-b8c1-5c75c75c0568 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:10.322977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59c6f0-9565-4363-b8c1-5c75c75c0568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:10.327551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-8d59c6f0-9565-4363-b8c1-5c75c75c0568 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:42:10.327551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:10.327551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:10.327551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:10.327551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:10.327551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:10.327551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:10.327551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:10.327551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:10.327551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:10.327551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:10.327551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:10.327551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:10.327551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:10.327551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:10.327551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:10.328430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:10.328430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:10.328430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:10.328430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:10.328430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:10.328430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:10.328430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:10.328430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:10.328430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:10.328430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:10.328430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:10.328430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:10.328430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:10.328430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:10.328430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:10.328430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:10.329286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:10.329286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:10.329286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:10.329286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:10.329286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:10.329286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:10.329286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:10.329286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:10.329286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:10.329286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:10.329286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:42:10.329286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:10.329286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 219/447] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:42:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:42:10.337194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59c6f0-9565-4363-b8c1-5c75c75c0568 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:10.399806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd055484-1630-413b-8de9-d9103510cf94 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:10.410596 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:10.437619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382c17e-250f-4d62-896c-ef0088918f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:10.438614 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382c17e-250f-4d62-896c-ef0088918f61 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:10.438949 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382c17e-250f-4d62-896c-ef0088918f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:10.439227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382c17e-250f-4d62-896c-ef0088918f61 None admin] PATH_INFO: `/v3/projects/84ce091dd3714924a52d3b36bdfb30f4` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:10.440373 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382c17e-250f-4d62-896c-ef0088918f61 None admin] RBAC: Authorizing `identity:get_project(project_id=84ce091dd3714924a52d3b36bdfb30f4)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:10.441868 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382c17e-250f-4d62-896c-ef0088918f61 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:10.443696 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 229/448] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:42:10 2022] GET /identity/v3/projects/84ce091dd3714924a52d3b36bdfb30f4 => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:10.449222 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382c17e-250f-4d62-896c-ef0088918f61 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:10.453369 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59c6f0-9565-4363-b8c1-5c75c75c0568 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:10.487858 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b625f0-c507-488c-b4ce-ffb927b856d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:10.488520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b625f0-c507-488c-b4ce-ffb927b856d3 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:10.488804 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b625f0-c507-488c-b4ce-ffb927b856d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:10.489040 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b625f0-c507-488c-b4ce-ffb927b856d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:10.489962 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b625f0-c507-488c-b4ce-ffb927b856d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:10.490271 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b625f0-c507-488c-b4ce-ffb927b856d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:10.491762 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b625f0-c507-488c-b4ce-ffb927b856d3 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:10.501237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 220/449] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:10.507118 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b625f0-c507-488c-b4ce-ffb927b856d3 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:10.509009 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:10.554620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382c17e-250f-4d62-896c-ef0088918f61 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:10.595599 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab80fe-05ae-4e8e-bb61-84bda2d62bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:10.596299 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab80fe-05ae-4e8e-bb61-84bda2d62bbe None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:10.596574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab80fe-05ae-4e8e-bb61-84bda2d62bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:10.596850 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab80fe-05ae-4e8e-bb61-84bda2d62bbe None admin] PATH_INFO: `/v3/groups/a2d2831f733044ef8667a44a6131e676` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:10.598040 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab80fe-05ae-4e8e-bb61-84bda2d62bbe None admin] RBAC: Authorizing `identity:get_group(group_id=a2d2831f733044ef8667a44a6131e676)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:10.599738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab80fe-05ae-4e8e-bb61-84bda2d62bbe None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:10.601370 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 230/450] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Jul 28 17:42:10 2022] GET /identity/v3/groups/a2d2831f733044ef8667a44a6131e676 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:10.607300 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab80fe-05ae-4e8e-bb61-84bda2d62bbe None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:10.614941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b625f0-c507-488c-b4ce-ffb927b856d3 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:10.635695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:10.650831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75a8f3-2493-4881-8346-5db2f80a5ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:10.651549 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75a8f3-2493-4881-8346-5db2f80a5ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:10.651831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75a8f3-2493-4881-8346-5db2f80a5ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:10.652094 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75a8f3-2493-4881-8346-5db2f80a5ff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:10.712670 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab80fe-05ae-4e8e-bb61-84bda2d62bbe None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:10.719466 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75a8f3-2493-4881-8346-5db2f80a5ff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:10.720942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75a8f3-2493-4881-8346-5db2f80a5ff8 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:10.739928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:10.750425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38955d13-7f58-4a9c-8a4e-e8b5143536b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:10.751050 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38955d13-7f58-4a9c-8a4e-e8b5143536b4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:10.751331 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38955d13-7f58-4a9c-8a4e-e8b5143536b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:10.751602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38955d13-7f58-4a9c-8a4e-e8b5143536b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:10.752381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38955d13-7f58-4a9c-8a4e-e8b5143536b4 None admin] RBAC: Adding query filter params (group.id=a2d2831f733044ef8667a44a6131e676, role.id=980cae90acae42189f92fd6dd42867a5, scope.project.id=84ce091dd3714924a52d3b36bdfb30f4) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:10.752692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38955d13-7f58-4a9c-8a4e-e8b5143536b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:10.754153 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38955d13-7f58-4a9c-8a4e-e8b5143536b4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:10.760652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 231/451] 10.222.0.96 () {56 vars in 1376 bytes} [Thu Jul 28 17:42:10 2022] GET /identity/v3/role_assignments?group.id=a2d2831f733044ef8667a44a6131e676&scope.project.id=84ce091dd3714924a52d3b36bdfb30f4&role.id=980cae90acae42189f92fd6dd42867a5 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:10.824971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 221/452] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:42:10.830964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38955d13-7f58-4a9c-8a4e-e8b5143536b4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:10.940365 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38955d13-7f58-4a9c-8a4e-e8b5143536b4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:10.977338 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a801bb-5550-44f3-a12e-39fd3a5bef56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:10.977927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a801bb-5550-44f3-a12e-39fd3a5bef56 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:10.978211 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a801bb-5550-44f3-a12e-39fd3a5bef56 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:10.978490 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a801bb-5550-44f3-a12e-39fd3a5bef56 None admin] PATH_INFO: `/v3/projects/a9647712d7a24fe1831a2c16cfba2abb` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:10.979685 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a801bb-5550-44f3-a12e-39fd3a5bef56 None admin] RBAC: Authorizing `identity:get_project(project_id=a9647712d7a24fe1831a2c16cfba2abb)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:10.981174 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a801bb-5550-44f3-a12e-39fd3a5bef56 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:10.982862 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 232/453] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:42:10 2022] GET /identity/v3/projects/a9647712d7a24fe1831a2c16cfba2abb => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:10.988623 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75a8f3-2493-4881-8346-5db2f80a5ff8 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:11.018064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:11.114164 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75a8f3-2493-4881-8346-5db2f80a5ff8 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:11.151549 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c182dc-ef7c-4d6f-89f8-9a745c18bb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:11.152185 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c182dc-ef7c-4d6f-89f8-9a745c18bb6b None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:11.152453 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c182dc-ef7c-4d6f-89f8-9a745c18bb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:11.152723 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c182dc-ef7c-4d6f-89f8-9a745c18bb6b None admin] PATH_INFO: `/v3/groups/627a8ca342ea408195b547e766c93a98` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:11.153968 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c182dc-ef7c-4d6f-89f8-9a745c18bb6b None admin] RBAC: Authorizing `identity:get_group(group_id=627a8ca342ea408195b547e766c93a98)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:11.155414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c182dc-ef7c-4d6f-89f8-9a745c18bb6b None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:11.156996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 222/454] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Jul 28 17:42:10 2022] GET /identity/v3/groups/627a8ca342ea408195b547e766c93a98 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:11.163255 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a801bb-5550-44f3-a12e-39fd3a5bef56 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:11.229200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:11.276896 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a801bb-5550-44f3-a12e-39fd3a5bef56 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:11.319489 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ef717-ba2d-4498-acf7-467f0d99f669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:11.320384 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ef717-ba2d-4498-acf7-467f0d99f669 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:11.320751 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ef717-ba2d-4498-acf7-467f0d99f669 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:11.321125 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ef717-ba2d-4498-acf7-467f0d99f669 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:11.322379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ef717-ba2d-4498-acf7-467f0d99f669 None admin] RBAC: Adding query filter params (group.id=627a8ca342ea408195b547e766c93a98, role.id=5b95c3aebc8041c7885a9234a9e54d7c, scope.project.id=a9647712d7a24fe1831a2c16cfba2abb) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:11.322813 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ef717-ba2d-4498-acf7-467f0d99f669 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:11.325092 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ef717-ba2d-4498-acf7-467f0d99f669 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:11.334108 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 233/455] 10.222.0.96 () {56 vars in 1376 bytes} [Thu Jul 28 17:42:11 2022] GET /identity/v3/role_assignments?group.id=627a8ca342ea408195b547e766c93a98&scope.project.id=a9647712d7a24fe1831a2c16cfba2abb&role.id=5b95c3aebc8041c7885a9234a9e54d7c => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:13.831447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada75dec-3291-4093-9dd5-36129de53342 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:13.831978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada75dec-3291-4093-9dd5-36129de53342 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:13.832053 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada75dec-3291-4093-9dd5-36129de53342 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:13.833703 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 223/456] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:13.839228 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0e628-8074-4a57-ae2a-98a294a9a08a None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:13.840110 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0e628-8074-4a57-ae2a-98a294a9a08a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:13.840543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0e628-8074-4a57-ae2a-98a294a9a08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:13.870139 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-8fe0e628-8074-4a57-ae2a-98a294a9a08a None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:13.871808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8fe0e628-8074-4a57-ae2a-98a294a9a08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:13.959032 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 234/457] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:13.983109 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a6960-41bd-4b34-88fc-45aea43a8411 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:13.983725 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a6960-41bd-4b34-88fc-45aea43a8411 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:13.984197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a6960-41bd-4b34-88fc-45aea43a8411 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:13.986014 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 224/458] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:13.991647 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd75ee2-62f8-4fa8-993d-6f0cf6466b76 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:13.991929 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd75ee2-62f8-4fa8-993d-6f0cf6466b76 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:13.992198 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd75ee2-62f8-4fa8-993d-6f0cf6466b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:13.997597 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a6960-41bd-4b34-88fc-45aea43a8411 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:14.031550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-cbd75ee2-62f8-4fa8-993d-6f0cf6466b76 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:14.032897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-cbd75ee2-62f8-4fa8-993d-6f0cf6466b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:14.101861 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:14.116967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a6960-41bd-4b34-88fc-45aea43a8411 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:14.150216 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:14.154452 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbcf46-6997-43bd-9f6b-7d88bc8ff194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:14.155370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbcf46-6997-43bd-9f6b-7d88bc8ff194 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:14.155783 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbcf46-6997-43bd-9f6b-7d88bc8ff194 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:14.156198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbcf46-6997-43bd-9f6b-7d88bc8ff194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:14.169029 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbcf46-6997-43bd-9f6b-7d88bc8ff194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:14.170815 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbcf46-6997-43bd-9f6b-7d88bc8ff194 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:14.188904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-e0dbcf46-6997-43bd-9f6b-7d88bc8ff194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:14.188904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:14.188904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:14.188904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:14.188904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:14.188904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:14.188904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:14.188904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:14.188904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:14.188904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:14.188904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:14.188904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:14.188904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:14.188904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:14.188904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:14.189996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:14.189996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:14.189996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:14.189996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:14.189996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:14.189996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:14.189996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:14.189996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:14.189996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:14.189996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:14.189996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:14.189996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:14.189996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:14.189996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:14.189996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:14.189996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:14.189996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:14.190967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:14.190967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:14.190967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:14.190967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:14.193417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 225/459] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:14.199444 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 235/460] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:14.200570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbcf46-6997-43bd-9f6b-7d88bc8ff194 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:14.209087 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4395b6-3319-45c1-b6fc-c83774ad7ab6 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:14.209785 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4395b6-3319-45c1-b6fc-c83774ad7ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:14.210354 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4395b6-3319-45c1-b6fc-c83774ad7ab6 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:14.212282 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 236/461] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:42:14.217988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb6aff-0eb2-4ed6-84e2-32b238a4982d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:14.218999 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb6aff-0eb2-4ed6-84e2-32b238a4982d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:14.219467 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb6aff-0eb2-4ed6-84e2-32b238a4982d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:14.246165 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-4fbb6aff-0eb2-4ed6-84e2-32b238a4982d None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:14.248959 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4fbb6aff-0eb2-4ed6-84e2-32b238a4982d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:14.319651 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbcf46-6997-43bd-9f6b-7d88bc8ff194 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:14.337165 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 237/462] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:42:14.338394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb6aff-0eb2-4ed6-84e2-32b238a4982d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:14.362469 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb53f89-d64e-4873-b560-4e4e5ce4078b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:14.364329 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb53f89-d64e-4873-b560-4e4e5ce4078b None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:14.364608 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb53f89-d64e-4873-b560-4e4e5ce4078b None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:14.364954 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb53f89-d64e-4873-b560-4e4e5ce4078b None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:14.365899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb53f89-d64e-4873-b560-4e4e5ce4078b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:14.366204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb53f89-d64e-4873-b560-4e4e5ce4078b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:14.369452 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb53f89-d64e-4873-b560-4e4e5ce4078b None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:14.381224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:14.387840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 226/463] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:14.389605 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb53f89-d64e-4873-b560-4e4e5ce4078b None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:14.478707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb6aff-0eb2-4ed6-84e2-32b238a4982d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:14.498311 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:14.507196 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb53f89-d64e-4873-b560-4e4e5ce4078b None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:14.527307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a2aa6-7da0-4175-a15c-ea4a8694c89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:14.527967 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a2aa6-7da0-4175-a15c-ea4a8694c89d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:14.528246 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a2aa6-7da0-4175-a15c-ea4a8694c89d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:14.528518 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a2aa6-7da0-4175-a15c-ea4a8694c89d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:14.540073 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a2aa6-7da0-4175-a15c-ea4a8694c89d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:14.541543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a2aa6-7da0-4175-a15c-ea4a8694c89d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:14.556270 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f836b-4986-4be7-9cf7-f90894ec2d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:14.557357 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f836b-4986-4be7-9cf7-f90894ec2d47 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:14.557872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f836b-4986-4be7-9cf7-f90894ec2d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:14.558114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-f54a2aa6-7da0-4175-a15c-ea4a8694c89d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:14.558114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:14.558114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:14.558114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:14.558114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:14.558114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:14.558114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:14.558114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:14.558114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:14.558114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:14.558114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:14.558114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:14.558114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:14.558114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:14.558114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:14.558925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:14.558925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:14.558925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:14.558925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:14.558925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:14.558925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:14.558925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:14.558925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:14.558925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:14.558925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:14.558925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:14.558925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:14.558925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:14.558925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:14.558925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:14.558925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:14.558925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:14.560206 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:14.560206 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:14.560206 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:14.560206 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:14.560206 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 238/464] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:14.560206 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a2aa6-7da0-4175-a15c-ea4a8694c89d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:14.561155 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f836b-4986-4be7-9cf7-f90894ec2d47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:14.575589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f836b-4986-4be7-9cf7-f90894ec2d47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:14.578071 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f836b-4986-4be7-9cf7-f90894ec2d47 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:14.609745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-d69f836b-4986-4be7-9cf7-f90894ec2d47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:14.609745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:14.609745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:14.609745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:14.609745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:14.609745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:14.609745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:14.609745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:14.609745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:14.609745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:14.609745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:14.609745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:14.609745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:14.609745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:14.609745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:14.611065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:14.611065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:14.611065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:14.611065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:14.611065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:14.611065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:14.611065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:14.611065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:14.611065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:14.611065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:14.611065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:14.611065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:14.611065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:14.611065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:14.611065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:14.611065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:14.611065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:14.612650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:14.612650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:14.612650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:14.612650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:14.616291 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 227/465] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:14.616291 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f836b-4986-4be7-9cf7-f90894ec2d47 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:14.693113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:14.713510 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a2aa6-7da0-4175-a15c-ea4a8694c89d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:14.750980 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1f0f2-f9ad-4b70-a322-0eabcb09292c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:14.751751 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1f0f2-f9ad-4b70-a322-0eabcb09292c None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:14.752117 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1f0f2-f9ad-4b70-a322-0eabcb09292c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:14.752381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1f0f2-f9ad-4b70-a322-0eabcb09292c None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:14.753195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1f0f2-f9ad-4b70-a322-0eabcb09292c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:14.754725 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1f0f2-f9ad-4b70-a322-0eabcb09292c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:14.757829 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f836b-4986-4be7-9cf7-f90894ec2d47 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:14.779607 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 239/466] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Jul 28 17:42:14 2022] POST /identity/v3/users => generated 246 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:42:14.781186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1f0f2-f9ad-4b70-a322-0eabcb09292c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:14.796154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb543bc-81c3-41bb-858d-002f6c91c9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:14.797167 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb543bc-81c3-41bb-858d-002f6c91c9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:14.797584 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb543bc-81c3-41bb-858d-002f6c91c9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:14.797993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb543bc-81c3-41bb-858d-002f6c91c9d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:14.798846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb543bc-81c3-41bb-858d-002f6c91c9d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:14.799289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb543bc-81c3-41bb-858d-002f6c91c9d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:14.800922 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb543bc-81c3-41bb-858d-002f6c91c9d7 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:14.814353 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:14.816148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 228/467] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:14.818023 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f4b54-1dbb-4f8c-b225-1ea1449d8c3f None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:14.818533 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f4b54-1dbb-4f8c-b225-1ea1449d8c3f None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:14.819084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f4b54-1dbb-4f8c-b225-1ea1449d8c3f None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:14.820634 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 229/468] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:14.825900 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f4b54-1dbb-4f8c-b225-1ea1449d8c3f None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:14.913927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1f0f2-f9ad-4b70-a322-0eabcb09292c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:14.962018 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ac1b4-14d4-4eba-a3f6-98d839f98848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:14.962618 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ac1b4-14d4-4eba-a3f6-98d839f98848 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:14.962899 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ac1b4-14d4-4eba-a3f6-98d839f98848 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:14.963169 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ac1b4-14d4-4eba-a3f6-98d839f98848 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:14.964499 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ac1b4-14d4-4eba-a3f6-98d839f98848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:14.964499 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ac1b4-14d4-4eba-a3f6-98d839f98848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:14.965923 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ac1b4-14d4-4eba-a3f6-98d839f98848 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:14.976293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f4b54-1dbb-4f8c-b225-1ea1449d8c3f None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:14.979674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 240/469] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:14.980521 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe67b65-0305-40d2-8e86-dee958965dee None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:14.980807 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe67b65-0305-40d2-8e86-dee958965dee None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:14.982042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe67b65-0305-40d2-8e86-dee958965dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:14.997938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:15.002220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-bfe67b65-0305-40d2-8e86-dee958965dee None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:15.003260 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-bfe67b65-0305-40d2-8e86-dee958965dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:15.035044 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f033ed-a0b4-459c-80d8-9fa21468cf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:15.035678 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f033ed-a0b4-459c-80d8-9fa21468cf4b None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:15.035953 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f033ed-a0b4-459c-80d8-9fa21468cf4b None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:15.036223 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f033ed-a0b4-459c-80d8-9fa21468cf4b None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:15.038546 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f033ed-a0b4-459c-80d8-9fa21468cf4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:15.041101 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f033ed-a0b4-459c-80d8-9fa21468cf4b None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:15.075573 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 230/470] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Jul 28 17:42:14 2022] POST /identity/v3/users => generated 248 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:42:15.077101 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f033ed-a0b4-459c-80d8-9fa21468cf4b None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:15.141032 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 241/471] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:15.183489 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe67b65-0305-40d2-8e86-dee958965dee None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:15.200994 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f033ed-a0b4-459c-80d8-9fa21468cf4b None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:15.209983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:15.239377 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b26e52-ed0c-47c4-bd93-91f922744a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:15.240107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b26e52-ed0c-47c4-bd93-91f922744a82 None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:15.240441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b26e52-ed0c-47c4-bd93-91f922744a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:15.240785 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b26e52-ed0c-47c4-bd93-91f922744a82 None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:15.241997 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b26e52-ed0c-47c4-bd93-91f922744a82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:15.243581 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b26e52-ed0c-47c4-bd93-91f922744a82 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:15.272025 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 231/472] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Jul 28 17:42:15 2022] POST /identity/v3/users => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:42:15.378956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe67b65-0305-40d2-8e86-dee958965dee None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:15.416842 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb89ab9-f596-49ea-93f7-00ee3724837d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:15.417553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb89ab9-f596-49ea-93f7-00ee3724837d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:15.417832 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb89ab9-f596-49ea-93f7-00ee3724837d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:15.418108 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb89ab9-f596-49ea-93f7-00ee3724837d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:15.429893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb89ab9-f596-49ea-93f7-00ee3724837d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:15.431413 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb89ab9-f596-49ea-93f7-00ee3724837d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:15.449361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-bfb89ab9-f596-49ea-93f7-00ee3724837d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:15.449361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:15.449361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:15.449361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:15.449361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:15.449361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:15.449361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:15.449361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:15.449361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:15.449361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:15.449361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:15.449361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:15.449361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:15.449361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:15.449361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:15.450240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:15.450240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:15.450240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:15.450240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:15.450240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:15.450240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:15.450240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:15.450240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:15.450240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:15.450240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:15.450240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:15.450240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:15.450240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:15.450240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:15.450240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:15.450240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:15.450240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:15.451073 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:15.451073 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:15.451073 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:15.451073 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:15.451073 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 242/473] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:15.458002 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b26e52-ed0c-47c4-bd93-91f922744a82 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:15.485485 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:15.503880 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdb1ff-7c68-4cc4-9508-a4fef2e44466 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:15.504162 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdb1ff-7c68-4cc4-9508-a4fef2e44466 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:15.504574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdb1ff-7c68-4cc4-9508-a4fef2e44466 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:15.506657 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 243/474] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:42:15.512823 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe132d-b6da-4ab5-b698-e45bb0a5e0de None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:15.513521 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe132d-b6da-4ab5-b698-e45bb0a5e0de None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:15.513800 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe132d-b6da-4ab5-b698-e45bb0a5e0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:15.535197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-73fe132d-b6da-4ab5-b698-e45bb0a5e0de None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:15.536424 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-73fe132d-b6da-4ab5-b698-e45bb0a5e0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:15.596893 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b26e52-ed0c-47c4-bd93-91f922744a82 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:15.613924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:15.629101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 244/475] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:42:15.650762 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6828ff-2362-4d16-a397-83e3c79c5f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:15.651759 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6828ff-2362-4d16-a397-83e3c79c5f47 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:15.652234 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6828ff-2362-4d16-a397-83e3c79c5f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:15.652724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6828ff-2362-4d16-a397-83e3c79c5f47 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:15.653708 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6828ff-2362-4d16-a397-83e3c79c5f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:15.654225 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6828ff-2362-4d16-a397-83e3c79c5f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:15.655873 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6828ff-2362-4d16-a397-83e3c79c5f47 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:15.656264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe132d-b6da-4ab5-b698-e45bb0a5e0de None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:15.676008 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 232/476] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:15.686381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6828ff-2362-4d16-a397-83e3c79c5f47 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:15.811305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe132d-b6da-4ab5-b698-e45bb0a5e0de None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:15.828193 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:15.845899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6828ff-2362-4d16-a397-83e3c79c5f47 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:15.855840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8175f-c492-4b07-a72c-ea9eaafed675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:15.856473 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8175f-c492-4b07-a72c-ea9eaafed675 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:15.856777 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8175f-c492-4b07-a72c-ea9eaafed675 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:15.857281 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8175f-c492-4b07-a72c-ea9eaafed675 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:15.857854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8175f-c492-4b07-a72c-ea9eaafed675 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:15.859247 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8175f-c492-4b07-a72c-ea9eaafed675 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:15.869147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.sql.core [None req-7db8175f-c492-4b07-a72c-ea9eaafed675 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 17:42:15.869147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 17:42:15.869147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [parameters: {'id': 'f558b4074c584a14b18157c3582f3cee', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 17:42:15.869147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80310) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 17:42:15.886866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-7db8175f-c492-4b07-a72c-ea9eaafed675 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 17:42:15.886866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:15.886866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 17:42:15.886866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 17:42:15.886866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 17:42:15.886866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 17:42:15.886866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 17:42:15.886866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 17:42:15.886866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 17:42:15.886866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application conn.query(q) Jul 28 17:42:15.886866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 17:42:15.886866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 17:42:15.886866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 17:42:15.886866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application result.read() Jul 28 17:42:15.886866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 17:42:15.887766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 17:42:15.887766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 17:42:15.887766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 17:42:15.887766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 17:42:15.887766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 17:42:15.887766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 17:42:15.887766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 17:42:15.887766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 17:42:15.887766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:15.887766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 17:42:15.887766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:15.887766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:15.887766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 17:42:15.887766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 17:42:15.887766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 28 17:42:15.887766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return ref.to_dict() Jul 28 17:42:15.887766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 17:42:15.887766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application next(self.gen) Jul 28 17:42:15.888998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 17:42:15.888998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application yield resource Jul 28 17:42:15.888998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 17:42:15.888998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application next(self.gen) Jul 28 17:42:15.888998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 17:42:15.888998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 17:42:15.888998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 17:42:15.888998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 17:42:15.888998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 17:42:15.888998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise self.value Jul 28 17:42:15.888998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 17:42:15.888998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 17:42:15.888998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 17:42:15.888998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application session.commit() Jul 28 17:42:15.888998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 17:42:15.888998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 17:42:15.888998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 17:42:15.889871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 17:42:15.889871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 17:42:15.889871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.session.flush() Jul 28 17:42:15.889871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 17:42:15.889871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 17:42:15.889871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 17:42:15.889871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 17:42:15.889871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 17:42:15.889871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application compat.raise_( Jul 28 17:42:15.889871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 17:42:15.889871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception Jul 28 17:42:15.889871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 17:42:15.889871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 17:42:15.889871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 17:42:15.889871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 17:42:15.889871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 17:42:15.889871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 17:42:15.890735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 17:42:15.890735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 17:42:15.890735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 17:42:15.890735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 17:42:15.890735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 17:42:15.890735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 17:42:15.890735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 17:42:15.890735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 17:42:15.890735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 17:42:15.890735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 17:42:15.890735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 17:42:15.890735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 17:42:15.890735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 17:42:15.890735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 17:42:15.890735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 17:42:15.890735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception Jul 28 17:42:15.891542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 17:42:15.891542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 17:42:15.891542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 17:42:15.891542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 17:42:15.891542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 17:42:15.891542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 17:42:15.891542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 17:42:15.891542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application conn.query(q) Jul 28 17:42:15.891542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 17:42:15.891542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 17:42:15.891542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 17:42:15.891542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application result.read() Jul 28 17:42:15.891542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 17:42:15.891542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 17:42:15.891542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 17:42:15.891542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 17:42:15.892315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 17:42:15.892315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 17:42:15.892315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 17:42:15.892315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 17:42:15.892315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 17:42:15.892315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 17:42:15.892315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [parameters: {'id': 'f558b4074c584a14b18157c3582f3cee', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 17:42:15.892315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 17:42:15.892315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:15.892315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:42:15.892315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:15.892315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:15.892315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:15.892315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:15.892315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:15.892315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:15.894363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:15.894363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:15.894363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:15.894363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:15.894363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:15.894363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:15.894363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 28 17:42:15.894363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 28 17:42:15.894363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:15.894363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:15.894363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 28 17:42:15.894363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 28 17:42:15.894363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 17:42:15.894363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 17:42:15.894363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 17:42:15.894363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:15.896426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 245/477] 10.222.0.96 () {60 vars in 1131 bytes} [Thu Jul 28 17:42:15 2022] POST /identity/v3/roles => generated 144 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:42:15.896426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8175f-c492-4b07-a72c-ea9eaafed675 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:15.907159 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed0376-8757-4f9d-b2d0-3402416bb837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:15.908081 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed0376-8757-4f9d-b2d0-3402416bb837 None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:15.908645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed0376-8757-4f9d-b2d0-3402416bb837 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:15.909132 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed0376-8757-4f9d-b2d0-3402416bb837 None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:15.910033 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed0376-8757-4f9d-b2d0-3402416bb837 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:15.911737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed0376-8757-4f9d-b2d0-3402416bb837 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:15.951888 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 233/478] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Jul 28 17:42:15 2022] POST /identity/v3/users => generated 249 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:42:15.960733 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:16.019868 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8175f-c492-4b07-a72c-ea9eaafed675 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:16.058616 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a516afd-c5b9-4570-8497-9958190ea4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:16.059426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a516afd-c5b9-4570-8497-9958190ea4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:16.059709 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a516afd-c5b9-4570-8497-9958190ea4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:16.059985 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a516afd-c5b9-4570-8497-9958190ea4f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:16.072092 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a516afd-c5b9-4570-8497-9958190ea4f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:16.077237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-0a516afd-c5b9-4570-8497-9958190ea4f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:42:16.077237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:16.077237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:16.077237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:16.077237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:16.077237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:16.077237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:16.077237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:16.077237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:16.077237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:16.077237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:16.077237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:16.077237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:16.077237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:16.077237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:16.077237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:16.078177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:16.078177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:16.078177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:16.078177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:16.078177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:16.078177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:16.078177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:16.078177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:16.078177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:16.078177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:16.078177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:16.078177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:16.078177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:16.078177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:16.078177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:16.078177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:16.078966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:16.078966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:16.078966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:16.078966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:16.078966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:16.078966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:16.078966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:16.078966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:16.078966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:16.078966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:16.078966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:42:16.078966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:16.078966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 246/479] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:42:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:42:16.084931 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed0376-8757-4f9d-b2d0-3402416bb837 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:16.237520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed0376-8757-4f9d-b2d0-3402416bb837 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:16.283648 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2159f7-f011-4f18-a19c-a3ecec6b09a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:16.284300 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2159f7-f011-4f18-a19c-a3ecec6b09a7 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:16.284579 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2159f7-f011-4f18-a19c-a3ecec6b09a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:16.284850 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2159f7-f011-4f18-a19c-a3ecec6b09a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:16.285831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2159f7-f011-4f18-a19c-a3ecec6b09a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:16.286134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2159f7-f011-4f18-a19c-a3ecec6b09a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:16.287585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2159f7-f011-4f18-a19c-a3ecec6b09a7 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:16.300579 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 234/480] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:17.180627 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca46605-a3e4-4d69-9e0b-6f2b515f306c None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:17.181171 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca46605-a3e4-4d69-9e0b-6f2b515f306c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:17.181274 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca46605-a3e4-4d69-9e0b-6f2b515f306c None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:17.182814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 247/481] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:17.189787 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdd809-6dc8-4f5b-b539-a79382677c2b None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:17.190201 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdd809-6dc8-4f5b-b539-a79382677c2b None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:17.190375 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdd809-6dc8-4f5b-b539-a79382677c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:17.200528 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:17.216030 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-bbbdd809-6dc8-4f5b-b539-a79382677c2b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:17.217308 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-bbbdd809-6dc8-4f5b-b539-a79382677c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:17.310186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 235/482] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:17.345714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca46605-a3e4-4d69-9e0b-6f2b515f306c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:17.494356 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca46605-a3e4-4d69-9e0b-6f2b515f306c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:17.518836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:17.542975 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aef71a-7aa8-4867-835a-332cb26d9fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:17.543694 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aef71a-7aa8-4867-835a-332cb26d9fce None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:17.543969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aef71a-7aa8-4867-835a-332cb26d9fce None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:17.544240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aef71a-7aa8-4867-835a-332cb26d9fce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:17.564946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aef71a-7aa8-4867-835a-332cb26d9fce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:17.569966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-63aef71a-7aa8-4867-835a-332cb26d9fce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:17.569966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:17.569966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:17.569966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:17.569966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:17.569966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:17.569966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:17.569966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:17.569966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:17.569966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:17.569966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:17.569966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:17.569966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:17.569966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:17.569966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:17.569966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:17.570814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:17.570814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:17.570814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:17.570814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:17.570814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:17.570814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:17.570814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:17.570814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:17.570814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:17.570814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:17.570814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:17.570814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:17.570814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:17.570814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:17.570814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:17.570814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:17.571590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:17.571590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:17.571590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:17.571590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:17.571590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:17.571590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:17.571590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:17.571590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:17.571590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:17.571590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:17.571590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:17.571590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:17.571590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 248/483] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:42:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:17.577414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdd809-6dc8-4f5b-b539-a79382677c2b None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:17.730445 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdd809-6dc8-4f5b-b539-a79382677c2b None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:17.769352 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:17.775090 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b471c-3b0b-4530-a770-b72c62f28f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:17.775719 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b471c-3b0b-4530-a770-b72c62f28f29 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:17.775997 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b471c-3b0b-4530-a770-b72c62f28f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:17.776271 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b471c-3b0b-4530-a770-b72c62f28f29 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:17.777000 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b471c-3b0b-4530-a770-b72c62f28f29 None admin] RBAC: Adding query filter params (name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:17.777332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b471c-3b0b-4530-a770-b72c62f28f29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:17.778868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b471c-3b0b-4530-a770-b72c62f28f29 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:17.795319 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 236/484] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Jul 28 17:42:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:17.800770 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aef71a-7aa8-4867-835a-332cb26d9fce None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:17.861420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6056d87-2eaa-4a02-bf11-a61140b301dc None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:17.861773 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6056d87-2eaa-4a02-bf11-a61140b301dc None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:17.861993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6056d87-2eaa-4a02-bf11-a61140b301dc None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:17.863629 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 237/485] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:42:17.868782 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3229a03-47ab-4d83-ab04-959d03d265de None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:17.869078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3229a03-47ab-4d83-ab04-959d03d265de None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:17.869366 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3229a03-47ab-4d83-ab04-959d03d265de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:17.892126 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-b3229a03-47ab-4d83-ab04-959d03d265de None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:17.893435 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b3229a03-47ab-4d83-ab04-959d03d265de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:17.938147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aef71a-7aa8-4867-835a-332cb26d9fce None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:17.969228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 238/486] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:42:17.971058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd86275-3222-4e12-bc1b-d46f9fae3ca8 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:17.971436 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd86275-3222-4e12-bc1b-d46f9fae3ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:17.971801 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd86275-3222-4e12-bc1b-d46f9fae3ca8 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:17.973535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 239/487] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:17.979111 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf6bd5-02f2-45e6-9f8b-d6917f5beaae None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:17.979493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf6bd5-02f2-45e6-9f8b-d6917f5beaae None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:17.979865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf6bd5-02f2-45e6-9f8b-d6917f5beaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:17.984643 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b8bf8-08e1-49d9-9672-fae5efc06ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:17.985327 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b8bf8-08e1-49d9-9672-fae5efc06ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:17.985608 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b8bf8-08e1-49d9-9672-fae5efc06ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:17.985919 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b8bf8-08e1-49d9-9672-fae5efc06ed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:18.003486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-60cf6bd5-02f2-45e6-9f8b-d6917f5beaae None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:18.003674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b8bf8-08e1-49d9-9672-fae5efc06ed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:18.004877 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-60cf6bd5-02f2-45e6-9f8b-d6917f5beaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:18.005161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b8bf8-08e1-49d9-9672-fae5efc06ed1 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:18.022257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-599b8bf8-08e1-49d9-9672-fae5efc06ed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:18.022257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:18.022257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:18.022257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:18.022257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:18.022257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:18.022257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:18.022257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:18.022257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:18.022257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:18.022257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:18.022257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:18.022257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:18.022257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:18.022257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:18.023094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:18.023094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:18.023094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:18.023094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:18.023094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:18.023094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:18.023094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:18.023094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:18.023094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:18.023094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:18.023094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:18.023094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:18.023094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:18.023094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:18.023094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:18.023094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:18.023094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:18.024478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:18.024478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:18.024478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:18.024478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:18.024478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 249/488] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:18.024752 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b8bf8-08e1-49d9-9672-fae5efc06ed1 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:18.056322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:18.079735 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 240/489] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:42:18.085169 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf6bd5-02f2-45e6-9f8b-d6917f5beaae None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:18.149536 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:18.157143 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b8bf8-08e1-49d9-9672-fae5efc06ed1 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:18.192357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa53043-dd4b-486f-8494-76ec8b0e1b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:18.193869 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa53043-dd4b-486f-8494-76ec8b0e1b47 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:18.194396 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa53043-dd4b-486f-8494-76ec8b0e1b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:18.194859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa53043-dd4b-486f-8494-76ec8b0e1b47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:18.200062 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf6bd5-02f2-45e6-9f8b-d6917f5beaae None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:18.206200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa53043-dd4b-486f-8494-76ec8b0e1b47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:18.212586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-baa53043-dd4b-486f-8494-76ec8b0e1b47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:18.212586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:18.212586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:18.212586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:18.212586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:18.212586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:18.212586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:18.212586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:18.212586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:18.212586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:18.212586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:18.212586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:18.212586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:18.212586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:18.212586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:18.212586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:18.213553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:18.213553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:18.213553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:18.213553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:18.213553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:18.213553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:18.213553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:18.213553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:18.213553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:18.213553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:18.213553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:18.213553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:18.213553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:18.213553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:18.213553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:18.213553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:18.214339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:18.214339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:18.214339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:18.214339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:18.214339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:18.214339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:18.214339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:18.214339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:18.214339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:18.214339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:18.214339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:18.214339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:18.217019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 250/490] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:42:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:18.218031 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa53043-dd4b-486f-8494-76ec8b0e1b47 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:18.250191 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b050424-3e7c-48ad-9b6c-13eeab58a212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:18.250821 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b050424-3e7c-48ad-9b6c-13eeab58a212 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:18.251100 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b050424-3e7c-48ad-9b6c-13eeab58a212 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:18.251470 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b050424-3e7c-48ad-9b6c-13eeab58a212 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:18.252184 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b050424-3e7c-48ad-9b6c-13eeab58a212 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:18.252811 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b050424-3e7c-48ad-9b6c-13eeab58a212 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:18.254156 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b050424-3e7c-48ad-9b6c-13eeab58a212 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:18.268173 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 241/491] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:18.269270 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b050424-3e7c-48ad-9b6c-13eeab58a212 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:18.316542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:18.331354 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa53043-dd4b-486f-8494-76ec8b0e1b47 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:18.366545 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fabb9-72a0-4acf-a7cd-547d67f94241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:18.367573 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fabb9-72a0-4acf-a7cd-547d67f94241 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:18.368056 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fabb9-72a0-4acf-a7cd-547d67f94241 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:18.368543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fabb9-72a0-4acf-a7cd-547d67f94241 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:18.379419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fabb9-72a0-4acf-a7cd-547d67f94241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:18.385275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-661fabb9-72a0-4acf-a7cd-547d67f94241 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:18.385275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:18.385275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:18.385275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:18.385275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:18.385275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:18.385275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:18.385275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:18.385275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:18.385275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:18.385275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:18.385275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:18.385275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:18.385275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:18.385275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:18.385275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:18.386147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:18.386147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:18.386147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:18.386147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:18.386147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:18.386147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:18.386147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:18.386147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:18.386147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:18.386147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:18.386147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:18.386147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:18.386147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:18.386147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:18.386147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:18.386147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:18.386953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:18.386953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:18.386953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:18.386953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:18.386953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:18.386953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:18.386953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:18.386953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:18.386953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:18.386953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:18.386953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:18.386953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:18.387552 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b050424-3e7c-48ad-9b6c-13eeab58a212 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:18.394588 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 251/492] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:42:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:18.395797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fabb9-72a0-4acf-a7cd-547d67f94241 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:18.403284 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:18.427276 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc12ec1-add9-4003-8087-977ef36160b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:18.428785 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc12ec1-add9-4003-8087-977ef36160b0 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:18.429154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc12ec1-add9-4003-8087-977ef36160b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:18.429502 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc12ec1-add9-4003-8087-977ef36160b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:18.430163 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc12ec1-add9-4003-8087-977ef36160b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:18.430473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc12ec1-add9-4003-8087-977ef36160b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:18.432256 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc12ec1-add9-4003-8087-977ef36160b0 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:18.446771 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 242/493] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Jul 28 17:42:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:18.447677 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc12ec1-add9-4003-8087-977ef36160b0 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:18.506693 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fabb9-72a0-4acf-a7cd-547d67f94241 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:18.543489 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbad72-68b8-4bf6-93d8-752c4a823631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:18.544586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbad72-68b8-4bf6-93d8-752c4a823631 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:18.545215 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbad72-68b8-4bf6-93d8-752c4a823631 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:18.545692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbad72-68b8-4bf6-93d8-752c4a823631 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:18.555352 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbad72-68b8-4bf6-93d8-752c4a823631 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:18.557100 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbad72-68b8-4bf6-93d8-752c4a823631 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:18.561584 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc12ec1-add9-4003-8087-977ef36160b0 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:18.571109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-99cbad72-68b8-4bf6-93d8-752c4a823631 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:42:18.571109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:18.571109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:18.571109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:18.571109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:18.571109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:18.571109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:18.571109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:18.571109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:18.571109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:18.571109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:18.571109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:18.571109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:18.571109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:18.571109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:18.571109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:18.572061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:18.572061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:18.572061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:18.572061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:18.572061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:18.572061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:18.572061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:18.572061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:18.572061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:18.572061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:18.572061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:18.572061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:18.572061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:18.572061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:18.572061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:18.572061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:18.572061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:18.572061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:18.572946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:18.572946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:18.572946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:18.572946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:18.572946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:18.572946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:18.572946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:18.572946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:18.572946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:42:18.572946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:18.575329 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 252/494] 10.222.0.96 () {56 vars in 1093 bytes} [Thu Jul 28 17:42:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:18.576636 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbad72-68b8-4bf6-93d8-752c4a823631 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:18.589166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:18.600979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0f8dd-3f48-4d83-a868-56cf4954fe12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:18.601724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0f8dd-3f48-4d83-a868-56cf4954fe12 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:18.602072 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0f8dd-3f48-4d83-a868-56cf4954fe12 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:18.602418 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0f8dd-3f48-4d83-a868-56cf4954fe12 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:18.603458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0f8dd-3f48-4d83-a868-56cf4954fe12 None admin] RBAC: Adding query filter params (name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:18.603618 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0f8dd-3f48-4d83-a868-56cf4954fe12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:18.605142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0f8dd-3f48-4d83-a868-56cf4954fe12 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:18.614300 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 243/495] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Jul 28 17:42:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:18.616058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0f8dd-3f48-4d83-a868-56cf4954fe12 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:18.668584 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:18.701079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbad72-68b8-4bf6-93d8-752c4a823631 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:18.740359 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3b822-c9d6-429c-944d-bc58e9a9a13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:18.741214 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3b822-c9d6-429c-944d-bc58e9a9a13b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:18.741497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3b822-c9d6-429c-944d-bc58e9a9a13b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:18.741775 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3b822-c9d6-429c-944d-bc58e9a9a13b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:18.752320 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0f8dd-3f48-4d83-a868-56cf4954fe12 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:18.754115 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3b822-c9d6-429c-944d-bc58e9a9a13b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:18.755706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3b822-c9d6-429c-944d-bc58e9a9a13b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:18.770771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-68f3b822-c9d6-429c-944d-bc58e9a9a13b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:18.770771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:18.770771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:18.770771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:18.770771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:18.770771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:18.770771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:18.770771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:18.770771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:18.770771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:18.770771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:18.770771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:18.770771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:18.770771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:18.770771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:18.771934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:18.771934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:18.771934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:18.771934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:18.771934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:18.771934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:18.771934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:18.771934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:18.771934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:18.771934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:18.771934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:18.771934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:18.771934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:18.771934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:18.771934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:18.771934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:18.771934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:18.772772 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:18.772772 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:18.772772 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:18.772772 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:18.772772 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 253/496] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:18.777705 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3b822-c9d6-429c-944d-bc58e9a9a13b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:18.789760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92491497-041b-4f66-97dd-be72f6cf3a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:18.790396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92491497-041b-4f66-97dd-be72f6cf3a8a None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:18.790708 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92491497-041b-4f66-97dd-be72f6cf3a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:18.790955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92491497-041b-4f66-97dd-be72f6cf3a8a None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:18.791791 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92491497-041b-4f66-97dd-be72f6cf3a8a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:18.792101 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92491497-041b-4f66-97dd-be72f6cf3a8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:18.793555 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92491497-041b-4f66-97dd-be72f6cf3a8a None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:18.838927 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 244/497] 10.222.0.96 () {56 vars in 1133 bytes} [Thu Jul 28 17:42:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:18.840191 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b50c03-c26a-45de-baa8-e90d1612914b None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:18.840495 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b50c03-c26a-45de-baa8-e90d1612914b None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:18.840723 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b50c03-c26a-45de-baa8-e90d1612914b None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:18.845524 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 245/498] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:18.845524 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b50c03-c26a-45de-baa8-e90d1612914b None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:18.845726 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:18.889720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3b822-c9d6-429c-944d-bc58e9a9a13b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:18.923460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7163387-fdbe-4dbe-ad01-d98caeeaa635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:18.924024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7163387-fdbe-4dbe-ad01-d98caeeaa635 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:18.924320 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7163387-fdbe-4dbe-ad01-d98caeeaa635 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:18.924571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7163387-fdbe-4dbe-ad01-d98caeeaa635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:18.935165 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7163387-fdbe-4dbe-ad01-d98caeeaa635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:18.936635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7163387-fdbe-4dbe-ad01-d98caeeaa635 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:18.944038 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:18.950541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-f7163387-fdbe-4dbe-ad01-d98caeeaa635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:18.950541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:18.950541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:18.950541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:18.950541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:18.950541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:18.950541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:18.950541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:18.950541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:18.950541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:18.950541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:18.950541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:18.950541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:18.950541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:18.950541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:18.951382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:18.951382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:18.951382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:18.951382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:18.951382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:18.951382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:18.951382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:18.951382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:18.951382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:18.951382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:18.951382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:18.951382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:18.951382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:18.951382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:18.951382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:18.951382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:18.951382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:18.952239 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:18.952239 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:18.952239 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:18.952239 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:18.952449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b50c03-c26a-45de-baa8-e90d1612914b None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:18.952533 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 254/499] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:18.952533 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7163387-fdbe-4dbe-ad01-d98caeeaa635 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:18.986878 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48736b37-2b3c-485b-9a1d-c8b309b13f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:18.987479 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48736b37-2b3c-485b-9a1d-c8b309b13f4d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:18.987757 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48736b37-2b3c-485b-9a1d-c8b309b13f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:18.988040 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48736b37-2b3c-485b-9a1d-c8b309b13f4d None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:18.988718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48736b37-2b3c-485b-9a1d-c8b309b13f4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:18.989042 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48736b37-2b3c-485b-9a1d-c8b309b13f4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:18.990880 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48736b37-2b3c-485b-9a1d-c8b309b13f4d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:19.001940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 246/500] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:19.003063 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109f7a2-716f-42e7-8292-71696706348e None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:19.003338 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109f7a2-716f-42e7-8292-71696706348e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:19.003613 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109f7a2-716f-42e7-8292-71696706348e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:19.022112 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-f109f7a2-716f-42e7-8292-71696706348e None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:19.023314 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f109f7a2-716f-42e7-8292-71696706348e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:19.061721 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7163387-fdbe-4dbe-ad01-d98caeeaa635 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:19.074836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:19.089151 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 247/501] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:19.101310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2b2c1-010e-40b3-b62e-ce2dcd4b85cb None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:19.101310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2b2c1-010e-40b3-b62e-ce2dcd4b85cb None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:19.101310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2b2c1-010e-40b3-b62e-ce2dcd4b85cb None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:19.101310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 248/502] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:19.101310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2b2c1-010e-40b3-b62e-ce2dcd4b85cb None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:19.105553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a575c8-686e-4b61-9d63-96113e5799eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:19.106541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a575c8-686e-4b61-9d63-96113e5799eb None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:19.106829 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a575c8-686e-4b61-9d63-96113e5799eb None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:19.107403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a575c8-686e-4b61-9d63-96113e5799eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:19.181340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a575c8-686e-4b61-9d63-96113e5799eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:19.182754 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a575c8-686e-4b61-9d63-96113e5799eb None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:19.185769 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:19.202424 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2b2c1-010e-40b3-b62e-ce2dcd4b85cb None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:19.237510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4820a1a-5cff-4869-ab1a-7b93615e3a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:19.238137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4820a1a-5cff-4869-ab1a-7b93615e3a21 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:19.238419 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4820a1a-5cff-4869-ab1a-7b93615e3a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:19.238734 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4820a1a-5cff-4869-ab1a-7b93615e3a21 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:19.239432 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4820a1a-5cff-4869-ab1a-7b93615e3a21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:19.239739 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4820a1a-5cff-4869-ab1a-7b93615e3a21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:19.241140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4820a1a-5cff-4869-ab1a-7b93615e3a21 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:19.252412 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 249/503] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:19.253250 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4820a1a-5cff-4869-ab1a-7b93615e3a21 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:19.281780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 255/504] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:42:19.283048 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62247298-7818-4432-8a3c-3eeca1f54f36 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:19.283340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62247298-7818-4432-8a3c-3eeca1f54f36 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:19.283595 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62247298-7818-4432-8a3c-3eeca1f54f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:19.301727 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-62247298-7818-4432-8a3c-3eeca1f54f36 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:19.303052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-62247298-7818-4432-8a3c-3eeca1f54f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:19.310585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:19.356204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4820a1a-5cff-4869-ab1a-7b93615e3a21 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:19.373351 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 256/505] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:19.374196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62247298-7818-4432-8a3c-3eeca1f54f36 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:19.390483 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4121a62-8387-4e35-aaaa-219313913e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:19.391137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4121a62-8387-4e35-aaaa-219313913e71 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:19.391419 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4121a62-8387-4e35-aaaa-219313913e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:19.391696 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4121a62-8387-4e35-aaaa-219313913e71 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:19.400216 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4121a62-8387-4e35-aaaa-219313913e71 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:19.401780 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4121a62-8387-4e35-aaaa-219313913e71 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:19.415265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-c4121a62-8387-4e35-aaaa-219313913e71 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 17:42:19.415265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:19.415265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:19.415265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:19.415265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:19.415265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:19.415265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:19.415265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:19.415265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:19.415265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:19.415265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:19.415265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:19.415265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:19.415265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:19.415265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:19.415265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:19.416204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:19.416204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:19.416204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:19.416204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:19.416204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:19.416204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:19.416204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:19.416204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:19.416204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:19.416204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:19.416204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:19.416204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:19.416204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:19.416204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:19.416204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:19.416204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:19.416204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:19.416204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:19.417219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:19.417219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:19.417219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:19.417219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:19.417219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:19.417219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:19.417219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:19.417219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:19.417219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 17:42:19.417219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:19.417219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 250/506] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:42:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:19.417842 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4121a62-8387-4e35-aaaa-219313913e71 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:19.426418 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:19.496865 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62247298-7818-4432-8a3c-3eeca1f54f36 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:19.522345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4121a62-8387-4e35-aaaa-219313913e71 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:19.530645 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640af62-b7df-4c53-b7fc-206f2710216d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:19.531293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640af62-b7df-4c53-b7fc-206f2710216d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:19.531567 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640af62-b7df-4c53-b7fc-206f2710216d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:19.531838 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640af62-b7df-4c53-b7fc-206f2710216d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:19.542345 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640af62-b7df-4c53-b7fc-206f2710216d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:19.547227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-0640af62-b7df-4c53-b7fc-206f2710216d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:19.547227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:19.547227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:19.547227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:19.547227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:19.547227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:19.547227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:19.547227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:19.547227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:19.547227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:19.547227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:19.547227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:19.547227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:19.547227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:19.547227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:19.547227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:19.548254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:19.548254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:19.548254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:19.548254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:19.548254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:19.548254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:19.548254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:19.548254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:19.548254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:19.548254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:19.548254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:19.548254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:19.548254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:19.548254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:19.548254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:19.548254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:19.549244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:19.549244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:19.549244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:19.549244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:19.549244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:19.549244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:19.549244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:19.549244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:19.549244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:19.549244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:19.549244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:19.549244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:19.549244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 257/507] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:42:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:19.549244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640af62-b7df-4c53-b7fc-206f2710216d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:19.552494 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:19.558682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a1fa7-d76f-4f86-8cf4-f4d59e29dadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:19.559337 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a1fa7-d76f-4f86-8cf4-f4d59e29dadf None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:19.559614 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a1fa7-d76f-4f86-8cf4-f4d59e29dadf None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:19.559872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a1fa7-d76f-4f86-8cf4-f4d59e29dadf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:19.567588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a1fa7-d76f-4f86-8cf4-f4d59e29dadf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:19.569323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a1fa7-d76f-4f86-8cf4-f4d59e29dadf None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:19.580510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-bf0a1fa7-d76f-4f86-8cf4-f4d59e29dadf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:42:19.580510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:19.580510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:19.580510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:19.580510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:19.580510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:19.580510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:19.580510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:19.580510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:19.580510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:19.580510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:19.580510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:19.580510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:19.580510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:19.580510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:19.580510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:19.581449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:19.581449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:19.581449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:19.581449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:19.581449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:19.581449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:19.581449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:19.581449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:19.581449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:19.581449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:19.581449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:19.581449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:19.581449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:19.581449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:19.581449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:19.581449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:19.581449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:19.581449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:19.582835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:19.582835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:19.582835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:19.582835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:19.582835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:19.582835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:19.582835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:19.582835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:19.582835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:42:19.582835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:19.582835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 251/508] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:42:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:19.582835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a1fa7-d76f-4f86-8cf4-f4d59e29dadf None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:19.655671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640af62-b7df-4c53-b7fc-206f2710216d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:19.656444 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:19.692025 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a1fa7-d76f-4f86-8cf4-f4d59e29dadf None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:19.692449 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf3ec1-e96f-49eb-b1c1-027984035783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:19.693376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf3ec1-e96f-49eb-b1c1-027984035783 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:19.693740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf3ec1-e96f-49eb-b1c1-027984035783 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:19.694131 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf3ec1-e96f-49eb-b1c1-027984035783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:19.705016 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf3ec1-e96f-49eb-b1c1-027984035783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:19.706572 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf3ec1-e96f-49eb-b1c1-027984035783 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:19.721549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-9bdf3ec1-e96f-49eb-b1c1-027984035783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:19.721549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:19.721549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:19.721549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:19.721549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:19.721549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:19.721549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:19.721549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:19.721549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:19.721549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:19.721549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:19.721549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:19.721549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:19.721549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:19.721549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:19.722400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:19.722400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:19.722400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:19.722400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:19.722400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:19.722400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:19.722400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:19.722400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:19.722400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:19.722400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:19.722400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:19.722400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:19.722400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:19.722400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:19.722400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:19.722400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:19.722400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:19.723231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:19.723231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:19.723231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:19.723231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:19.723231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 258/509] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:19.723541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf3ec1-e96f-49eb-b1c1-027984035783 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:19.729612 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c19c41-10cc-44c9-9382-cb63ddd0ebd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:19.730264 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c19c41-10cc-44c9-9382-cb63ddd0ebd7 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:19.730541 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c19c41-10cc-44c9-9382-cb63ddd0ebd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:19.730809 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c19c41-10cc-44c9-9382-cb63ddd0ebd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:19.741443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c19c41-10cc-44c9-9382-cb63ddd0ebd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:19.742883 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c19c41-10cc-44c9-9382-cb63ddd0ebd7 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:19.756626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-30c19c41-10cc-44c9-9382-cb63ddd0ebd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:19.756626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:19.756626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:19.756626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:19.756626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:19.756626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:19.756626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:19.756626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:19.756626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:19.756626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:19.756626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:19.756626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:19.756626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:19.756626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:19.756626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:19.757520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:19.757520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:19.757520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:19.757520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:19.757520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:19.757520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:19.757520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:19.757520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:19.757520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:19.757520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:19.757520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:19.757520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:19.757520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:19.757520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:19.757520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:19.757520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:19.757520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:19.758359 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:19.758359 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:19.758359 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:19.758359 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:19.758359 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 252/510] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:19.758624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c19c41-10cc-44c9-9382-cb63ddd0ebd7 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:19.784495 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:19.830979 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf3ec1-e96f-49eb-b1c1-027984035783 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:19.860927 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c19c41-10cc-44c9-9382-cb63ddd0ebd7 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:19.865589 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a4f82-9dbb-454b-b60d-36cf594e977e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:19.866220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a4f82-9dbb-454b-b60d-36cf594e977e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:19.866502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a4f82-9dbb-454b-b60d-36cf594e977e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:19.866780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a4f82-9dbb-454b-b60d-36cf594e977e None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:19.867579 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a4f82-9dbb-454b-b60d-36cf594e977e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:19.867934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a4f82-9dbb-454b-b60d-36cf594e977e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:19.869374 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a4f82-9dbb-454b-b60d-36cf594e977e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:19.878869 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:19.899306 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f112dd4-635d-4d3e-8e4b-bbf0dbec15da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:19.899932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f112dd4-635d-4d3e-8e4b-bbf0dbec15da None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:19.900210 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f112dd4-635d-4d3e-8e4b-bbf0dbec15da None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:19.900479 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f112dd4-635d-4d3e-8e4b-bbf0dbec15da None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:19.901226 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f112dd4-635d-4d3e-8e4b-bbf0dbec15da None admin] RBAC: Adding query filter params (name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:19.901529 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f112dd4-635d-4d3e-8e4b-bbf0dbec15da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:19.902925 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f112dd4-635d-4d3e-8e4b-bbf0dbec15da None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:19.907520 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 259/511] 10.222.0.96 () {56 vars in 1137 bytes} [Thu Jul 28 17:42:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:19.908360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a4f82-9dbb-454b-b60d-36cf594e977e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:19.912358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 253/512] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Jul 28 17:42:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:19.913122 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f112dd4-635d-4d3e-8e4b-bbf0dbec15da None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:20.017096 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a4f82-9dbb-454b-b60d-36cf594e977e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:20.023816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f112dd4-635d-4d3e-8e4b-bbf0dbec15da None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:20.032155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:20.055291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becac71f-4a58-42f3-8b91-a1ca46b1922d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:20.055913 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becac71f-4a58-42f3-8b91-a1ca46b1922d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:20.056209 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becac71f-4a58-42f3-8b91-a1ca46b1922d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:20.056443 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becac71f-4a58-42f3-8b91-a1ca46b1922d None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:20.057287 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becac71f-4a58-42f3-8b91-a1ca46b1922d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:20.057588 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becac71f-4a58-42f3-8b91-a1ca46b1922d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:20.058210 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48898ae-5222-4b7a-85f8-bd502953aa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:20.058831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48898ae-5222-4b7a-85f8-bd502953aa13 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:20.059057 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becac71f-4a58-42f3-8b91-a1ca46b1922d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:20.059154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48898ae-5222-4b7a-85f8-bd502953aa13 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:20.059426 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48898ae-5222-4b7a-85f8-bd502953aa13 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:20.060062 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48898ae-5222-4b7a-85f8-bd502953aa13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:20.060366 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48898ae-5222-4b7a-85f8-bd502953aa13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:20.061746 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48898ae-5222-4b7a-85f8-bd502953aa13 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:20.073498 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 254/513] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:20.074393 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48898ae-5222-4b7a-85f8-bd502953aa13 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:20.081701 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 260/514] 10.222.0.96 () {56 vars in 1137 bytes} [Thu Jul 28 17:42:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:20.081701 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becac71f-4a58-42f3-8b91-a1ca46b1922d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:20.116412 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:20.173997 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48898ae-5222-4b7a-85f8-bd502953aa13 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:20.178122 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becac71f-4a58-42f3-8b91-a1ca46b1922d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:20.208585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77976992-b939-4094-ad06-ea5503a7ae44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:20.209228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77976992-b939-4094-ad06-ea5503a7ae44 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:20.209505 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77976992-b939-4094-ad06-ea5503a7ae44 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:20.209774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77976992-b939-4094-ad06-ea5503a7ae44 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:20.210457 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77976992-b939-4094-ad06-ea5503a7ae44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:20.210754 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77976992-b939-4094-ad06-ea5503a7ae44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:20.211456 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128552a2-4389-4071-b96f-1138be2a8341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:20.212099 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128552a2-4389-4071-b96f-1138be2a8341 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:20.212191 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77976992-b939-4094-ad06-ea5503a7ae44 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:20.212379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128552a2-4389-4071-b96f-1138be2a8341 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:20.212652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128552a2-4389-4071-b96f-1138be2a8341 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:20.223038 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 255/515] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:20.223828 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77976992-b939-4094-ad06-ea5503a7ae44 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:20.253766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:20.282149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128552a2-4389-4071-b96f-1138be2a8341 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:20.283567 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128552a2-4389-4071-b96f-1138be2a8341 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:20.319915 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:20.322923 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77976992-b939-4094-ad06-ea5503a7ae44 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:20.357359 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605bc26-eb2b-449d-be6a-ee9ad1c5ad76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:20.357993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605bc26-eb2b-449d-be6a-ee9ad1c5ad76 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:20.358289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605bc26-eb2b-449d-be6a-ee9ad1c5ad76 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:20.358563 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605bc26-eb2b-449d-be6a-ee9ad1c5ad76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:20.369591 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605bc26-eb2b-449d-be6a-ee9ad1c5ad76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:20.371050 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605bc26-eb2b-449d-be6a-ee9ad1c5ad76 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:20.385294 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 261/516] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:42:20.385451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-8605bc26-eb2b-449d-be6a-ee9ad1c5ad76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:20.385451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:20.385451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:20.385451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:20.385451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:20.385451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:20.385451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:20.385451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:20.385451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:20.385451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:20.385451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:20.385451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:20.385451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:20.385451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:20.385451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:20.386244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:20.386244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:20.386244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:20.386244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:20.386244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:20.386244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:20.386244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:20.386244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:20.386244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:20.386244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:20.386244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:20.386244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:20.386244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:20.386244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:20.386244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:20.386244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:20.386244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:20.387635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:20.387635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:20.387635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:20.387635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:20.388491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128552a2-4389-4071-b96f-1138be2a8341 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:20.388565 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 256/517] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:20.388565 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605bc26-eb2b-449d-be6a-ee9ad1c5ad76 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:20.456859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:20.487179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605bc26-eb2b-449d-be6a-ee9ad1c5ad76 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:20.487904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128552a2-4389-4071-b96f-1138be2a8341 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:20.522104 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b777843-3025-4fdf-9954-5fec18ba6bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:20.522413 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ce3f4-884d-4811-b8d3-410925041c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:20.522751 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b777843-3025-4fdf-9954-5fec18ba6bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:20.523030 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b777843-3025-4fdf-9954-5fec18ba6bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:20.523183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ce3f4-884d-4811-b8d3-410925041c91 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:20.523272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b777843-3025-4fdf-9954-5fec18ba6bd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:20.523349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ce3f4-884d-4811-b8d3-410925041c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:20.523566 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ce3f4-884d-4811-b8d3-410925041c91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:20.530146 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b777843-3025-4fdf-9954-5fec18ba6bd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:20.531653 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b777843-3025-4fdf-9954-5fec18ba6bd2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:20.543578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-6b777843-3025-4fdf-9954-5fec18ba6bd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:20.543578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:20.543578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:20.543578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:20.543578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:20.543578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:20.543578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:20.543578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:20.543578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:20.543578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:20.543578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:20.543578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:20.543578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:20.543578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:20.543578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:20.544543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:20.544543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:20.544543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:20.544543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:20.544543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:20.544543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:20.544543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:20.544543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:20.544543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:20.544543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:20.544543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:20.544543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:20.544543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:20.544543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:20.544543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:20.544543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:20.544543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:20.545453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:20.545453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:20.545453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:20.545453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:20.545453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:20.545453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:20.545453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:20.545453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:20.545453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 262/518] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:20.545453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b777843-3025-4fdf-9954-5fec18ba6bd2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:20.551812 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:20.593357 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ce3f4-884d-4811-b8d3-410925041c91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:20.594843 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ce3f4-884d-4811-b8d3-410925041c91 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:20.646623 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b777843-3025-4fdf-9954-5fec18ba6bd2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:20.675686 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:20.683065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cda64-9c96-496d-a04d-13fcbfc4dbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:20.683811 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cda64-9c96-496d-a04d-13fcbfc4dbb9 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:20.684267 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cda64-9c96-496d-a04d-13fcbfc4dbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:20.684764 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cda64-9c96-496d-a04d-13fcbfc4dbb9 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:20.685835 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104cda64-9c96-496d-a04d-13fcbfc4dbb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:20.687311 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104cda64-9c96-496d-a04d-13fcbfc4dbb9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:20.693915 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 257/519] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:42:20.695474 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ce3f4-884d-4811-b8d3-410925041c91 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:20.712492 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 263/520] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Jul 28 17:42:20 2022] POST /identity/v3/users => generated 247 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:42:20.713393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cda64-9c96-496d-a04d-13fcbfc4dbb9 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:20.759185 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:20.813392 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ce3f4-884d-4811-b8d3-410925041c91 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:20.843527 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cda64-9c96-496d-a04d-13fcbfc4dbb9 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:20.848609 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09b056-739b-487c-bbd0-9e3ea785b3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:20.849414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09b056-739b-487c-bbd0-9e3ea785b3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:20.849688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09b056-739b-487c-bbd0-9e3ea785b3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:20.849962 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09b056-739b-487c-bbd0-9e3ea785b3f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:20.850675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09b056-739b-487c-bbd0-9e3ea785b3f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:20.850981 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09b056-739b-487c-bbd0-9e3ea785b3f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:20.852422 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09b056-739b-487c-bbd0-9e3ea785b3f8 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:20.864667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 258/521] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:20.865914 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09b056-739b-487c-bbd0-9e3ea785b3f8 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:20.892048 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dedc75-2b2a-47a3-b1d8-ed298366a0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:20.892957 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dedc75-2b2a-47a3-b1d8-ed298366a0fc None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:20.893521 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dedc75-2b2a-47a3-b1d8-ed298366a0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:20.893796 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dedc75-2b2a-47a3-b1d8-ed298366a0fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:20.908242 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dedc75-2b2a-47a3-b1d8-ed298366a0fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:20.909776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dedc75-2b2a-47a3-b1d8-ed298366a0fc None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:20.938340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-01dedc75-2b2a-47a3-b1d8-ed298366a0fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:20.938340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:20.938340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:20.938340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:20.938340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:20.938340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:20.938340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:20.938340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:20.938340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:20.938340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:20.938340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:20.938340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:20.938340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:20.938340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:20.938340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:20.939266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:20.939266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:20.939266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:20.939266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:20.939266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:20.939266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:20.939266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:20.939266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:20.939266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:20.939266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:20.939266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:20.939266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:20.939266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:20.939266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:20.939266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:20.939266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:20.939266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:20.940825 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:20.940825 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:20.940825 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:20.940825 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:20.940825 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 264/522] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:20.941252 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dedc75-2b2a-47a3-b1d8-ed298366a0fc None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:20.977012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09b056-739b-487c-bbd0-9e3ea785b3f8 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:20.987023 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:20.990787 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:21.018153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248dbc9-55cd-4311-a6ad-b2df4c217464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:21.020141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248dbc9-55cd-4311-a6ad-b2df4c217464 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:21.020513 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248dbc9-55cd-4311-a6ad-b2df4c217464 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:21.020936 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248dbc9-55cd-4311-a6ad-b2df4c217464 None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:21.021852 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248dbc9-55cd-4311-a6ad-b2df4c217464 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:21.022255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248dbc9-55cd-4311-a6ad-b2df4c217464 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:21.025801 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248dbc9-55cd-4311-a6ad-b2df4c217464 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:21.045313 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 259/523] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:21.046134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248dbc9-55cd-4311-a6ad-b2df4c217464 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:21.054884 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dedc75-2b2a-47a3-b1d8-ed298366a0fc None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:21.094168 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387d2bb-a81f-4874-9471-33bc537e3910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:21.094731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387d2bb-a81f-4874-9471-33bc537e3910 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:21.095002 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387d2bb-a81f-4874-9471-33bc537e3910 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:21.095273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387d2bb-a81f-4874-9471-33bc537e3910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:21.106703 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387d2bb-a81f-4874-9471-33bc537e3910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:21.108170 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387d2bb-a81f-4874-9471-33bc537e3910 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:21.123758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-a387d2bb-a81f-4874-9471-33bc537e3910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:21.123758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:21.123758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:21.123758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:21.123758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:21.123758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:21.123758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:21.123758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:21.123758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:21.123758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:21.123758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:21.123758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:21.123758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:21.123758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:21.123758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:21.124658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:21.124658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:21.124658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:21.124658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:21.124658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:21.124658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:21.124658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:21.124658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:21.124658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:21.124658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:21.124658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:21.124658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:21.124658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:21.124658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:21.124658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:21.124658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:21.124658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:21.126128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:21.126128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:21.126128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:21.126128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:21.126128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 265/524] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:21.126653 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387d2bb-a81f-4874-9471-33bc537e3910 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:21.166896 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248dbc9-55cd-4311-a6ad-b2df4c217464 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:21.206141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2738a0-3468-450a-b53a-a90583982c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:21.207097 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2738a0-3468-450a-b53a-a90583982c1a None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:21.207375 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2738a0-3468-450a-b53a-a90583982c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:21.207647 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2738a0-3468-450a-b53a-a90583982c1a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:21.215320 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2738a0-3468-450a-b53a-a90583982c1a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:21.216772 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2738a0-3468-450a-b53a-a90583982c1a None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:21.222888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:21.228892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-df2738a0-3468-450a-b53a-a90583982c1a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 17:42:21.228892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:21.228892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:21.228892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:21.228892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:21.228892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:21.228892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:21.228892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:21.228892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:21.228892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:21.228892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:21.228892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:21.228892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:21.228892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:21.228892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:21.228892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:21.229984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:21.229984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:21.229984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:21.229984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:21.229984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:21.229984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:21.229984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:21.229984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:21.229984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:21.229984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:21.229984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:21.229984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:21.229984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:21.229984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:21.229984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:21.229984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:21.229984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:21.229984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:21.230867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:21.230867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:21.230867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:21.230867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:21.230867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:21.230867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:21.230867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:21.230867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:21.230867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 17:42:21.230867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:21.230867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 260/525] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:42:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:21.230867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2738a0-3468-450a-b53a-a90583982c1a None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:21.241296 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387d2bb-a81f-4874-9471-33bc537e3910 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:21.267841 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:21.280367 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a25b37-0e29-465d-8508-05d8380e0c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:21.281441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a25b37-0e29-465d-8508-05d8380e0c91 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:21.281824 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a25b37-0e29-465d-8508-05d8380e0c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:21.282189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a25b37-0e29-465d-8508-05d8380e0c91 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:21.283493 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a25b37-0e29-465d-8508-05d8380e0c91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:21.283897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a25b37-0e29-465d-8508-05d8380e0c91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:21.285819 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a25b37-0e29-465d-8508-05d8380e0c91 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:21.301557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 266/526] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:21.302718 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a25b37-0e29-465d-8508-05d8380e0c91 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:21.340190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2738a0-3468-450a-b53a-a90583982c1a None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:21.376492 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad92fb-ad9c-4bae-9877-6f303e7bc29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:21.377507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad92fb-ad9c-4bae-9877-6f303e7bc29f None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:21.377976 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad92fb-ad9c-4bae-9877-6f303e7bc29f None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:21.378531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad92fb-ad9c-4bae-9877-6f303e7bc29f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:21.379685 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad92fb-ad9c-4bae-9877-6f303e7bc29f None admin] RBAC: Adding query filter params (role.id=f8cbbf969cfc442595755799825094f6, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=5ac367247aa54671ae5c33d251017470) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:21.380091 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad92fb-ad9c-4bae-9877-6f303e7bc29f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:21.381838 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad92fb-ad9c-4bae-9877-6f303e7bc29f None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:21.397087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 261/527] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:42:21 2022] GET /identity/v3/role_assignments?user.id=5ac367247aa54671ae5c33d251017470&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=f8cbbf969cfc442595755799825094f6 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:21.397087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad92fb-ad9c-4bae-9877-6f303e7bc29f None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:21.431489 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a25b37-0e29-465d-8508-05d8380e0c91 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:21.473398 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68491eb-058a-44fb-95c9-23dc2af17c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:21.474183 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68491eb-058a-44fb-95c9-23dc2af17c3b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:21.474570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68491eb-058a-44fb-95c9-23dc2af17c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:21.474928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68491eb-058a-44fb-95c9-23dc2af17c3b None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:21.475747 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68491eb-058a-44fb-95c9-23dc2af17c3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:21.476122 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68491eb-058a-44fb-95c9-23dc2af17c3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:21.477779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68491eb-058a-44fb-95c9-23dc2af17c3b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:21.495987 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 267/528] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:21.497214 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68491eb-058a-44fb-95c9-23dc2af17c3b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:21.512181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:21.527197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:21.535855 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad92fb-ad9c-4bae-9877-6f303e7bc29f None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:21.575205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2bfaf-ff07-43b7-a4fc-9a3c32e5da91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:21.576219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2bfaf-ff07-43b7-a4fc-9a3c32e5da91 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:21.576903 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2bfaf-ff07-43b7-a4fc-9a3c32e5da91 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:21.577382 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2bfaf-ff07-43b7-a4fc-9a3c32e5da91 None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:21.578437 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2bfaf-ff07-43b7-a4fc-9a3c32e5da91 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:21.578741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2bfaf-ff07-43b7-a4fc-9a3c32e5da91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:21.580249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2bfaf-ff07-43b7-a4fc-9a3c32e5da91 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:21.601149 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 262/529] 10.222.0.96 () {56 vars in 1139 bytes} [Thu Jul 28 17:42:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:21.602994 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2bfaf-ff07-43b7-a4fc-9a3c32e5da91 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:21.620410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68491eb-058a-44fb-95c9-23dc2af17c3b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:21.658812 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f2f79-bf1a-442b-ac2b-af85aa1d8587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:21.659376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f2f79-bf1a-442b-ac2b-af85aa1d8587 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:21.659661 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f2f79-bf1a-442b-ac2b-af85aa1d8587 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:21.659929 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f2f79-bf1a-442b-ac2b-af85aa1d8587 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:21.667702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f2f79-bf1a-442b-ac2b-af85aa1d8587 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:21.669408 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f2f79-bf1a-442b-ac2b-af85aa1d8587 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:21.681921 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-459f2f79-bf1a-442b-ac2b-af85aa1d8587 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:21.681921 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:21.681921 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:21.681921 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:21.681921 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:21.681921 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:21.681921 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:21.681921 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:21.681921 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:21.681921 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:21.681921 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:21.681921 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:21.681921 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:21.681921 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:21.681921 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:21.682797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:21.682797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:21.682797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:21.682797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:21.682797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:21.682797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:21.682797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:21.682797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:21.682797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:21.682797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:21.682797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:21.682797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:21.682797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:21.682797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:21.682797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:21.682797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:21.682797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:21.683648 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:21.683648 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:21.683648 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:21.683648 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:21.683648 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:21.683648 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:21.683648 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:21.683648 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:21.687895 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 268/530] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:21.688904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f2f79-bf1a-442b-ac2b-af85aa1d8587 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:21.711737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2bfaf-ff07-43b7-a4fc-9a3c32e5da91 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:21.747599 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16cf45-3e66-4720-98dc-32807be6c750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:21.748619 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16cf45-3e66-4720-98dc-32807be6c750 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:21.749127 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16cf45-3e66-4720-98dc-32807be6c750 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:21.749650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16cf45-3e66-4720-98dc-32807be6c750 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:21.757600 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16cf45-3e66-4720-98dc-32807be6c750 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:21.759413 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16cf45-3e66-4720-98dc-32807be6c750 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:21.768751 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:21.775378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-3d16cf45-3e66-4720-98dc-32807be6c750 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:21.775378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:21.775378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:21.775378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:21.775378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:21.775378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:21.775378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:21.775378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:21.775378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:21.775378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:21.775378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:21.775378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:21.775378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:21.775378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:21.775378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:21.776248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:21.776248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:21.776248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:21.776248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:21.776248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:21.776248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:21.776248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:21.776248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:21.776248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:21.776248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:21.776248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:21.776248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:21.776248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:21.776248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:21.776248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:21.776248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:21.776248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:21.777126 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:21.777126 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:21.777126 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:21.777126 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:21.777126 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:21.777126 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:21.777126 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:21.777126 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:21.784335 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 263/531] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:21.785476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16cf45-3e66-4720-98dc-32807be6c750 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:21.803547 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:21.805929 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f2f79-bf1a-442b-ac2b-af85aa1d8587 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:21.845666 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43c886-b67c-4f95-8195-3bfd691c0bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:21.846302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43c886-b67c-4f95-8195-3bfd691c0bae None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:21.846580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43c886-b67c-4f95-8195-3bfd691c0bae None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:21.846852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43c886-b67c-4f95-8195-3bfd691c0bae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:21.895125 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16cf45-3e66-4720-98dc-32807be6c750 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:21.926480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43c886-b67c-4f95-8195-3bfd691c0bae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:21.927953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43c886-b67c-4f95-8195-3bfd691c0bae None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:21.943291 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53d081-9093-4504-a148-9a2e94c1d118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:21.944302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53d081-9093-4504-a148-9a2e94c1d118 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:21.944716 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53d081-9093-4504-a148-9a2e94c1d118 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:21.945147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53d081-9093-4504-a148-9a2e94c1d118 None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:21.946031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53d081-9093-4504-a148-9a2e94c1d118 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:21.946569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53d081-9093-4504-a148-9a2e94c1d118 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:21.948315 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53d081-9093-4504-a148-9a2e94c1d118 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:21.962130 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 264/532] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:21.963287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53d081-9093-4504-a148-9a2e94c1d118 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:22.003940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:22.041540 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 269/533] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:42:22.042453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43c886-b67c-4f95-8195-3bfd691c0bae None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:22.057813 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:22.085374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53d081-9093-4504-a148-9a2e94c1d118 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:22.122079 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334f6ec-e5a0-4196-afbb-8933cf98587d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:22.123556 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334f6ec-e5a0-4196-afbb-8933cf98587d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:22.123556 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334f6ec-e5a0-4196-afbb-8933cf98587d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:22.123795 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334f6ec-e5a0-4196-afbb-8933cf98587d None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:22.124475 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334f6ec-e5a0-4196-afbb-8933cf98587d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:22.124782 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334f6ec-e5a0-4196-afbb-8933cf98587d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:22.126351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334f6ec-e5a0-4196-afbb-8933cf98587d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:22.140936 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 265/534] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:22.141902 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334f6ec-e5a0-4196-afbb-8933cf98587d None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:22.151614 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43c886-b67c-4f95-8195-3bfd691c0bae None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:22.190421 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4d5cb-bead-4296-a214-59b4088f33bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:22.191397 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4d5cb-bead-4296-a214-59b4088f33bb None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:22.191901 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4d5cb-bead-4296-a214-59b4088f33bb None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:22.192342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4d5cb-bead-4296-a214-59b4088f33bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:22.193482 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4d5cb-bead-4296-a214-59b4088f33bb None admin] RBAC: Adding query filter params (role.id=f8cbbf969cfc442595755799825094f6, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=98465c2d73e540b5bf506f5a7423e035) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:22.194050 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4d5cb-bead-4296-a214-59b4088f33bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:22.195858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4d5cb-bead-4296-a214-59b4088f33bb None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:22.208266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 270/535] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:42:22 2022] GET /identity/v3/role_assignments?user.id=98465c2d73e540b5bf506f5a7423e035&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=f8cbbf969cfc442595755799825094f6 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:22.209872 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4d5cb-bead-4296-a214-59b4088f33bb None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:22.250253 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334f6ec-e5a0-4196-afbb-8933cf98587d None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:22.259002 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:22.290710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcb4b5-f8e2-47d3-bd91-08e97941427c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:22.291282 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcb4b5-f8e2-47d3-bd91-08e97941427c None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:22.291564 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcb4b5-f8e2-47d3-bd91-08e97941427c None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:22.291837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcb4b5-f8e2-47d3-bd91-08e97941427c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:22.294141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:22.304898 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dcb4b5-f8e2-47d3-bd91-08e97941427c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:22.306429 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dcb4b5-f8e2-47d3-bd91-08e97941427c None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:22.331999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-e9dcb4b5-f8e2-47d3-bd91-08e97941427c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:22.331999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:22.331999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:22.331999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:22.331999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:22.331999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:22.331999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:22.331999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:22.331999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:22.331999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:22.331999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:22.331999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:22.331999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:22.331999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:22.331999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:22.332917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:22.332917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:22.332917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:22.332917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:22.332917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:22.332917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:22.332917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:22.332917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:22.332917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:22.332917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:22.332917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:22.332917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:22.332917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:22.332917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:22.332917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:22.332917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:22.332917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:22.333812 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:22.333812 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:22.333812 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:22.333812 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:22.338005 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4d5cb-bead-4296-a214-59b4088f33bb None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:22.339852 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 266/536] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:22.347049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcb4b5-f8e2-47d3-bd91-08e97941427c None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:22.381765 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea80d14-e555-41ef-a6b5-96e55414d36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:22.382769 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea80d14-e555-41ef-a6b5-96e55414d36a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:22.383269 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea80d14-e555-41ef-a6b5-96e55414d36a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:22.383727 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea80d14-e555-41ef-a6b5-96e55414d36a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:22.384746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea80d14-e555-41ef-a6b5-96e55414d36a None admin] RBAC: Adding query filter params (role.id=f8cbbf969cfc442595755799825094f6, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=e6d20d753e37498e8664f983b0988e3d) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:22.385314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea80d14-e555-41ef-a6b5-96e55414d36a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:22.387016 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea80d14-e555-41ef-a6b5-96e55414d36a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:22.394774 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 271/537] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:42:22 2022] GET /identity/v3/role_assignments?user.id=e6d20d753e37498e8664f983b0988e3d&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=f8cbbf969cfc442595755799825094f6 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:22.491007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcb4b5-f8e2-47d3-bd91-08e97941427c None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:22.537909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfee91-965d-4bf8-8650-376881225276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:22.538671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfee91-965d-4bf8-8650-376881225276 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:22.538950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfee91-965d-4bf8-8650-376881225276 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:22.539221 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfee91-965d-4bf8-8650-376881225276 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:22.540020 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfee91-965d-4bf8-8650-376881225276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:22.540327 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfee91-965d-4bf8-8650-376881225276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:22.541856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfee91-965d-4bf8-8650-376881225276 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:22.555681 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 267/538] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:22.561505 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea80d14-e555-41ef-a6b5-96e55414d36a None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:22.698023 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:22.706602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea80d14-e555-41ef-a6b5-96e55414d36a None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:22.753376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bb282-79ed-4ce5-85aa-ccb15571f125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:22.754392 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bb282-79ed-4ce5-85aa-ccb15571f125 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:22.754881 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bb282-79ed-4ce5-85aa-ccb15571f125 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:22.755433 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bb282-79ed-4ce5-85aa-ccb15571f125 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:22.768205 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292bb282-79ed-4ce5-85aa-ccb15571f125 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:22.770016 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292bb282-79ed-4ce5-85aa-ccb15571f125 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:22.784634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-292bb282-79ed-4ce5-85aa-ccb15571f125 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:22.784634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:22.784634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:22.784634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:22.784634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:22.784634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:22.784634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:22.784634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:22.784634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:22.784634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:22.784634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:22.784634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:22.784634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:22.784634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:22.784634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:22.785603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:22.785603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:22.785603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:22.785603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:22.785603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:22.785603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:22.785603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:22.785603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:22.785603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:22.785603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:22.785603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:22.785603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:22.785603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:22.785603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:22.785603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:22.785603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:22.785603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:22.786646 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:22.786646 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:22.786646 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:22.786646 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:22.786646 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:22.786646 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:22.786646 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:22.786646 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:22.789326 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 272/539] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:22.794717 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfee91-965d-4bf8-8650-376881225276 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:22.859248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:22.918750 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfee91-965d-4bf8-8650-376881225276 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:22.966043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ae1cf-6ded-45d9-a5fe-a932b0ec3879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:22.966727 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ae1cf-6ded-45d9-a5fe-a932b0ec3879 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:22.967001 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ae1cf-6ded-45d9-a5fe-a932b0ec3879 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:22.967270 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ae1cf-6ded-45d9-a5fe-a932b0ec3879 None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:22.968020 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ae1cf-6ded-45d9-a5fe-a932b0ec3879 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:22.968373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ae1cf-6ded-45d9-a5fe-a932b0ec3879 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:22.969843 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ae1cf-6ded-45d9-a5fe-a932b0ec3879 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:22.985634 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 268/540] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:22.992708 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bb282-79ed-4ce5-85aa-ccb15571f125 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:23.049251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb88512-60ad-49b8-9ba7-ca996184ee2e None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:23.049582 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb88512-60ad-49b8-9ba7-ca996184ee2e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:23.050000 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb88512-60ad-49b8-9ba7-ca996184ee2e None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:23.051378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 269/541] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:42:23.057282 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b9fcb-71a7-44bf-bc86-2454ac3e7dfb None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:23.057535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b9fcb-71a7-44bf-bc86-2454ac3e7dfb None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:23.057791 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b9fcb-71a7-44bf-bc86-2454ac3e7dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:23.084212 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-6e4b9fcb-71a7-44bf-bc86-2454ac3e7dfb None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:23.088381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6e4b9fcb-71a7-44bf-bc86-2454ac3e7dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:23.169655 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bb282-79ed-4ce5-85aa-ccb15571f125 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:23.229321 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b20a9e-a705-42f4-af8c-e1b690fc37bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:23.230579 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b20a9e-a705-42f4-af8c-e1b690fc37bd None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:23.232173 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b20a9e-a705-42f4-af8c-e1b690fc37bd None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:23.233304 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b20a9e-a705-42f4-af8c-e1b690fc37bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:23.234829 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b20a9e-a705-42f4-af8c-e1b690fc37bd None admin] RBAC: Adding query filter params (role.id=f8cbbf969cfc442595755799825094f6, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=76add49d4be940ad846d32fa16431988) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:23.235484 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b20a9e-a705-42f4-af8c-e1b690fc37bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:23.238330 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b20a9e-a705-42f4-af8c-e1b690fc37bd None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:23.242592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 270/542] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:42:23.252551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 273/543] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:42:22 2022] GET /identity/v3/role_assignments?user.id=76add49d4be940ad846d32fa16431988&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=f8cbbf969cfc442595755799825094f6 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:23.272315 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b9fcb-71a7-44bf-bc86-2454ac3e7dfb None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:23.322457 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:23.412792 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b9fcb-71a7-44bf-bc86-2454ac3e7dfb None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:23.453835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c93d9b-55d5-48e0-8156-ae311cf563da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:23.454599 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c93d9b-55d5-48e0-8156-ae311cf563da None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:23.454875 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c93d9b-55d5-48e0-8156-ae311cf563da None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:23.455144 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c93d9b-55d5-48e0-8156-ae311cf563da None admin] PATH_INFO: `/v3/roles/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:23.467275 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c93d9b-55d5-48e0-8156-ae311cf563da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:23.472158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-88c93d9b-55d5-48e0-8156-ae311cf563da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:23.472158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:23.472158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:23.472158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:23.472158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:23.472158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:23.472158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:23.472158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:23.472158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:23.472158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:23.472158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:23.472158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:23.472158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:23.472158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:23.472158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:23.472158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:23.473032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:23.473032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:23.473032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:23.473032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:23.473032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:23.473032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:23.473032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:23.473032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:23.473032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:23.473032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:23.473032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:23.473032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:23.473032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:23.473032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:23.473032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:23.473032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:23.473899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:23.473899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:23.473899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:23.473899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:23.473899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:23.473899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:23.473899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:23.473899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:23.473899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:23.473899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:23.473899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:23.473899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:23.473899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 271/544] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:42:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:23.479619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b20a9e-a705-42f4-af8c-e1b690fc37bd None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:23.523810 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:23.609307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b20a9e-a705-42f4-af8c-e1b690fc37bd None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:23.651785 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63024257-864c-4a1b-bf90-12e0886fd31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:23.652437 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63024257-864c-4a1b-bf90-12e0886fd31b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:23.652715 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63024257-864c-4a1b-bf90-12e0886fd31b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:23.652986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63024257-864c-4a1b-bf90-12e0886fd31b None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:23.653740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63024257-864c-4a1b-bf90-12e0886fd31b None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:23.654041 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63024257-864c-4a1b-bf90-12e0886fd31b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:23.655448 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63024257-864c-4a1b-bf90-12e0886fd31b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:23.671495 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 274/545] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Jul 28 17:42:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:23.677026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c93d9b-55d5-48e0-8156-ae311cf563da None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:23.701204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45098381-f98f-4192-ab42-9fe1cc9d8791 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:23.701625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45098381-f98f-4192-ab42-9fe1cc9d8791 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:23.701920 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45098381-f98f-4192-ab42-9fe1cc9d8791 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:23.703362 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 275/546] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:42:23.708644 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a2205-2658-4bb9-a1ff-87a447302b00 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:23.708927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a2205-2658-4bb9-a1ff-87a447302b00 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:23.709289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a2205-2658-4bb9-a1ff-87a447302b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:23.737602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-361a2205-2658-4bb9-a1ff-87a447302b00 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:23.738841 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-361a2205-2658-4bb9-a1ff-87a447302b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:23.849517 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:23.859461 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c93d9b-55d5-48e0-8156-ae311cf563da None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:23.867247 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 276/547] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:42:23.897716 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f4f44-9c8a-44e0-aaca-47aadb1910ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:23.898370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f4f44-9c8a-44e0-aaca-47aadb1910ad None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:23.898646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f4f44-9c8a-44e0-aaca-47aadb1910ad None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:23.898923 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f4f44-9c8a-44e0-aaca-47aadb1910ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:23.909405 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f4f44-9c8a-44e0-aaca-47aadb1910ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:23.911054 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f4f44-9c8a-44e0-aaca-47aadb1910ad None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:23.912135 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a2205-2658-4bb9-a1ff-87a447302b00 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:23.927019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-b45f4f44-9c8a-44e0-aaca-47aadb1910ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:23.927019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:23.927019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:23.927019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:23.927019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:23.927019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:23.927019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:23.927019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:23.927019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:23.927019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:23.927019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:23.927019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:23.927019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:23.927019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:23.927019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:23.929087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:23.929087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:23.929087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:23.929087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:23.929087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:23.929087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:23.929087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:23.929087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:23.929087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:23.929087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:23.929087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:23.929087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:23.929087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:23.929087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:23.929087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:23.929087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:23.929087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:23.931155 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:23.931155 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:23.931155 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:23.931155 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:23.931155 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 272/548] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:23.938013 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f4f44-9c8a-44e0-aaca-47aadb1910ad None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:23.944550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:24.084619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a2205-2658-4bb9-a1ff-87a447302b00 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:24.115653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f4f44-9c8a-44e0-aaca-47aadb1910ad None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:24.153654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4738e2c-ef84-4c8a-9b4e-7eae11885eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:24.154338 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4738e2c-ef84-4c8a-9b4e-7eae11885eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:24.154712 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4738e2c-ef84-4c8a-9b4e-7eae11885eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:24.154976 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4738e2c-ef84-4c8a-9b4e-7eae11885eb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:24.155671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4738e2c-ef84-4c8a-9b4e-7eae11885eb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:24.155968 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4738e2c-ef84-4c8a-9b4e-7eae11885eb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:24.157441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4738e2c-ef84-4c8a-9b4e-7eae11885eb2 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:24.159567 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62484e53-f8c0-43af-a352-a0ffdf710b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:24.160363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62484e53-f8c0-43af-a352-a0ffdf710b7d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:24.160644 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62484e53-f8c0-43af-a352-a0ffdf710b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:24.160920 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62484e53-f8c0-43af-a352-a0ffdf710b7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:24.172322 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 273/549] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:24.178087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4738e2c-ef84-4c8a-9b4e-7eae11885eb2 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:24.190063 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:24.194057 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62484e53-f8c0-43af-a352-a0ffdf710b7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:24.200118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-62484e53-f8c0-43af-a352-a0ffdf710b7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:24.200118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:24.200118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:24.200118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:24.200118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:24.200118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:24.200118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:24.200118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:24.200118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:24.200118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:24.200118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:24.200118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:24.200118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:24.200118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:24.200118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:24.200118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:24.202776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:24.202776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:24.202776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:24.202776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:24.202776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:24.202776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:24.202776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:24.202776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:24.202776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:24.202776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:24.202776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:24.202776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:24.202776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:24.202776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:24.202776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:24.202776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:24.204379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:24.204379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:24.204379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:24.204379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:24.204379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:24.204379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:24.204379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:24.204379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:24.204379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:24.204379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:24.204379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:24.204379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:24.210542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 277/550] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:42:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:24.211579 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62484e53-f8c0-43af-a352-a0ffdf710b7d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:24.313673 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4738e2c-ef84-4c8a-9b4e-7eae11885eb2 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:24.371039 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:24.384704 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539263a-fa1b-4cd5-b9d8-50aa561f42d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:24.385677 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539263a-fa1b-4cd5-b9d8-50aa561f42d5 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:24.386139 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539263a-fa1b-4cd5-b9d8-50aa561f42d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:24.386629 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539263a-fa1b-4cd5-b9d8-50aa561f42d5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:24.401764 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539263a-fa1b-4cd5-b9d8-50aa561f42d5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:24.403297 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539263a-fa1b-4cd5-b9d8-50aa561f42d5 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:24.407564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62484e53-f8c0-43af-a352-a0ffdf710b7d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:24.422706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-1539263a-fa1b-4cd5-b9d8-50aa561f42d5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:42:24.422706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:24.422706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:24.422706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:24.422706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:24.422706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:24.422706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:24.422706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:24.422706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:24.422706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:24.422706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:24.422706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:24.422706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:24.422706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:24.422706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:24.422706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:24.423671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:24.423671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:24.423671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:24.423671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:24.423671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:24.423671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:24.423671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:24.423671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:24.423671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:24.423671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:24.423671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:24.423671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:24.423671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:24.423671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:24.423671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:24.423671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:24.423671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:24.423671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:24.424743 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:24.424743 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:24.424743 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:24.424743 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:24.424743 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:24.424743 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:24.424743 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:24.424743 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:24.424743 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:42:24.424743 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:24.431788 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 274/551] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:42:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:42:24.432710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539263a-fa1b-4cd5-b9d8-50aa561f42d5 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:24.456752 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309e13a-a543-41f0-ae17-feb5e4911240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:24.457780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309e13a-a543-41f0-ae17-feb5e4911240 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:24.458436 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309e13a-a543-41f0-ae17-feb5e4911240 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:24.458720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309e13a-a543-41f0-ae17-feb5e4911240 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:24.459443 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309e13a-a543-41f0-ae17-feb5e4911240 None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:24.459752 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309e13a-a543-41f0-ae17-feb5e4911240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:24.461186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309e13a-a543-41f0-ae17-feb5e4911240 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:24.479073 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 278/552] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Jul 28 17:42:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:24.484594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309e13a-a543-41f0-ae17-feb5e4911240 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:24.525423 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:24.570471 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539263a-fa1b-4cd5-b9d8-50aa561f42d5 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:24.628477 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309e13a-a543-41f0-ae17-feb5e4911240 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:24.650673 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe99b8-8c80-4ec9-838e-28e86d3dde34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:24.651292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe99b8-8c80-4ec9-838e-28e86d3dde34 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:24.651568 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe99b8-8c80-4ec9-838e-28e86d3dde34 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:24.651838 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe99b8-8c80-4ec9-838e-28e86d3dde34 None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:24.652635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe99b8-8c80-4ec9-838e-28e86d3dde34 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:24.652938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe99b8-8c80-4ec9-838e-28e86d3dde34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:24.655730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe99b8-8c80-4ec9-838e-28e86d3dde34 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:24.676884 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61f7ff-31df-47bc-93b8-1b21cddd200b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:24.677600 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61f7ff-31df-47bc-93b8-1b21cddd200b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:24.677967 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61f7ff-31df-47bc-93b8-1b21cddd200b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:24.678250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61f7ff-31df-47bc-93b8-1b21cddd200b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:24.681215 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:24.682898 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 275/553] 10.222.0.96 () {56 vars in 1135 bytes} [Thu Jul 28 17:42:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:24.684613 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b2ecc-d666-439c-90e7-11c37a566d01 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:24.684900 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b2ecc-d666-439c-90e7-11c37a566d01 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:24.685368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b2ecc-d666-439c-90e7-11c37a566d01 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:24.691102 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 276/554] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:24.691952 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b2ecc-d666-439c-90e7-11c37a566d01 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:24.692468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61f7ff-31df-47bc-93b8-1b21cddd200b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:24.694473 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61f7ff-31df-47bc-93b8-1b21cddd200b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:24.710560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-aa61f7ff-31df-47bc-93b8-1b21cddd200b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:24.710560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:24.710560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:24.710560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:24.710560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:24.710560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:24.710560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:24.710560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:24.710560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:24.710560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:24.710560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:24.710560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:24.710560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:24.710560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:24.710560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:24.711566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:24.711566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:24.711566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:24.711566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:24.711566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:24.711566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:24.711566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:24.711566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:24.711566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:24.711566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:24.711566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:24.711566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:24.711566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:24.711566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:24.711566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:24.711566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:24.711566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:24.712425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:24.712425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:24.712425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:24.712425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:24.712425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 279/555] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:42:24.716837 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be8b17-6b61-46b7-9200-d981d2c67e89 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:24.716837 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be8b17-6b61-46b7-9200-d981d2c67e89 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:24.716837 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be8b17-6b61-46b7-9200-d981d2c67e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:24.737540 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a3be8b17-6b61-46b7-9200-d981d2c67e89 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:24.739925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a3be8b17-6b61-46b7-9200-d981d2c67e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:24.816724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b2ecc-d666-439c-90e7-11c37a566d01 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:24.838389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 280/556] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:24.840030 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be8b17-6b61-46b7-9200-d981d2c67e89 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:24.845240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:24.858030 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74788063-6d53-40be-915d-319383bf03d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:24.858677 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74788063-6d53-40be-915d-319383bf03d3 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:24.858953 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74788063-6d53-40be-915d-319383bf03d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:24.859225 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74788063-6d53-40be-915d-319383bf03d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:24.931393 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74788063-6d53-40be-915d-319383bf03d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:24.932771 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74788063-6d53-40be-915d-319383bf03d3 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:24.949342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be8b17-6b61-46b7-9200-d981d2c67e89 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:24.967619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:24.985083 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bba910-d6f8-42f1-b8a1-f6a31257da69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:24.985711 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bba910-d6f8-42f1-b8a1-f6a31257da69 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:24.986042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bba910-d6f8-42f1-b8a1-f6a31257da69 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:24.986320 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bba910-d6f8-42f1-b8a1-f6a31257da69 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:24.987005 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bba910-d6f8-42f1-b8a1-f6a31257da69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:24.987505 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bba910-d6f8-42f1-b8a1-f6a31257da69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:24.988849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bba910-d6f8-42f1-b8a1-f6a31257da69 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:25.000579 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 281/557] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:25.001900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f699a90-da9d-48cc-97ab-13690766fa90 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:25.002187 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f699a90-da9d-48cc-97ab-13690766fa90 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:25.002461 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f699a90-da9d-48cc-97ab-13690766fa90 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:25.008129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 282/558] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:25.008860 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f699a90-da9d-48cc-97ab-13690766fa90 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:25.051132 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 277/559] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:42:25.052164 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74788063-6d53-40be-915d-319383bf03d3 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:25.086893 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:25.119408 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f699a90-da9d-48cc-97ab-13690766fa90 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:25.155127 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac610d64-54c0-4829-b899-bf0c7adc0849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:25.156342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac610d64-54c0-4829-b899-bf0c7adc0849 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:25.156794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac610d64-54c0-4829-b899-bf0c7adc0849 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:25.157706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac610d64-54c0-4829-b899-bf0c7adc0849 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:25.160980 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74788063-6d53-40be-915d-319383bf03d3 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:25.170154 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac610d64-54c0-4829-b899-bf0c7adc0849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:25.176312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-ac610d64-54c0-4829-b899-bf0c7adc0849 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:25.176312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:25.176312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:25.176312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:25.176312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:25.176312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:25.176312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:25.176312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:25.176312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:25.176312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:25.176312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:25.176312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:25.176312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:25.176312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:25.176312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:25.176312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:25.177402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:25.177402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:25.177402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:25.177402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:25.177402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:25.177402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:25.177402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:25.177402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:25.177402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:25.177402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:25.177402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:25.177402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:25.177402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:25.177402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:25.177402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:25.177402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:25.178200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:25.178200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:25.178200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:25.178200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:25.178200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:25.178200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:25.178200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:25.178200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:25.178200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:25.178200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:25.178200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:25.178200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:25.179174 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 283/560] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:42:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:25.180205 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662d3ac-18a0-48e1-bb90-802f0ae1487c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:25.180488 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662d3ac-18a0-48e1-bb90-802f0ae1487c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:25.180760 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662d3ac-18a0-48e1-bb90-802f0ae1487c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:25.201094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e662d3ac-18a0-48e1-bb90-802f0ae1487c None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:25.201289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae08ef-b6d3-4d58-b038-6bdfcb3dd7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:25.201755 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae08ef-b6d3-4d58-b038-6bdfcb3dd7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:25.202032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae08ef-b6d3-4d58-b038-6bdfcb3dd7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:25.202300 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae08ef-b6d3-4d58-b038-6bdfcb3dd7a7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:25.203278 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e662d3ac-18a0-48e1-bb90-802f0ae1487c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:25.210961 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae08ef-b6d3-4d58-b038-6bdfcb3dd7a7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:25.212436 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae08ef-b6d3-4d58-b038-6bdfcb3dd7a7 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:25.227949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-06ae08ef-b6d3-4d58-b038-6bdfcb3dd7a7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:42:25.227949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:25.227949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:25.227949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:25.227949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:25.227949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:25.227949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:25.227949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:25.227949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:25.227949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:25.227949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:25.227949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:25.227949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:25.227949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:25.227949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:25.227949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:25.229009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:25.229009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:25.229009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:25.229009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:25.229009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:25.229009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:25.229009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:25.229009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:25.229009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:25.229009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:25.229009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:25.229009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:25.229009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:25.229009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:25.229009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:25.229009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:25.229009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:25.229009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:25.230381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:25.230381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:25.230381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:25.230381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:25.230381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:25.230381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:25.230381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:25.230381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:25.230381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:42:25.230381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:25.230381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 278/561] 10.222.0.96 () {56 vars in 1093 bytes} [Thu Jul 28 17:42:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:25.230381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae08ef-b6d3-4d58-b038-6bdfcb3dd7a7 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:25.243570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:25.288161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 284/562] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:25.288845 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662d3ac-18a0-48e1-bb90-802f0ae1487c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:25.346291 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:25.363430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae08ef-b6d3-4d58-b038-6bdfcb3dd7a7 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:25.391290 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662d3ac-18a0-48e1-bb90-802f0ae1487c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:25.402028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32883301-28de-4db0-9966-6c446349fb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:25.403077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32883301-28de-4db0-9966-6c446349fb6e None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:25.403509 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32883301-28de-4db0-9966-6c446349fb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:25.403793 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32883301-28de-4db0-9966-6c446349fb6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:25.415378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32883301-28de-4db0-9966-6c446349fb6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:25.417074 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32883301-28de-4db0-9966-6c446349fb6e None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:25.428583 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b533e91-e12a-4740-ade2-715528f854a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:25.429245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b533e91-e12a-4740-ade2-715528f854a3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:25.429605 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b533e91-e12a-4740-ade2-715528f854a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:25.429854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b533e91-e12a-4740-ade2-715528f854a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:25.430567 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b533e91-e12a-4740-ade2-715528f854a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:25.430870 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b533e91-e12a-4740-ade2-715528f854a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:25.431984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-32883301-28de-4db0-9966-6c446349fb6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:25.431984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:25.431984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:25.431984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:25.431984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:25.431984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:25.431984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:25.431984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:25.431984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:25.431984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:25.431984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:25.431984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:25.431984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:25.431984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:25.431984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:25.432779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:25.432779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:25.432779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:25.432779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:25.432779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:25.432779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:25.432779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:25.432779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:25.432779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:25.432779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:25.432779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:25.432779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:25.432779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:25.432779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:25.432779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:25.432779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:25.432779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:25.434023 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:25.434023 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:25.434023 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:25.434023 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:25.434237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b533e91-e12a-4740-ade2-715528f854a3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:25.434305 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 279/563] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:25.434305 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32883301-28de-4db0-9966-6c446349fb6e None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:25.450956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 285/564] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Jul 28 17:42:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:25.450956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b533e91-e12a-4740-ade2-715528f854a3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:25.481997 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:25.546534 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32883301-28de-4db0-9966-6c446349fb6e None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:25.556933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b533e91-e12a-4740-ade2-715528f854a3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:25.586237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e31cc7-c0a9-4c64-83a6-4d08f89da073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:25.586864 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e31cc7-c0a9-4c64-83a6-4d08f89da073 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:25.587144 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e31cc7-c0a9-4c64-83a6-4d08f89da073 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:25.587419 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e31cc7-c0a9-4c64-83a6-4d08f89da073 None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:25.588245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e31cc7-c0a9-4c64-83a6-4d08f89da073 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:25.588551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e31cc7-c0a9-4c64-83a6-4d08f89da073 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:25.590053 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e31cc7-c0a9-4c64-83a6-4d08f89da073 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:25.592610 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be57aed-fb19-40d9-b322-e4b587c0dbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:25.593293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be57aed-fb19-40d9-b322-e4b587c0dbc7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:25.593571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be57aed-fb19-40d9-b322-e4b587c0dbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:25.593837 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be57aed-fb19-40d9-b322-e4b587c0dbc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:25.599919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:25.607219 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be57aed-fb19-40d9-b322-e4b587c0dbc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:25.613577 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 280/565] 10.222.0.96 () {56 vars in 1133 bytes} [Thu Jul 28 17:42:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:25.613577 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e31cc7-c0a9-4c64-83a6-4d08f89da073 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:25.613794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-8be57aed-fb19-40d9-b322-e4b587c0dbc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:25.613794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:25.613794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:25.613794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:25.613794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:25.613794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:25.613794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:25.613794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:25.613794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:25.613794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:25.613794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:25.613794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:25.613794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:25.613794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:25.613794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:25.613794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:25.614784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:25.614784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:25.614784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:25.614784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:25.614784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:25.614784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:25.614784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:25.614784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:25.614784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:25.614784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:25.614784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:25.614784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:25.614784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:25.614784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:25.614784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:25.614784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:25.616260 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:25.616260 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:25.616260 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:25.616260 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:25.616260 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:25.616260 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:25.616260 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:25.616260 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:25.616260 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:25.616260 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:25.616260 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:25.616260 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:25.619037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 286/566] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:42:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:25.619906 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be57aed-fb19-40d9-b322-e4b587c0dbc7 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:25.716452 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e31cc7-c0a9-4c64-83a6-4d08f89da073 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:25.717026 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:25.727106 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be57aed-fb19-40d9-b322-e4b587c0dbc7 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:25.750325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349dc4c-2c20-482a-a665-51682c657869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:25.750869 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349dc4c-2c20-482a-a665-51682c657869 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:25.751145 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349dc4c-2c20-482a-a665-51682c657869 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:25.751417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349dc4c-2c20-482a-a665-51682c657869 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:25.752135 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349dc4c-2c20-482a-a665-51682c657869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:25.752431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349dc4c-2c20-482a-a665-51682c657869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:25.753835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349dc4c-2c20-482a-a665-51682c657869 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:25.760344 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262345f-68fb-40b8-807d-d705aa9a5f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:25.760993 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262345f-68fb-40b8-807d-d705aa9a5f5e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:25.761302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262345f-68fb-40b8-807d-d705aa9a5f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:25.761575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262345f-68fb-40b8-807d-d705aa9a5f5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:25.765640 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 281/567] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:25.766457 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349dc4c-2c20-482a-a665-51682c657869 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:25.774017 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262345f-68fb-40b8-807d-d705aa9a5f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:25.775475 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262345f-68fb-40b8-807d-d705aa9a5f5e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:25.791516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-8262345f-68fb-40b8-807d-d705aa9a5f5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:25.791516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:25.791516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:25.791516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:25.791516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:25.791516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:25.791516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:25.791516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:25.791516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:25.791516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:25.791516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:25.791516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:25.791516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:25.791516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:25.791516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:25.792580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:25.792580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:25.792580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:25.792580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:25.792580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:25.792580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:25.792580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:25.792580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:25.792580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:25.792580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:25.792580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:25.792580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:25.792580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:25.792580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:25.792580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:25.792580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:25.792580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:25.793619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:25.793619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:25.793619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:25.793619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:25.793619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 287/568] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:25.797923 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262345f-68fb-40b8-807d-d705aa9a5f5e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:25.826397 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:25.870065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349dc4c-2c20-482a-a665-51682c657869 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:25.896128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262345f-68fb-40b8-807d-d705aa9a5f5e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:25.902900 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad3d97-8be2-4ad5-9f6d-533f7bdfe94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:25.903546 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad3d97-8be2-4ad5-9f6d-533f7bdfe94e None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:25.903858 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad3d97-8be2-4ad5-9f6d-533f7bdfe94e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:25.904136 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad3d97-8be2-4ad5-9f6d-533f7bdfe94e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:25.915492 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad3d97-8be2-4ad5-9f6d-533f7bdfe94e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:25.917178 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad3d97-8be2-4ad5-9f6d-533f7bdfe94e None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:25.928827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22922963-42ae-423a-b92b-411832308e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:25.929477 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22922963-42ae-423a-b92b-411832308e56 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:25.929755 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22922963-42ae-423a-b92b-411832308e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:25.930025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22922963-42ae-423a-b92b-411832308e56 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:25.930715 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22922963-42ae-423a-b92b-411832308e56 None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:25.931013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22922963-42ae-423a-b92b-411832308e56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:25.931154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-0aad3d97-8be2-4ad5-9f6d-533f7bdfe94e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:25.931154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:25.931154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:25.931154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:25.931154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:25.931154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:25.931154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:25.931154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:25.931154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:25.931154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:25.931154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:25.931154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:25.931154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:25.931154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:25.931154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:25.932117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:25.932117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:25.932117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:25.932117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:25.932117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:25.932117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:25.932117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:25.932117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:25.932117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:25.932117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:25.932117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:25.932117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:25.932117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:25.932117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:25.932117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:25.932117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:25.932117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:25.933246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:25.933246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:25.933246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:25.933246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:25.933513 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22922963-42ae-423a-b92b-411832308e56 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:25.937156 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 282/569] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:25.938272 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f19520-fabb-4b0e-932d-38a1bc5ea9ad None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:25.938555 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f19520-fabb-4b0e-932d-38a1bc5ea9ad None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:25.938837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f19520-fabb-4b0e-932d-38a1bc5ea9ad None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:25.940069 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 283/570] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:25.944330 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 288/571] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Jul 28 17:42:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:25.944447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f19520-fabb-4b0e-932d-38a1bc5ea9ad None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:25.944535 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22922963-42ae-423a-b92b-411832308e56 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:25.947664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:26.045768 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f19520-fabb-4b0e-932d-38a1bc5ea9ad None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:26.046400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22922963-42ae-423a-b92b-411832308e56 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:26.056075 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:26.080437 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9937b4-7222-45ab-9898-b258657e30be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:26.081068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9937b4-7222-45ab-9898-b258657e30be None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:26.081359 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9937b4-7222-45ab-9898-b258657e30be None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:26.081627 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9937b4-7222-45ab-9898-b258657e30be None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:26.082015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e230f6-e4ba-432c-a575-ed9896c29029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:26.082300 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9937b4-7222-45ab-9898-b258657e30be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:26.082597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9937b4-7222-45ab-9898-b258657e30be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:26.082683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e230f6-e4ba-432c-a575-ed9896c29029 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:26.082927 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e230f6-e4ba-432c-a575-ed9896c29029 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:26.083201 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e230f6-e4ba-432c-a575-ed9896c29029 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:26.084137 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9937b4-7222-45ab-9898-b258657e30be None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:26.090089 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e230f6-e4ba-432c-a575-ed9896c29029 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:26.091538 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e230f6-e4ba-432c-a575-ed9896c29029 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:26.096182 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 289/572] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:26.096996 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9937b4-7222-45ab-9898-b258657e30be None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:26.103569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-16e230f6-e4ba-432c-a575-ed9896c29029 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:26.103569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:26.103569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:26.103569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:26.103569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:26.103569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:26.103569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:26.103569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:26.103569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:26.103569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:26.103569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:26.103569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:26.103569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:26.103569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:26.103569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:26.109240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:26.109240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:26.109240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:26.109240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:26.109240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:26.109240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:26.109240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:26.109240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:26.109240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:26.109240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:26.109240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:26.109240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:26.109240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:26.109240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:26.109240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:26.109240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:26.109240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:26.110242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:26.110242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:26.110242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:26.110242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:26.110242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:26.110242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:26.110242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:26.110242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:26.110242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 284/573] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:26.110242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41b226-eeb6-4165-b168-356a3b0c826b None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:26.110242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41b226-eeb6-4165-b168-356a3b0c826b None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:26.110835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41b226-eeb6-4165-b168-356a3b0c826b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:26.125440 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-6a41b226-eeb6-4165-b168-356a3b0c826b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:26.126650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6a41b226-eeb6-4165-b168-356a3b0c826b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:26.165591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:26.195244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 285/574] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:26.196094 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41b226-eeb6-4165-b168-356a3b0c826b None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:26.204133 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9937b4-7222-45ab-9898-b258657e30be None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:26.241625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74ee04-8b3a-4004-b95f-76e56ce5cc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:26.242241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74ee04-8b3a-4004-b95f-76e56ce5cc34 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:26.242520 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74ee04-8b3a-4004-b95f-76e56ce5cc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:26.242791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74ee04-8b3a-4004-b95f-76e56ce5cc34 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:26.243488 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74ee04-8b3a-4004-b95f-76e56ce5cc34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:26.243784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74ee04-8b3a-4004-b95f-76e56ce5cc34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:26.245172 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74ee04-8b3a-4004-b95f-76e56ce5cc34 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:26.256549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 290/575] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:26.257372 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74ee04-8b3a-4004-b95f-76e56ce5cc34 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:26.307345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:26.312444 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41b226-eeb6-4165-b168-356a3b0c826b None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:26.347997 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fdbd4-d5cc-48ba-8e7c-6e7d0bf995bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:26.348624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fdbd4-d5cc-48ba-8e7c-6e7d0bf995bd None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:26.348928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fdbd4-d5cc-48ba-8e7c-6e7d0bf995bd None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:26.349386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fdbd4-d5cc-48ba-8e7c-6e7d0bf995bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:26.356318 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74ee04-8b3a-4004-b95f-76e56ce5cc34 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:26.360111 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fdbd4-d5cc-48ba-8e7c-6e7d0bf995bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:26.361627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fdbd4-d5cc-48ba-8e7c-6e7d0bf995bd None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:26.376243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-065fdbd4-d5cc-48ba-8e7c-6e7d0bf995bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:26.376243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:26.376243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:26.376243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:26.376243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:26.376243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:26.376243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:26.376243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:26.376243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:26.376243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:26.376243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:26.376243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:26.376243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:26.376243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:26.376243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:26.377186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:26.377186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:26.377186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:26.377186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:26.377186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:26.377186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:26.377186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:26.377186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:26.377186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:26.377186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:26.377186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:26.377186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:26.377186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:26.377186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:26.377186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:26.377186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:26.377186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:26.378089 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:26.378089 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:26.378089 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:26.378089 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:26.378089 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 286/576] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:26.378360 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fdbd4-d5cc-48ba-8e7c-6e7d0bf995bd None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:26.384589 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:26.397179 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c4c0f-90fa-45a9-9f0f-cb94aa79e5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:26.397814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c4c0f-90fa-45a9-9f0f-cb94aa79e5be None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:26.398099 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c4c0f-90fa-45a9-9f0f-cb94aa79e5be None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:26.398374 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c4c0f-90fa-45a9-9f0f-cb94aa79e5be None admin] PATH_INFO: `/v3/users/glance` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:26.406014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c4c0f-90fa-45a9-9f0f-cb94aa79e5be None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:26.407510 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c4c0f-90fa-45a9-9f0f-cb94aa79e5be None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:26.419006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-d83c4c0f-90fa-45a9-9f0f-cb94aa79e5be None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 17:42:26.419006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:26.419006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:26.419006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:26.419006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:26.419006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:26.419006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:26.419006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:26.419006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:26.419006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:26.419006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:26.419006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:26.419006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:26.419006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:26.419006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:26.419006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:26.419969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:26.419969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:26.419969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:26.419969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:26.419969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:26.419969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:26.419969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:26.419969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:26.419969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:26.419969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:26.419969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:26.419969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:26.419969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:26.419969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:26.419969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:26.419969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:26.419969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:26.419969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:26.420924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:26.420924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:26.420924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:26.420924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:26.420924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:26.420924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:26.420924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:26.420924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:26.420924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 17:42:26.420924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:26.420924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 291/577] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:42:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:26.420924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c4c0f-90fa-45a9-9f0f-cb94aa79e5be None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:26.482077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fdbd4-d5cc-48ba-8e7c-6e7d0bf995bd None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:26.517897 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c046d5c-d68b-4d99-9e17-b1ead63ed569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:26.518513 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c046d5c-d68b-4d99-9e17-b1ead63ed569 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:26.518787 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c046d5c-d68b-4d99-9e17-b1ead63ed569 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:26.519064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c046d5c-d68b-4d99-9e17-b1ead63ed569 None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:26.519813 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c046d5c-d68b-4d99-9e17-b1ead63ed569 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:26.520114 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c046d5c-d68b-4d99-9e17-b1ead63ed569 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:26.521692 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c046d5c-d68b-4d99-9e17-b1ead63ed569 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:26.523251 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c4c0f-90fa-45a9-9f0f-cb94aa79e5be None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:26.533461 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 287/578] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:26.534250 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c046d5c-d68b-4d99-9e17-b1ead63ed569 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:26.547548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:26.559437 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b714bc-2792-4076-837f-a64152474ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:26.560018 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b714bc-2792-4076-837f-a64152474ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:26.560296 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b714bc-2792-4076-837f-a64152474ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:26.560566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b714bc-2792-4076-837f-a64152474ce4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:26.570976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b714bc-2792-4076-837f-a64152474ce4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:26.576333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-e4b714bc-2792-4076-837f-a64152474ce4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:26.576333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:26.576333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:26.576333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:26.576333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:26.576333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:26.576333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:26.576333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:26.576333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:26.576333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:26.576333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:26.576333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:26.576333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:26.576333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:26.576333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:26.576333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:26.577291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:26.577291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:26.577291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:26.577291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:26.577291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:26.577291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:26.577291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:26.577291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:26.577291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:26.577291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:26.577291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:26.577291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:26.577291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:26.577291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:26.577291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:26.577291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:26.578163 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:26.578163 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:26.578163 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:26.578163 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:26.578163 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:26.578163 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:26.578163 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:26.578163 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:26.578163 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:26.578163 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:26.578163 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:26.578163 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:26.578163 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 292/579] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:42:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:26.578862 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b714bc-2792-4076-837f-a64152474ce4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:26.625250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:26.636875 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c046d5c-d68b-4d99-9e17-b1ead63ed569 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:26.672423 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bd487-fb5c-4a2e-9fdd-eb04a17cc06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:26.673115 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bd487-fb5c-4a2e-9fdd-eb04a17cc06c None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:26.673392 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bd487-fb5c-4a2e-9fdd-eb04a17cc06c None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:26.673661 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bd487-fb5c-4a2e-9fdd-eb04a17cc06c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:26.680458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bd487-fb5c-4a2e-9fdd-eb04a17cc06c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:26.680925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b714bc-2792-4076-837f-a64152474ce4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:26.681926 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bd487-fb5c-4a2e-9fdd-eb04a17cc06c None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:26.693255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-2e2bd487-fb5c-4a2e-9fdd-eb04a17cc06c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:26.693255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:26.693255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:26.693255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:26.693255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:26.693255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:26.693255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:26.693255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:26.693255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:26.693255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:26.693255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:26.693255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:26.693255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:26.693255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:26.693255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:26.694189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:26.694189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:26.694189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:26.694189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:26.694189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:26.694189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:26.694189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:26.694189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:26.694189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:26.694189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:26.694189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:26.694189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:26.694189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:26.694189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:26.694189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:26.694189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:26.694189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:26.695982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:26.695982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:26.695982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:26.695982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:26.695982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:26.695982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:26.695982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:26.695982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:26.695982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 288/580] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:26.695982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bd487-fb5c-4a2e-9fdd-eb04a17cc06c None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:26.720407 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d927270-d738-48a3-b192-c0b63254cd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:26.721025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d927270-d738-48a3-b192-c0b63254cd34 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:26.721327 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d927270-d738-48a3-b192-c0b63254cd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:26.721593 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d927270-d738-48a3-b192-c0b63254cd34 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:26.722268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d927270-d738-48a3-b192-c0b63254cd34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:26.722561 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d927270-d738-48a3-b192-c0b63254cd34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:26.724000 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d927270-d738-48a3-b192-c0b63254cd34 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:26.736216 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 293/581] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:26.737021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d927270-d738-48a3-b192-c0b63254cd34 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:26.769459 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:26.803265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bd487-fb5c-4a2e-9fdd-eb04a17cc06c None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:26.839912 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30144655-8971-4249-9df1-4fc5e282fff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:26.840310 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d927270-d738-48a3-b192-c0b63254cd34 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:26.840474 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30144655-8971-4249-9df1-4fc5e282fff1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:26.840714 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30144655-8971-4249-9df1-4fc5e282fff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:26.840990 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30144655-8971-4249-9df1-4fc5e282fff1 None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:26.841806 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30144655-8971-4249-9df1-4fc5e282fff1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:26.842105 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30144655-8971-4249-9df1-4fc5e282fff1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:26.842695 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:26.843548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30144655-8971-4249-9df1-4fc5e282fff1 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:26.862386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 289/582] 10.222.0.96 () {56 vars in 1137 bytes} [Thu Jul 28 17:42:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:26.863197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30144655-8971-4249-9df1-4fc5e282fff1 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:26.879871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e1e27-774b-4402-a2f2-8d68bef5ffa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:26.880908 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e1e27-774b-4402-a2f2-8d68bef5ffa3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:26.880908 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e1e27-774b-4402-a2f2-8d68bef5ffa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:26.881229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e1e27-774b-4402-a2f2-8d68bef5ffa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:26.882029 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e1e27-774b-4402-a2f2-8d68bef5ffa3 None admin] RBAC: Adding query filter params (role.id=f8cbbf969cfc442595755799825094f6, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=4ea1a9023eaf427f96f86af909a803fd) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:26.882345 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e1e27-774b-4402-a2f2-8d68bef5ffa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:26.883792 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e1e27-774b-4402-a2f2-8d68bef5ffa3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:26.889617 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 294/583] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:42:26 2022] GET /identity/v3/role_assignments?user.id=4ea1a9023eaf427f96f86af909a803fd&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=f8cbbf969cfc442595755799825094f6 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:26.890394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e1e27-774b-4402-a2f2-8d68bef5ffa3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:26.975665 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30144655-8971-4249-9df1-4fc5e282fff1 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:27.009884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:27.027793 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76d69a-258b-4ff5-ba91-4cfe94f9e99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:27.028883 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76d69a-258b-4ff5-ba91-4cfe94f9e99d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:27.029234 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76d69a-258b-4ff5-ba91-4cfe94f9e99d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:27.029511 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76d69a-258b-4ff5-ba91-4cfe94f9e99d None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:27.030252 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76d69a-258b-4ff5-ba91-4cfe94f9e99d None admin] RBAC: Adding query filter params (name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:27.030556 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76d69a-258b-4ff5-ba91-4cfe94f9e99d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:27.031959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76d69a-258b-4ff5-ba91-4cfe94f9e99d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:27.035821 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e1e27-774b-4402-a2f2-8d68bef5ffa3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:27.045973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 290/584] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Jul 28 17:42:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:27.045973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76d69a-258b-4ff5-ba91-4cfe94f9e99d None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:27.078216 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06335186-f0cb-480b-bdc5-2e403c87e679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:27.078903 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06335186-f0cb-480b-bdc5-2e403c87e679 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:27.079206 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06335186-f0cb-480b-bdc5-2e403c87e679 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:27.079462 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06335186-f0cb-480b-bdc5-2e403c87e679 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:27.080229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06335186-f0cb-480b-bdc5-2e403c87e679 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:27.080521 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06335186-f0cb-480b-bdc5-2e403c87e679 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:27.082014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06335186-f0cb-480b-bdc5-2e403c87e679 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:27.104891 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 295/585] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:27.104891 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06335186-f0cb-480b-bdc5-2e403c87e679 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:27.136562 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:27.160053 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76d69a-258b-4ff5-ba91-4cfe94f9e99d None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:27.194792 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc4330-8f83-4360-88bc-5aa1d1dd7ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:27.195549 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc4330-8f83-4360-88bc-5aa1d1dd7ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:27.195892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc4330-8f83-4360-88bc-5aa1d1dd7ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:27.196229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc4330-8f83-4360-88bc-5aa1d1dd7ef1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:27.203991 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc4330-8f83-4360-88bc-5aa1d1dd7ef1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:27.205502 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc4330-8f83-4360-88bc-5aa1d1dd7ef1 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:27.215469 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06335186-f0cb-480b-bdc5-2e403c87e679 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:27.216917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-5cdc4330-8f83-4360-88bc-5aa1d1dd7ef1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:42:27.216917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:27.216917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:27.216917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:27.216917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:27.216917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:27.216917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:27.216917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:27.216917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:27.216917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:27.216917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:27.216917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:27.216917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:27.216917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:27.216917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:27.216917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:27.218027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:27.218027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:27.218027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:27.218027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:27.218027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:27.218027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:27.218027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:27.218027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:27.218027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:27.218027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:27.218027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:27.218027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:27.218027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:27.218027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:27.218027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:27.218027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:27.218027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:27.218027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:27.218977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:27.218977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:27.218977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:27.218977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:27.218977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:27.218977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:27.218977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:27.218977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:27.218977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:42:27.218977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:27.218977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 291/586] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:42:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:27.219550 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc4330-8f83-4360-88bc-5aa1d1dd7ef1 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:27.260869 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd4775-5aca-43f4-8736-e216c14e71cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:27.261553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd4775-5aca-43f4-8736-e216c14e71cb None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:27.261835 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd4775-5aca-43f4-8736-e216c14e71cb None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:27.262110 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd4775-5aca-43f4-8736-e216c14e71cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:27.272931 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd4775-5aca-43f4-8736-e216c14e71cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:27.274461 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd4775-5aca-43f4-8736-e216c14e71cb None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:27.284666 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:27.289900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-a0fd4775-5aca-43f4-8736-e216c14e71cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:27.289900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:27.289900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:27.289900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:27.289900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:27.289900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:27.289900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:27.289900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:27.289900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:27.289900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:27.289900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:27.289900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:27.289900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:27.289900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:27.289900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:27.290801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:27.290801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:27.290801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:27.290801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:27.290801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:27.290801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:27.290801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:27.290801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:27.290801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:27.290801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:27.290801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:27.290801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:27.290801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:27.290801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:27.290801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:27.290801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:27.290801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:27.291667 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:27.291667 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:27.291667 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:27.291667 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:27.291667 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 296/587] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:27.291947 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd4775-5aca-43f4-8736-e216c14e71cb None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:27.341960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc4330-8f83-4360-88bc-5aa1d1dd7ef1 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:27.379327 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f212b-42e5-4e3e-84c5-5367d99434de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:27.380450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f212b-42e5-4e3e-84c5-5367d99434de None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:27.380859 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f212b-42e5-4e3e-84c5-5367d99434de None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:27.381170 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f212b-42e5-4e3e-84c5-5367d99434de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:27.383305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:27.395888 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f212b-42e5-4e3e-84c5-5367d99434de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:27.397906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f212b-42e5-4e3e-84c5-5367d99434de None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:27.405676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd4775-5aca-43f4-8736-e216c14e71cb None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:27.413323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-2b7f212b-42e5-4e3e-84c5-5367d99434de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:27.413323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:27.413323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:27.413323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:27.413323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:27.413323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:27.413323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:27.413323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:27.413323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:27.413323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:27.413323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:27.413323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:27.413323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:27.413323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:27.413323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:27.414301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:27.414301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:27.414301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:27.414301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:27.414301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:27.414301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:27.414301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:27.414301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:27.414301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:27.414301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:27.414301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:27.414301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:27.414301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:27.414301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:27.414301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:27.414301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:27.414301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:27.415377 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:27.415377 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:27.415377 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:27.415377 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:27.420991 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 292/588] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:27.420991 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f212b-42e5-4e3e-84c5-5367d99434de None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:27.450102 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007f384-a5e7-4969-b15e-b16e6d3769a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:27.451020 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007f384-a5e7-4969-b15e-b16e6d3769a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:27.451446 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007f384-a5e7-4969-b15e-b16e6d3769a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:27.451896 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007f384-a5e7-4969-b15e-b16e6d3769a2 None admin] PATH_INFO: `/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/5ac367247aa54671ae5c33d251017470/roles/f8cbbf969cfc442595755799825094f6` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:27.469883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007f384-a5e7-4969-b15e-b16e6d3769a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=db5ce5e789e949d09c183dbe04e53f19, user_id=5ac367247aa54671ae5c33d251017470, role_id=f8cbbf969cfc442595755799825094f6)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:27.471522 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007f384-a5e7-4969-b15e-b16e6d3769a2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:27.493177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 297/589] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:42:27 2022] PUT /identity/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/5ac367247aa54671ae5c33d251017470/roles/f8cbbf969cfc442595755799825094f6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:42:27.495818 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007f384-a5e7-4969-b15e-b16e6d3769a2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:27.527864 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f212b-42e5-4e3e-84c5-5367d99434de None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:27.539524 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:27.580492 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81af0fe-79ec-4a2c-aaea-6f5100341edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:27.581216 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81af0fe-79ec-4a2c-aaea-6f5100341edc None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:27.581494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81af0fe-79ec-4a2c-aaea-6f5100341edc None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:27.582060 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81af0fe-79ec-4a2c-aaea-6f5100341edc None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:27.582896 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81af0fe-79ec-4a2c-aaea-6f5100341edc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:27.583986 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81af0fe-79ec-4a2c-aaea-6f5100341edc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:27.586009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81af0fe-79ec-4a2c-aaea-6f5100341edc None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:27.612332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 293/590] 10.222.0.96 () {56 vars in 1137 bytes} [Thu Jul 28 17:42:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:27.613272 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81af0fe-79ec-4a2c-aaea-6f5100341edc None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:27.628531 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007f384-a5e7-4969-b15e-b16e6d3769a2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:27.668777 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:27.675138 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4bbc99-c96d-4819-b2bc-5e5bbe477b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:27.676370 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bbc99-c96d-4819-b2bc-5e5bbe477b31 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:27.676633 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bbc99-c96d-4819-b2bc-5e5bbe477b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:27.677873 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bbc99-c96d-4819-b2bc-5e5bbe477b31 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:27.678836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bbc99-c96d-4819-b2bc-5e5bbe477b31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:27.679300 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bbc99-c96d-4819-b2bc-5e5bbe477b31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:27.680950 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bbc99-c96d-4819-b2bc-5e5bbe477b31 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:27.696424 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 298/591] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:27.697431 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4bbc99-c96d-4819-b2bc-5e5bbe477b31 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:27.734609 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81af0fe-79ec-4a2c-aaea-6f5100341edc None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:27.771009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8f3e5-6424-4670-9cc0-aec1cde048dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:27.772343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8f3e5-6424-4670-9cc0-aec1cde048dd None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:27.772826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8f3e5-6424-4670-9cc0-aec1cde048dd None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:27.773371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8f3e5-6424-4670-9cc0-aec1cde048dd None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:27.774260 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8f3e5-6424-4670-9cc0-aec1cde048dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:27.774759 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8f3e5-6424-4670-9cc0-aec1cde048dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:27.776351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8f3e5-6424-4670-9cc0-aec1cde048dd None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:27.793461 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 294/592] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:27.794767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8f3e5-6424-4670-9cc0-aec1cde048dd None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:27.803178 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4bbc99-c96d-4819-b2bc-5e5bbe477b31 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:27.823486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:27.843837 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adda7d0-8ade-4831-9b81-7783bd1e8daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:27.844543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adda7d0-8ade-4831-9b81-7783bd1e8daa None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:27.844824 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adda7d0-8ade-4831-9b81-7783bd1e8daa None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:27.845138 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adda7d0-8ade-4831-9b81-7783bd1e8daa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:27.856726 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adda7d0-8ade-4831-9b81-7783bd1e8daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:27.858303 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adda7d0-8ade-4831-9b81-7783bd1e8daa None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:27.873575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-3adda7d0-8ade-4831-9b81-7783bd1e8daa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:27.873575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:27.873575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:27.873575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:27.873575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:27.873575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:27.873575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:27.873575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:27.873575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:27.873575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:27.873575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:27.873575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:27.873575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:27.873575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:27.873575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:27.874707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:27.874707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:27.874707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:27.874707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:27.874707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:27.874707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:27.874707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:27.874707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:27.874707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:27.874707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:27.874707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:27.874707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:27.874707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:27.874707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:27.874707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:27.874707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:27.874707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:27.875801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:27.875801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:27.875801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:27.875801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:27.875801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 299/593] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:27.875801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adda7d0-8ade-4831-9b81-7783bd1e8daa None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:27.906709 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8f3e5-6424-4670-9cc0-aec1cde048dd None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:27.921494 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:27.951056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e22cc1-4ede-4ef1-9048-62bb5ec8adbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:27.951056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e22cc1-4ede-4ef1-9048-62bb5ec8adbd None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:27.951056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e22cc1-4ede-4ef1-9048-62bb5ec8adbd None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:27.951056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e22cc1-4ede-4ef1-9048-62bb5ec8adbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:27.956836 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e22cc1-4ede-4ef1-9048-62bb5ec8adbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:27.958403 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e22cc1-4ede-4ef1-9048-62bb5ec8adbd None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:27.970971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-47e22cc1-4ede-4ef1-9048-62bb5ec8adbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:27.970971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:27.970971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:27.970971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:27.970971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:27.970971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:27.970971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:27.970971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:27.970971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:27.970971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:27.970971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:27.970971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:27.970971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:27.970971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:27.970971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:27.971887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:27.971887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:27.971887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:27.971887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:27.971887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:27.971887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:27.971887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:27.971887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:27.971887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:27.971887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:27.971887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:27.971887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:27.971887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:27.971887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:27.971887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:27.971887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:27.971887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:27.972760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:27.972760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:27.972760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:27.972760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:27.972760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:27.972760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:27.972760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:27.972760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:27.977167 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 295/594] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:27.978248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e22cc1-4ede-4ef1-9048-62bb5ec8adbd None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:27.984274 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adda7d0-8ade-4831-9b81-7783bd1e8daa None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:28.022381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d92a5-62a1-4525-8811-12b8db6ed347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:28.023058 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d92a5-62a1-4525-8811-12b8db6ed347 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:28.026196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d92a5-62a1-4525-8811-12b8db6ed347 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:28.026196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d92a5-62a1-4525-8811-12b8db6ed347 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:28.038072 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d92a5-62a1-4525-8811-12b8db6ed347 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:28.038072 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d92a5-62a1-4525-8811-12b8db6ed347 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:28.047369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-0f8d92a5-62a1-4525-8811-12b8db6ed347 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 17:42:28.047369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:28.047369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:28.047369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:28.047369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:28.047369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:28.047369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:28.047369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:28.047369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:28.047369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:28.047369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:28.047369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:28.047369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:28.047369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:28.047369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:28.047369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:28.048279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:28.048279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:28.048279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:28.048279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:28.048279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:28.048279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:28.048279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:28.048279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:28.048279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:28.048279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:28.048279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:28.048279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:28.048279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:28.048279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:28.048279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:28.048279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:28.048279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:28.048279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:28.049263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:28.049263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:28.049263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:28.049263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:28.049263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:28.049263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:28.049263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:28.049263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:28.049263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 17:42:28.049263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:28.049263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 300/595] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:42:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:28.049832 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d92a5-62a1-4525-8811-12b8db6ed347 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:28.083745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:28.112032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e22cc1-4ede-4ef1-9048-62bb5ec8adbd None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:28.156957 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d92a5-62a1-4525-8811-12b8db6ed347 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:28.158954 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:28.160551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46692247-13c1-4758-9df9-6977195fdf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:28.162583 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46692247-13c1-4758-9df9-6977195fdf9b None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:28.162844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46692247-13c1-4758-9df9-6977195fdf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:28.163131 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46692247-13c1-4758-9df9-6977195fdf9b None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:28.164076 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46692247-13c1-4758-9df9-6977195fdf9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:28.164382 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46692247-13c1-4758-9df9-6977195fdf9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:28.165825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46692247-13c1-4758-9df9-6977195fdf9b None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:28.184308 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 296/596] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:28.184308 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46692247-13c1-4758-9df9-6977195fdf9b None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:28.211557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926294f-929a-4b36-99ae-c099e685ec17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:28.212462 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926294f-929a-4b36-99ae-c099e685ec17 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:28.213174 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926294f-929a-4b36-99ae-c099e685ec17 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:28.214036 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926294f-929a-4b36-99ae-c099e685ec17 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:28.215204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926294f-929a-4b36-99ae-c099e685ec17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:28.215662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926294f-929a-4b36-99ae-c099e685ec17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:28.218208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926294f-929a-4b36-99ae-c099e685ec17 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:28.235066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 301/597] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:28.236394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926294f-929a-4b36-99ae-c099e685ec17 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:28.292196 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46692247-13c1-4758-9df9-6977195fdf9b None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:28.327828 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337de42-fd9e-49e8-9567-2f5cf0f0a593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:28.328603 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337de42-fd9e-49e8-9567-2f5cf0f0a593 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:28.328994 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337de42-fd9e-49e8-9567-2f5cf0f0a593 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:28.329379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337de42-fd9e-49e8-9567-2f5cf0f0a593 None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:28.330276 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337de42-fd9e-49e8-9567-2f5cf0f0a593 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:28.330726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337de42-fd9e-49e8-9567-2f5cf0f0a593 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:28.332328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337de42-fd9e-49e8-9567-2f5cf0f0a593 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:28.342562 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:28.358179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 297/598] 10.222.0.96 () {56 vars in 1139 bytes} [Thu Jul 28 17:42:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:28.359152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337de42-fd9e-49e8-9567-2f5cf0f0a593 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:28.378803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926294f-929a-4b36-99ae-c099e685ec17 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:28.418926 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b7170-c3ca-44bc-be72-e00b16961c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:28.419745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b7170-c3ca-44bc-be72-e00b16961c0c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:28.420304 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b7170-c3ca-44bc-be72-e00b16961c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:28.420516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b7170-c3ca-44bc-be72-e00b16961c0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:28.427668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b7170-c3ca-44bc-be72-e00b16961c0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:28.429335 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b7170-c3ca-44bc-be72-e00b16961c0c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:28.441563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-2e4b7170-c3ca-44bc-be72-e00b16961c0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:28.441563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:28.441563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:28.441563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:28.441563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:28.441563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:28.441563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:28.441563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:28.441563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:28.441563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:28.441563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:28.441563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:28.441563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:28.441563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:28.441563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:28.442847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:28.442847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:28.442847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:28.442847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:28.442847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:28.442847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:28.442847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:28.442847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:28.442847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:28.442847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:28.442847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:28.442847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:28.442847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:28.442847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:28.442847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:28.442847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:28.442847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:28.444481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:28.444481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:28.444481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:28.444481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:28.444481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:28.444481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:28.444481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:28.444481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:28.449400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 302/599] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:28.450364 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b7170-c3ca-44bc-be72-e00b16961c0c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:28.476654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:28.488305 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337de42-fd9e-49e8-9567-2f5cf0f0a593 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:28.525888 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22840d79-9057-4b14-8a98-4460f2895baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:28.526766 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22840d79-9057-4b14-8a98-4460f2895baa None admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:28.527141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22840d79-9057-4b14-8a98-4460f2895baa None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:28.527510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22840d79-9057-4b14-8a98-4460f2895baa None admin] PATH_INFO: `/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/98465c2d73e540b5bf506f5a7423e035/roles/f8cbbf969cfc442595755799825094f6` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:28.543771 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22840d79-9057-4b14-8a98-4460f2895baa None admin] RBAC: Authorizing `identity:create_grant(project_id=db5ce5e789e949d09c183dbe04e53f19, user_id=98465c2d73e540b5bf506f5a7423e035, role_id=f8cbbf969cfc442595755799825094f6)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:28.545552 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22840d79-9057-4b14-8a98-4460f2895baa None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:28.561778 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 298/600] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:42:28 2022] PUT /identity/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/98465c2d73e540b5bf506f5a7423e035/roles/f8cbbf969cfc442595755799825094f6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:42:28.562755 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22840d79-9057-4b14-8a98-4460f2895baa None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:28.579137 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b7170-c3ca-44bc-be72-e00b16961c0c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:28.620413 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:28.621945 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13edab7-e1e5-45ac-a13e-e3161b9a7f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:28.623149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13edab7-e1e5-45ac-a13e-e3161b9a7f61 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:28.623875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13edab7-e1e5-45ac-a13e-e3161b9a7f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:28.624227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13edab7-e1e5-45ac-a13e-e3161b9a7f61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:28.640989 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13edab7-e1e5-45ac-a13e-e3161b9a7f61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:28.643750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13edab7-e1e5-45ac-a13e-e3161b9a7f61 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:28.664875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-a13edab7-e1e5-45ac-a13e-e3161b9a7f61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:28.664875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:28.664875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:28.664875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:28.664875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:28.664875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:28.664875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:28.664875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:28.664875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:28.664875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:28.664875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:28.664875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:28.664875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:28.664875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:28.664875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:28.665927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:28.665927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:28.665927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:28.665927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:28.665927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:28.665927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:28.665927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:28.665927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:28.665927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:28.665927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:28.665927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:28.665927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:28.665927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:28.665927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:28.665927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:28.665927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:28.665927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:28.666828 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:28.666828 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:28.666828 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:28.666828 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:28.670566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 303/601] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:28.682219 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13edab7-e1e5-45ac-a13e-e3161b9a7f61 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:28.734518 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22840d79-9057-4b14-8a98-4460f2895baa None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:28.800948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dce370-67db-487e-9c10-7cf15479fffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:28.801640 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dce370-67db-487e-9c10-7cf15479fffd None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:28.801917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dce370-67db-487e-9c10-7cf15479fffd None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:28.802364 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dce370-67db-487e-9c10-7cf15479fffd None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:28.803365 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dce370-67db-487e-9c10-7cf15479fffd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:28.803670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dce370-67db-487e-9c10-7cf15479fffd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:28.805242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dce370-67db-487e-9c10-7cf15479fffd None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:28.821943 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 299/602] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:28.829610 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:28.830523 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dce370-67db-487e-9c10-7cf15479fffd None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:28.861773 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13edab7-e1e5-45ac-a13e-e3161b9a7f61 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:28.907272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc5176-e86e-4d6f-9187-045e1961731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:28.908513 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc5176-e86e-4d6f-9187-045e1961731c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:28.909185 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc5176-e86e-4d6f-9187-045e1961731c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:28.909567 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc5176-e86e-4d6f-9187-045e1961731c None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:28.910624 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc5176-e86e-4d6f-9187-045e1961731c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:28.911035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc5176-e86e-4d6f-9187-045e1961731c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:28.913353 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc5176-e86e-4d6f-9187-045e1961731c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:28.929456 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 304/603] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:28.942360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc5176-e86e-4d6f-9187-045e1961731c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:28.973688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dce370-67db-487e-9c10-7cf15479fffd None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:28.983768 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:29.018475 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308093a8-1a94-43a7-816e-2bad9eec6828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:29.019239 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308093a8-1a94-43a7-816e-2bad9eec6828 None admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:29.019523 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308093a8-1a94-43a7-816e-2bad9eec6828 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:29.020091 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308093a8-1a94-43a7-816e-2bad9eec6828 None admin] PATH_INFO: `/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/e6d20d753e37498e8664f983b0988e3d/roles/f8cbbf969cfc442595755799825094f6` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:29.040439 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308093a8-1a94-43a7-816e-2bad9eec6828 None admin] RBAC: Authorizing `identity:create_grant(project_id=db5ce5e789e949d09c183dbe04e53f19, user_id=e6d20d753e37498e8664f983b0988e3d, role_id=f8cbbf969cfc442595755799825094f6)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:29.042782 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308093a8-1a94-43a7-816e-2bad9eec6828 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:29.062421 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 300/604] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:42:28 2022] PUT /identity/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/e6d20d753e37498e8664f983b0988e3d/roles/f8cbbf969cfc442595755799825094f6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:42:29.064137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577a8dc-7f15-4c39-82c3-ad021897ae56 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:29.064713 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577a8dc-7f15-4c39-82c3-ad021897ae56 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:29.064997 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577a8dc-7f15-4c39-82c3-ad021897ae56 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:29.067317 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 301/605] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:29.073671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ca2c6-f6f4-46bb-a5eb-750d0f217e43 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:29.073955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ca2c6-f6f4-46bb-a5eb-750d0f217e43 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:29.074239 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ca2c6-f6f4-46bb-a5eb-750d0f217e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:29.077354 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc5176-e86e-4d6f-9187-045e1961731c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:29.094648 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-f30ca2c6-f6f4-46bb-a5eb-750d0f217e43 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:29.095919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f30ca2c6-f6f4-46bb-a5eb-750d0f217e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:29.122458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4d6d2-a6c3-4289-941c-a48ce5bbe61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:29.123497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4d6d2-a6c3-4289-941c-a48ce5bbe61f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:29.123802 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4d6d2-a6c3-4289-941c-a48ce5bbe61f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:29.124224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4d6d2-a6c3-4289-941c-a48ce5bbe61f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:29.131231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:29.142378 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4d6d2-a6c3-4289-941c-a48ce5bbe61f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:29.143893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4d6d2-a6c3-4289-941c-a48ce5bbe61f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:29.170886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-eac4d6d2-a6c3-4289-941c-a48ce5bbe61f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:29.170886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:29.170886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:29.170886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:29.170886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:29.170886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:29.170886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:29.170886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:29.170886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:29.170886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:29.170886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:29.170886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:29.170886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:29.170886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:29.170886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:29.171849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:29.171849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:29.171849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:29.171849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:29.171849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:29.171849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:29.171849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:29.171849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:29.171849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:29.171849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:29.171849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:29.171849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:29.171849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:29.171849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:29.171849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:29.171849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:29.171849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:29.172723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:29.172723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:29.172723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:29.172723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:29.172723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:29.172723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:29.172723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:29.172723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:29.172723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 305/606] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:42:29.178367 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4d6d2-a6c3-4289-941c-a48ce5bbe61f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:29.229432 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 302/607] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:29.268831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ca2c6-f6f4-46bb-a5eb-750d0f217e43 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:29.324271 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4d6d2-a6c3-4289-941c-a48ce5bbe61f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:29.361930 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d0b99-f960-46ec-ae99-be02781e9416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:29.362586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d0b99-f960-46ec-ae99-be02781e9416 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:29.362861 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d0b99-f960-46ec-ae99-be02781e9416 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:29.363130 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d0b99-f960-46ec-ae99-be02781e9416 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:29.363873 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d0b99-f960-46ec-ae99-be02781e9416 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:29.364172 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d0b99-f960-46ec-ae99-be02781e9416 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:29.365851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d0b99-f960-46ec-ae99-be02781e9416 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:29.384735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 306/608] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:29.387789 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d0b99-f960-46ec-ae99-be02781e9416 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:29.403172 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:29.420279 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ca2c6-f6f4-46bb-a5eb-750d0f217e43 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:29.459494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bd9d4-e610-4021-98bd-1539e8a1636e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:29.460647 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bd9d4-e610-4021-98bd-1539e8a1636e None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:29.461160 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bd9d4-e610-4021-98bd-1539e8a1636e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:29.461799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bd9d4-e610-4021-98bd-1539e8a1636e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:29.473773 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bd9d4-e610-4021-98bd-1539e8a1636e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:29.480476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-439bd9d4-e610-4021-98bd-1539e8a1636e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:29.480476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:29.480476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:29.480476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:29.480476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:29.480476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:29.480476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:29.480476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:29.480476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:29.480476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:29.480476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:29.480476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:29.480476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:29.480476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:29.480476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:29.480476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:29.481434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:29.481434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:29.481434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:29.481434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:29.481434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:29.481434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:29.481434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:29.481434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:29.481434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:29.481434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:29.481434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:29.481434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:29.481434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:29.481434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:29.481434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:29.481434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:29.482345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:29.482345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:29.482345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:29.482345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:29.482345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:29.482345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:29.482345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:29.482345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:29.482345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:29.482345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:29.482345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:29.482345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:29.485801 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 303/609] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:42:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:42:29.491787 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bd9d4-e610-4021-98bd-1539e8a1636e None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:29.518288 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:29.569109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d0b99-f960-46ec-ae99-be02781e9416 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:29.607408 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dc117-5ec9-494c-a204-1c3f4a5ff6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:29.609025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dc117-5ec9-494c-a204-1c3f4a5ff6f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:29.609525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dc117-5ec9-494c-a204-1c3f4a5ff6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:29.610134 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dc117-5ec9-494c-a204-1c3f4a5ff6f2 None admin] PATH_INFO: `/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/76add49d4be940ad846d32fa16431988/roles/f8cbbf969cfc442595755799825094f6` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:29.627461 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dc117-5ec9-494c-a204-1c3f4a5ff6f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=db5ce5e789e949d09c183dbe04e53f19, user_id=76add49d4be940ad846d32fa16431988, role_id=f8cbbf969cfc442595755799825094f6)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:29.629282 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dc117-5ec9-494c-a204-1c3f4a5ff6f2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:29.646581 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 307/610] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:42:29 2022] PUT /identity/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/76add49d4be940ad846d32fa16431988/roles/f8cbbf969cfc442595755799825094f6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:42:29.693208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bd9d4-e610-4021-98bd-1539e8a1636e None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:29.702087 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e51a15-c77c-46fb-ab31-5c4c1e425939 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:29.708494 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e51a15-c77c-46fb-ab31-5c4c1e425939 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:29.709201 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e51a15-c77c-46fb-ab31-5c4c1e425939 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:29.712361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 308/611] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:29 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:42:29.718750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40109018-c1eb-4b13-8304-3738db403616 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:29.719052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40109018-c1eb-4b13-8304-3738db403616 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:29.719307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40109018-c1eb-4b13-8304-3738db403616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:29.750650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-40109018-c1eb-4b13-8304-3738db403616 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:29.751892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-40109018-c1eb-4b13-8304-3738db403616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:29.780440 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e6c54-b82a-4747-b051-9d24d29dd782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:29.781813 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e6c54-b82a-4747-b051-9d24d29dd782 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:29.782298 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e6c54-b82a-4747-b051-9d24d29dd782 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:29.783043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e6c54-b82a-4747-b051-9d24d29dd782 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:29.784453 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e6c54-b82a-4747-b051-9d24d29dd782 None admin] RBAC: Adding query filter params (name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:29.785214 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e6c54-b82a-4747-b051-9d24d29dd782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:29.788560 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e6c54-b82a-4747-b051-9d24d29dd782 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:29.803871 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 304/612] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Jul 28 17:42:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:29.811970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e6c54-b82a-4747-b051-9d24d29dd782 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:29.837790 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:29.864849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 309/613] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:42:29.898873 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40109018-c1eb-4b13-8304-3738db403616 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:29.937939 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:29.948224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e6c54-b82a-4747-b051-9d24d29dd782 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:29.985213 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea63268-114a-4b42-8ea5-55968a8b4604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:29.987121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea63268-114a-4b42-8ea5-55968a8b4604 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:29.987121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea63268-114a-4b42-8ea5-55968a8b4604 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:29.987121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea63268-114a-4b42-8ea5-55968a8b4604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:29.998617 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea63268-114a-4b42-8ea5-55968a8b4604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:30.001969 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea63268-114a-4b42-8ea5-55968a8b4604 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:30.027007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-9ea63268-114a-4b42-8ea5-55968a8b4604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:30.027007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:30.027007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:30.027007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:30.027007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:30.027007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:30.027007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:30.027007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:30.027007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:30.027007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:30.027007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:30.027007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:30.027007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:30.027007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:30.027007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:30.027934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:30.027934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:30.027934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:30.027934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:30.027934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:30.027934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:30.027934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:30.027934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:30.027934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:30.027934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:30.027934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:30.027934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:30.027934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:30.027934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:30.027934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:30.027934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:30.027934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:30.028819 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:30.028819 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:30.028819 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:30.028819 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:30.028819 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 305/614] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:30.030505 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40109018-c1eb-4b13-8304-3738db403616 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:30.033783 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea63268-114a-4b42-8ea5-55968a8b4604 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:30.094085 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e7b94-5840-4597-a249-cdb3194937a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:30.094673 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e7b94-5840-4597-a249-cdb3194937a3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:30.094955 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e7b94-5840-4597-a249-cdb3194937a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:30.095228 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e7b94-5840-4597-a249-cdb3194937a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:30.109606 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:30.134670 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e7b94-5840-4597-a249-cdb3194937a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:30.145676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-2b6e7b94-5840-4597-a249-cdb3194937a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:30.145676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:30.145676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:30.145676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:30.145676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:30.145676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:30.145676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:30.145676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:30.145676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:30.145676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:30.145676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:30.145676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:30.145676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:30.145676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:30.145676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:30.145676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:30.146688 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:30.146688 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:30.146688 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:30.146688 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:30.146688 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:30.146688 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:30.146688 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:30.146688 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:30.146688 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:30.146688 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:30.146688 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:30.146688 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:30.146688 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:30.146688 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:30.146688 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:30.146688 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:30.147524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:30.147524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:30.147524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:30.147524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:30.147524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:30.147524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:30.147524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:30.147524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:30.147524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:30.147524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:30.147524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:30.147524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:30.148832 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea63268-114a-4b42-8ea5-55968a8b4604 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:30.153223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 310/615] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:42:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:30.158041 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e7b94-5840-4597-a249-cdb3194937a3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:30.189338 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed6bbc-18f4-4fb1-a665-7b0a7aa6888e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:30.190609 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed6bbc-18f4-4fb1-a665-7b0a7aa6888e None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:30.191159 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed6bbc-18f4-4fb1-a665-7b0a7aa6888e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:30.191633 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed6bbc-18f4-4fb1-a665-7b0a7aa6888e None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:30.192617 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed6bbc-18f4-4fb1-a665-7b0a7aa6888e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:30.193363 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed6bbc-18f4-4fb1-a665-7b0a7aa6888e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:30.195293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed6bbc-18f4-4fb1-a665-7b0a7aa6888e None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:30.209921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 306/616] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:30.218020 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed6bbc-18f4-4fb1-a665-7b0a7aa6888e None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:30.407999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed6bbc-18f4-4fb1-a665-7b0a7aa6888e None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:30.473441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:30.493779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:30.510758 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177d802-20f5-4723-8b21-e4649c6fce80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:30.511444 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177d802-20f5-4723-8b21-e4649c6fce80 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:30.512291 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177d802-20f5-4723-8b21-e4649c6fce80 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:30.512291 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177d802-20f5-4723-8b21-e4649c6fce80 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:30.517964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e7b94-5840-4597-a249-cdb3194937a3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:30.532465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177d802-20f5-4723-8b21-e4649c6fce80 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:30.538487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177d802-20f5-4723-8b21-e4649c6fce80 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:30.576928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-6177d802-20f5-4723-8b21-e4649c6fce80 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:42:30.576928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:30.576928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:30.576928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:30.576928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:30.576928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:30.576928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:30.576928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:30.576928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:30.576928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:30.576928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:30.576928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:30.576928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:30.576928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:30.576928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:30.576928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:30.577992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:30.577992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:30.577992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:30.577992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:30.577992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:30.577992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:30.577992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:30.577992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:30.577992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:30.577992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:30.577992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:30.577992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:30.577992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:30.577992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:30.577992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:30.577992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:30.577992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:30.577992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:30.578938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:30.578938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:30.578938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:30.578938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:30.578938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:30.578938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:30.578938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:30.578938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:30.578938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:42:30.578938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:30.597957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 307/617] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:42:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:30.604525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177d802-20f5-4723-8b21-e4649c6fce80 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:30.656839 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e77030-801f-4969-b38a-689cef517532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:30.658226 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e77030-801f-4969-b38a-689cef517532 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:30.658226 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e77030-801f-4969-b38a-689cef517532 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:30.658226 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e77030-801f-4969-b38a-689cef517532 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:30.658943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e77030-801f-4969-b38a-689cef517532 None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:30.659255 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e77030-801f-4969-b38a-689cef517532 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:30.660653 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e77030-801f-4969-b38a-689cef517532 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:30.692123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 311/618] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Jul 28 17:42:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 534 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:30.694491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e77030-801f-4969-b38a-689cef517532 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:30.857087 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e77030-801f-4969-b38a-689cef517532 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:30.891545 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3efc12-eabf-470e-ba3a-425a4e586c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:30.892199 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3efc12-eabf-470e-ba3a-425a4e586c29 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:30.892472 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3efc12-eabf-470e-ba3a-425a4e586c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:30.892792 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3efc12-eabf-470e-ba3a-425a4e586c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:30.907828 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3efc12-eabf-470e-ba3a-425a4e586c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:30.909566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3efc12-eabf-470e-ba3a-425a4e586c29 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:30.910949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177d802-20f5-4723-8b21-e4649c6fce80 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:30.924840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-cb3efc12-eabf-470e-ba3a-425a4e586c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:30.924840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:30.924840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:30.924840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:30.924840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:30.924840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:30.924840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:30.924840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:30.924840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:30.924840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:30.924840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:30.924840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:30.924840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:30.924840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:30.924840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:30.925857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:30.925857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:30.925857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:30.925857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:30.925857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:30.925857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:30.925857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:30.925857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:30.925857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:30.925857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:30.925857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:30.925857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:30.925857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:30.925857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:30.925857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:30.925857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:30.925857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:30.927337 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:30.927337 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:30.927337 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:30.927337 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:30.927337 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 312/619] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:30.934867 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3efc12-eabf-470e-ba3a-425a4e586c29 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:30.949404 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:30.986018 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e2a72-5f7f-4d6a-8b92-c429712c972e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:30.986678 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e2a72-5f7f-4d6a-8b92-c429712c972e None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:30.986956 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e2a72-5f7f-4d6a-8b92-c429712c972e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:30.987229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e2a72-5f7f-4d6a-8b92-c429712c972e None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:30.988060 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e2a72-5f7f-4d6a-8b92-c429712c972e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:30.989246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e2a72-5f7f-4d6a-8b92-c429712c972e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:30.991182 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e2a72-5f7f-4d6a-8b92-c429712c972e None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:31.026599 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 308/620] 10.222.0.96 () {56 vars in 1135 bytes} [Thu Jul 28 17:42:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:31.030103 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e2a72-5f7f-4d6a-8b92-c429712c972e None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:31.109446 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:31.123956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3efc12-eabf-470e-ba3a-425a4e586c29 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:31.188264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d014ff5-69ca-40b9-918d-cb23ff0327b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:31.188996 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d014ff5-69ca-40b9-918d-cb23ff0327b7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:31.189409 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d014ff5-69ca-40b9-918d-cb23ff0327b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:31.189782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d014ff5-69ca-40b9-918d-cb23ff0327b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:31.190597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d014ff5-69ca-40b9-918d-cb23ff0327b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:31.191017 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d014ff5-69ca-40b9-918d-cb23ff0327b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:31.192508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d014ff5-69ca-40b9-918d-cb23ff0327b7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:31.205949 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 313/621] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:31.207566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976a778-4d7f-4e04-9a59-b5770d7521ba None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:31.207947 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976a778-4d7f-4e04-9a59-b5770d7521ba None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:31.208358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976a778-4d7f-4e04-9a59-b5770d7521ba None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:31.213708 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e2a72-5f7f-4d6a-8b92-c429712c972e None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:31.214259 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 314/622] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:31.215325 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976a778-4d7f-4e04-9a59-b5770d7521ba None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:31.261748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f171b0a-c31a-424b-a82a-5ca56695b3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:31.263160 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f171b0a-c31a-424b-a82a-5ca56695b3cd None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:31.263602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f171b0a-c31a-424b-a82a-5ca56695b3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:31.264005 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f171b0a-c31a-424b-a82a-5ca56695b3cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:31.279594 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f171b0a-c31a-424b-a82a-5ca56695b3cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:31.281826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f171b0a-c31a-424b-a82a-5ca56695b3cd None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:31.294481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:31.304992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-1f171b0a-c31a-424b-a82a-5ca56695b3cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:31.304992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:31.304992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:31.304992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:31.304992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:31.304992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:31.304992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:31.304992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:31.304992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:31.304992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:31.304992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:31.304992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:31.304992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:31.304992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:31.304992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:31.306142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:31.306142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:31.306142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:31.306142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:31.306142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:31.306142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:31.306142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:31.306142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:31.306142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:31.306142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:31.306142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:31.306142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:31.306142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:31.306142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:31.306142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:31.306142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:31.306142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:31.307265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:31.307265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:31.307265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:31.307265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:31.309184 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 309/623] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:31.311174 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81818fcd-9c0a-40ae-bdd5-3bc2f1e17639 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:31.311625 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81818fcd-9c0a-40ae-bdd5-3bc2f1e17639 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:31.312058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81818fcd-9c0a-40ae-bdd5-3bc2f1e17639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:31.336707 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-81818fcd-9c0a-40ae-bdd5-3bc2f1e17639 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:31.338630 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-81818fcd-9c0a-40ae-bdd5-3bc2f1e17639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:31.344041 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976a778-4d7f-4e04-9a59-b5770d7521ba None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:31.379593 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788b604-e8ff-48c4-9487-03b02423a7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:31.380708 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788b604-e8ff-48c4-9487-03b02423a7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:31.381122 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788b604-e8ff-48c4-9487-03b02423a7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:31.381500 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788b604-e8ff-48c4-9487-03b02423a7e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:31.389453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788b604-e8ff-48c4-9487-03b02423a7e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:31.391010 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788b604-e8ff-48c4-9487-03b02423a7e6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:31.403395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-f788b604-e8ff-48c4-9487-03b02423a7e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:42:31.403395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:31.403395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:31.403395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:31.403395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:31.403395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:31.403395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:31.403395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:31.403395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:31.403395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:31.403395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:31.403395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:31.403395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:31.403395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:31.403395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:31.403395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:31.404557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:31.404557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:31.404557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:31.404557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:31.404557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:31.404557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:31.404557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:31.404557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:31.404557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:31.404557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:31.404557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:31.404557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:31.404557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:31.404557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:31.404557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:31.404557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:31.404557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:31.404557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:31.405730 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:31.405730 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:31.405730 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:31.405730 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:31.405730 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:31.405730 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:31.405730 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:31.405730 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:31.405730 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:42:31.405730 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:31.412104 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 315/624] 10.222.0.96 () {56 vars in 1093 bytes} [Thu Jul 28 17:42:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:31.412104 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788b604-e8ff-48c4-9487-03b02423a7e6 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:31.434697 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 310/625] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:31.436431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81818fcd-9c0a-40ae-bdd5-3bc2f1e17639 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:31.464114 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:31.540769 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788b604-e8ff-48c4-9487-03b02423a7e6 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:31.557585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81818fcd-9c0a-40ae-bdd5-3bc2f1e17639 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:31.567882 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:31.576920 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1df561-9aec-4422-ad90-e6f5f16d1780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:31.577566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1df561-9aec-4422-ad90-e6f5f16d1780 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:31.577842 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1df561-9aec-4422-ad90-e6f5f16d1780 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:31.578113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1df561-9aec-4422-ad90-e6f5f16d1780 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:31.578796 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1df561-9aec-4422-ad90-e6f5f16d1780 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:31.579094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1df561-9aec-4422-ad90-e6f5f16d1780 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:31.580471 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1df561-9aec-4422-ad90-e6f5f16d1780 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:31.597099 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 316/626] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:31.597099 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1df561-9aec-4422-ad90-e6f5f16d1780 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:31.600668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335531d-ca3f-43e0-b6d0-a30bb18e8ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:31.601561 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335531d-ca3f-43e0-b6d0-a30bb18e8ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:31.601996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335531d-ca3f-43e0-b6d0-a30bb18e8ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:31.602460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335531d-ca3f-43e0-b6d0-a30bb18e8ef7 None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:31.603470 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335531d-ca3f-43e0-b6d0-a30bb18e8ef7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:31.603777 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335531d-ca3f-43e0-b6d0-a30bb18e8ef7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:31.605256 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335531d-ca3f-43e0-b6d0-a30bb18e8ef7 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:31.625095 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 311/627] 10.222.0.96 () {56 vars in 1133 bytes} [Thu Jul 28 17:42:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:31.625095 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335531d-ca3f-43e0-b6d0-a30bb18e8ef7 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:31.704802 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1df561-9aec-4422-ad90-e6f5f16d1780 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:31.713912 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:31.735413 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335531d-ca3f-43e0-b6d0-a30bb18e8ef7 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:31.740698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c8652-6571-4063-8c8b-82425cad7aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:31.741373 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c8652-6571-4063-8c8b-82425cad7aff None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:31.741647 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c8652-6571-4063-8c8b-82425cad7aff None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:31.741917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c8652-6571-4063-8c8b-82425cad7aff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:31.752751 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c8652-6571-4063-8c8b-82425cad7aff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:31.757787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-528c8652-6571-4063-8c8b-82425cad7aff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:31.757787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:31.757787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:31.757787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:31.757787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:31.757787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:31.757787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:31.757787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:31.757787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:31.757787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:31.757787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:31.757787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:31.757787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:31.757787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:31.757787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:31.757787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:31.758714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:31.758714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:31.758714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:31.758714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:31.758714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:31.758714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:31.758714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:31.758714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:31.758714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:31.758714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:31.758714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:31.758714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:31.758714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:31.758714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:31.758714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:31.758714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:31.759596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:31.759596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:31.759596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:31.759596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:31.759596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:31.759596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:31.759596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:31.759596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:31.759596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:31.759596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:31.759596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:31.759596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:31.759596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 317/628] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:42:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:31.761900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af60de9-dd70-468c-a4b2-9022219d6155 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:31.761900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af60de9-dd70-468c-a4b2-9022219d6155 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:31.761900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af60de9-dd70-468c-a4b2-9022219d6155 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:31.767064 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 318/629] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:31.767064 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af60de9-dd70-468c-a4b2-9022219d6155 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:31.781743 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed2c65-638c-4308-8d61-57f5f34a66cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:31.782390 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed2c65-638c-4308-8d61-57f5f34a66cb None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:31.782666 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed2c65-638c-4308-8d61-57f5f34a66cb None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:31.782944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed2c65-638c-4308-8d61-57f5f34a66cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:31.790424 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed2c65-638c-4308-8d61-57f5f34a66cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:31.792320 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed2c65-638c-4308-8d61-57f5f34a66cb None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:31.806336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-35ed2c65-638c-4308-8d61-57f5f34a66cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:31.806336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:31.806336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:31.806336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:31.806336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:31.806336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:31.806336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:31.806336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:31.806336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:31.806336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:31.806336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:31.806336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:31.806336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:31.806336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:31.806336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:31.807286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:31.807286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:31.807286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:31.807286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:31.807286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:31.807286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:31.807286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:31.807286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:31.807286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:31.807286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:31.807286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:31.807286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:31.807286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:31.807286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:31.807286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:31.807286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:31.807286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:31.808172 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:31.808172 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:31.808172 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:31.808172 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:31.808172 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:31.808172 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:31.808172 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:31.808172 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:31.812206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 312/630] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:31.812873 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed2c65-638c-4308-8d61-57f5f34a66cb None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:31.817121 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:31.873186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af60de9-dd70-468c-a4b2-9022219d6155 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:31.910168 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7d1c8-e382-40ef-8cbf-b53194fbcc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:31.910789 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7d1c8-e382-40ef-8cbf-b53194fbcc2c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:31.911068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7d1c8-e382-40ef-8cbf-b53194fbcc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:31.911362 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7d1c8-e382-40ef-8cbf-b53194fbcc2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:31.913986 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed2c65-638c-4308-8d61-57f5f34a66cb None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:31.949481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de175870-9f31-4899-86bd-6a8cd3d74308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:31.950110 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de175870-9f31-4899-86bd-6a8cd3d74308 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:31.950389 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de175870-9f31-4899-86bd-6a8cd3d74308 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:31.950666 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de175870-9f31-4899-86bd-6a8cd3d74308 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:31.951381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de175870-9f31-4899-86bd-6a8cd3d74308 None admin] RBAC: Adding query filter params (name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:31.951684 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de175870-9f31-4899-86bd-6a8cd3d74308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:31.953091 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de175870-9f31-4899-86bd-6a8cd3d74308 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:31.962686 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 313/631] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Jul 28 17:42:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:31.963986 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248f189-f9cc-4ac0-902f-0a61b9afe1ef None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:31.964304 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248f189-f9cc-4ac0-902f-0a61b9afe1ef None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:31.964585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248f189-f9cc-4ac0-902f-0a61b9afe1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:31.970949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:31.983917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-5248f189-f9cc-4ac0-902f-0a61b9afe1ef None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:31.985139 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-5248f189-f9cc-4ac0-902f-0a61b9afe1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:31.986241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7d1c8-e382-40ef-8cbf-b53194fbcc2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:31.987685 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7d1c8-e382-40ef-8cbf-b53194fbcc2c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:32.042496 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:32.056523 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 314/632] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:32.058439 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248f189-f9cc-4ac0-902f-0a61b9afe1ef None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:32.097268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 319/633] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:42:32.098494 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7d1c8-e382-40ef-8cbf-b53194fbcc2c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:32.180646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248f189-f9cc-4ac0-902f-0a61b9afe1ef None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:32.197549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7d1c8-e382-40ef-8cbf-b53194fbcc2c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:32.210091 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:32.215660 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8534e5-b19f-4f17-8636-bce1504a3dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:32.216277 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8534e5-b19f-4f17-8636-bce1504a3dcf None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:32.216551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8534e5-b19f-4f17-8636-bce1504a3dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:32.216818 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8534e5-b19f-4f17-8636-bce1504a3dcf None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:32.217598 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8534e5-b19f-4f17-8636-bce1504a3dcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:32.217903 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8534e5-b19f-4f17-8636-bce1504a3dcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:32.219361 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8534e5-b19f-4f17-8636-bce1504a3dcf None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:32.230865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 315/634] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:32.231670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8534e5-b19f-4f17-8636-bce1504a3dcf None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:32.232202 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623daa12-99f9-4af8-be75-df228c5fd8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:32.232872 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623daa12-99f9-4af8-be75-df228c5fd8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:32.233177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623daa12-99f9-4af8-be75-df228c5fd8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:32.233452 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623daa12-99f9-4af8-be75-df228c5fd8f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:32.246830 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623daa12-99f9-4af8-be75-df228c5fd8f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:32.247937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623daa12-99f9-4af8-be75-df228c5fd8f3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:32.258860 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:32.268027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-623daa12-99f9-4af8-be75-df228c5fd8f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:32.268027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:32.268027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:32.268027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:32.268027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:32.268027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:32.268027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:32.268027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:32.268027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:32.268027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:32.268027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:32.268027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:32.268027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:32.268027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:32.268027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:32.269150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:32.269150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:32.269150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:32.269150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:32.269150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:32.269150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:32.269150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:32.269150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:32.269150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:32.269150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:32.269150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:32.269150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:32.269150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:32.269150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:32.269150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:32.269150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:32.269150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:32.270242 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:32.270242 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:32.270242 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:32.270242 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:32.270242 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 320/635] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:32.270242 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623daa12-99f9-4af8-be75-df228c5fd8f3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:32.343202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8534e5-b19f-4f17-8636-bce1504a3dcf None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:32.373619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623daa12-99f9-4af8-be75-df228c5fd8f3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:32.375881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef788efd-add9-4411-850e-d7efd7599098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:32.376546 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef788efd-add9-4411-850e-d7efd7599098 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:32.376825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef788efd-add9-4411-850e-d7efd7599098 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:32.377128 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef788efd-add9-4411-850e-d7efd7599098 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:32.387698 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef788efd-add9-4411-850e-d7efd7599098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:32.393431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-ef788efd-add9-4411-850e-d7efd7599098 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:32.393431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:32.393431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:32.393431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:32.393431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:32.393431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:32.393431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:32.393431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:32.393431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:32.393431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:32.393431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:32.393431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:32.393431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:32.393431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:32.393431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:32.393431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:32.394396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:32.394396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:32.394396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:32.394396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:32.394396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:32.394396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:32.394396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:32.394396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:32.394396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:32.394396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:32.394396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:32.394396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:32.394396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:32.394396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:32.394396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:32.394396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:32.395229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:32.395229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:32.395229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:32.395229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:32.395229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:32.395229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:32.395229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:32.395229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:32.395229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:32.395229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:32.395229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:32.395229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:32.395229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 316/636] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:42:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:32.396273 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ddc8c-255a-405b-9f26-db71d403aaa4 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:32.396518 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ddc8c-255a-405b-9f26-db71d403aaa4 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:32.396768 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ddc8c-255a-405b-9f26-db71d403aaa4 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:32.399292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 317/637] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:32.400141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ddc8c-255a-405b-9f26-db71d403aaa4 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:32.413809 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3212050-773f-40c4-8f57-1a45cf085ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:32.414476 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3212050-773f-40c4-8f57-1a45cf085ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:32.414756 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3212050-773f-40c4-8f57-1a45cf085ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:32.415051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3212050-773f-40c4-8f57-1a45cf085ff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:32.426476 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3212050-773f-40c4-8f57-1a45cf085ff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:32.428446 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3212050-773f-40c4-8f57-1a45cf085ff0 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:32.444454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-c3212050-773f-40c4-8f57-1a45cf085ff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:32.444454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:32.444454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:32.444454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:32.444454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:32.444454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:32.444454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:32.444454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:32.444454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:32.444454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:32.444454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:32.444454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:32.444454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:32.444454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:32.444454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:32.445468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:32.445468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:32.445468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:32.445468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:32.445468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:32.445468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:32.445468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:32.445468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:32.445468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:32.445468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:32.445468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:32.445468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:32.445468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:32.445468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:32.445468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:32.445468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:32.445468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:32.446343 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:32.446343 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:32.446343 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:32.446343 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:32.446343 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 321/638] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:32.446723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3212050-773f-40c4-8f57-1a45cf085ff0 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:32.456765 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:32.502146 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:32.505863 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ddc8c-255a-405b-9f26-db71d403aaa4 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:32.539455 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bf0a2-f74f-4114-8113-49ed0865d2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:32.540125 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bf0a2-f74f-4114-8113-49ed0865d2a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:32.540405 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bf0a2-f74f-4114-8113-49ed0865d2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:32.540686 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bf0a2-f74f-4114-8113-49ed0865d2a4 None admin] PATH_INFO: `/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/4ea1a9023eaf427f96f86af909a803fd/roles/f8cbbf969cfc442595755799825094f6` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:32.549005 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3212050-773f-40c4-8f57-1a45cf085ff0 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:32.557119 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bf0a2-f74f-4114-8113-49ed0865d2a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=db5ce5e789e949d09c183dbe04e53f19, user_id=4ea1a9023eaf427f96f86af909a803fd, role_id=f8cbbf969cfc442595755799825094f6)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:32.558542 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bf0a2-f74f-4114-8113-49ed0865d2a4 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:32.573535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 318/639] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:42:32 2022] PUT /identity/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/4ea1a9023eaf427f96f86af909a803fd/roles/f8cbbf969cfc442595755799825094f6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:42:32.574305 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bf0a2-f74f-4114-8113-49ed0865d2a4 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:32.588690 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6b992-21a5-4118-9c9f-2f6c7ce59665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:32.589742 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6b992-21a5-4118-9c9f-2f6c7ce59665 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:32.590094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6b992-21a5-4118-9c9f-2f6c7ce59665 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:32.590373 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6b992-21a5-4118-9c9f-2f6c7ce59665 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:32.591104 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6b992-21a5-4118-9c9f-2f6c7ce59665 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:32.591392 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6b992-21a5-4118-9c9f-2f6c7ce59665 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:32.592823 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6b992-21a5-4118-9c9f-2f6c7ce59665 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:32.606786 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 322/640] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:32.608430 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26083a28-fef7-4892-afa5-ef9f478f0be1 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:32.608712 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26083a28-fef7-4892-afa5-ef9f478f0be1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:32.608978 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26083a28-fef7-4892-afa5-ef9f478f0be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:32.629910 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-26083a28-fef7-4892-afa5-ef9f478f0be1 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:32.632252 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-26083a28-fef7-4892-afa5-ef9f478f0be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:32.698738 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bf0a2-f74f-4114-8113-49ed0865d2a4 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:32.700948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:32.725083 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 323/641] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:32.725083 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26083a28-fef7-4892-afa5-ef9f478f0be1 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:32.756994 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27884c2-7656-4d97-ac56-ab4c5ddb676c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:32.757720 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27884c2-7656-4d97-ac56-ab4c5ddb676c None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:32.758000 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27884c2-7656-4d97-ac56-ab4c5ddb676c None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:32.758274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27884c2-7656-4d97-ac56-ab4c5ddb676c None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:32.758993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27884c2-7656-4d97-ac56-ab4c5ddb676c None admin] RBAC: Adding query filter params (name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:32.759297 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27884c2-7656-4d97-ac56-ab4c5ddb676c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:32.760671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27884c2-7656-4d97-ac56-ab4c5ddb676c None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:32.769952 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 319/642] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Jul 28 17:42:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:32.773221 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27884c2-7656-4d97-ac56-ab4c5ddb676c None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:32.777382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:32.841231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26083a28-fef7-4892-afa5-ef9f478f0be1 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:32.878554 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142dc37-e2db-4fa1-ae86-88a7183c48bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:32.879149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142dc37-e2db-4fa1-ae86-88a7183c48bc None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:32.879428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142dc37-e2db-4fa1-ae86-88a7183c48bc None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:32.879704 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142dc37-e2db-4fa1-ae86-88a7183c48bc None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:32.880478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142dc37-e2db-4fa1-ae86-88a7183c48bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:32.880778 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142dc37-e2db-4fa1-ae86-88a7183c48bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:32.882201 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142dc37-e2db-4fa1-ae86-88a7183c48bc None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:32.885004 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27884c2-7656-4d97-ac56-ab4c5ddb676c None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:32.899540 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 324/643] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:32.899540 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142dc37-e2db-4fa1-ae86-88a7183c48bc None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:32.929995 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72319f7-f70c-44bc-bf05-2429688c7b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:32.930637 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72319f7-f70c-44bc-bf05-2429688c7b46 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:32.930913 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72319f7-f70c-44bc-bf05-2429688c7b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:32.931182 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72319f7-f70c-44bc-bf05-2429688c7b46 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:32.939158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72319f7-f70c-44bc-bf05-2429688c7b46 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:32.940613 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72319f7-f70c-44bc-bf05-2429688c7b46 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:32.953218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-a72319f7-f70c-44bc-bf05-2429688c7b46 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 17:42:32.953218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:32.953218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:32.953218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:32.953218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:32.953218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:32.953218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:32.953218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:32.953218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:32.953218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:32.953218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:32.953218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:32.953218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:32.953218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:32.953218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:32.953218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:32.954246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:32.954246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:32.954246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:32.954246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:32.954246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:32.954246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:32.954246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:32.954246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:32.954246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:32.954246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:32.954246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:32.954246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:32.954246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:32.954246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:32.954246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:32.954246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:32.954246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:32.954246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:32.955205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:32.955205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:32.955205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:32.955205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:32.955205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:32.955205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:32.955205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:32.955205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:32.955205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 17:42:32.955205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:32.955205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 320/644] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:42:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:32.955205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72319f7-f70c-44bc-bf05-2429688c7b46 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:32.984039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:33.013180 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142dc37-e2db-4fa1-ae86-88a7183c48bc None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:33.014841 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:33.052578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09a492-cc86-4959-bd8b-f52bfe72d3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:33.053263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09a492-cc86-4959-bd8b-f52bfe72d3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:33.053544 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09a492-cc86-4959-bd8b-f52bfe72d3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:33.053815 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09a492-cc86-4959-bd8b-f52bfe72d3c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:33.064259 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09a492-cc86-4959-bd8b-f52bfe72d3c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:33.070662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-0d09a492-cc86-4959-bd8b-f52bfe72d3c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:33.070662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:33.070662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:33.070662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:33.070662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:33.070662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:33.070662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:33.070662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:33.070662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:33.070662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:33.070662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:33.070662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:33.070662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:33.070662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:33.070662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:33.070662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:33.071594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:33.071594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:33.071594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:33.071594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:33.071594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:33.071594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:33.071594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:33.071594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:33.071594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:33.071594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:33.071594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:33.071594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:33.071594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:33.071594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:33.071594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:33.071594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:33.072502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:33.072502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:33.072502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:33.072502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:33.072502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:33.072502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:33.072502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:33.072502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:33.072502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:33.072502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:33.072502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:33.072502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:33.072502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 325/645] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:42:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:33.073360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09a492-cc86-4959-bd8b-f52bfe72d3c5 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:33.083496 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72319f7-f70c-44bc-bf05-2429688c7b46 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:33.119431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d7dae-157d-4b23-9846-da20280b0fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:33.120071 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d7dae-157d-4b23-9846-da20280b0fed None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:33.120344 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d7dae-157d-4b23-9846-da20280b0fed None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:33.120687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d7dae-157d-4b23-9846-da20280b0fed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:33.132210 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d7dae-157d-4b23-9846-da20280b0fed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:33.133928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d7dae-157d-4b23-9846-da20280b0fed None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:33.149481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-1d2d7dae-157d-4b23-9846-da20280b0fed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:33.149481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:33.149481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:33.149481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:33.149481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:33.149481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:33.149481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:33.149481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:33.149481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:33.149481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:33.149481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:33.149481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:33.149481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:33.149481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:33.149481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:33.150417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:33.150417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:33.150417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:33.150417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:33.150417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:33.150417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:33.150417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:33.150417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:33.150417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:33.150417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:33.150417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:33.150417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:33.150417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:33.150417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:33.150417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:33.150417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:33.150417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:33.151302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:33.151302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:33.151302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:33.151302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:33.153366 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 321/646] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:33.154524 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d7dae-157d-4b23-9846-da20280b0fed None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:33.178275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09a492-cc86-4959-bd8b-f52bfe72d3c5 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:33.214531 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f51159-2632-4095-8a2b-62d188bf804f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:33.215197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f51159-2632-4095-8a2b-62d188bf804f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:33.215581 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f51159-2632-4095-8a2b-62d188bf804f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:33.215855 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f51159-2632-4095-8a2b-62d188bf804f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:33.229093 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f51159-2632-4095-8a2b-62d188bf804f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:33.231041 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f51159-2632-4095-8a2b-62d188bf804f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:33.234640 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:33.243312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-b3f51159-2632-4095-8a2b-62d188bf804f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:33.243312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:33.243312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:33.243312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:33.243312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:33.243312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:33.243312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:33.243312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:33.243312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:33.243312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:33.243312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:33.243312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:33.243312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:33.243312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:33.243312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:33.244263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:33.244263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:33.244263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:33.244263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:33.244263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:33.244263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:33.244263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:33.244263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:33.244263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:33.244263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:33.244263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:33.244263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:33.244263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:33.244263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:33.244263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:33.244263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:33.244263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:33.245702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:33.245702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:33.245702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:33.245702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:33.245702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:33.245702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:33.245702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:33.245702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:33.245702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 326/647] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:33.245702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f51159-2632-4095-8a2b-62d188bf804f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:33.266331 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d7dae-157d-4b23-9846-da20280b0fed None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:33.275047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:33.304074 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292f6a4-fd66-4894-9b77-8f91c9a65286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:33.304692 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292f6a4-fd66-4894-9b77-8f91c9a65286 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:33.304967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292f6a4-fd66-4894-9b77-8f91c9a65286 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:33.305260 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292f6a4-fd66-4894-9b77-8f91c9a65286 None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:33.306044 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292f6a4-fd66-4894-9b77-8f91c9a65286 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:33.306342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292f6a4-fd66-4894-9b77-8f91c9a65286 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:33.307846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292f6a4-fd66-4894-9b77-8f91c9a65286 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:33.333270 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 322/648] 10.222.0.96 () {56 vars in 1137 bytes} [Thu Jul 28 17:42:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:33.333270 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292f6a4-fd66-4894-9b77-8f91c9a65286 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:33.360782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f51159-2632-4095-8a2b-62d188bf804f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:33.399537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98429d45-ce56-4714-885c-c8a283a9f2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:33.400368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98429d45-ce56-4714-885c-c8a283a9f2ed None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:33.400809 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98429d45-ce56-4714-885c-c8a283a9f2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:33.401281 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98429d45-ce56-4714-885c-c8a283a9f2ed None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:33.402145 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98429d45-ce56-4714-885c-c8a283a9f2ed None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:33.402659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98429d45-ce56-4714-885c-c8a283a9f2ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:33.404222 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98429d45-ce56-4714-885c-c8a283a9f2ed None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:33.414056 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 327/649] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Jul 28 17:42:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:33.415165 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98429d45-ce56-4714-885c-c8a283a9f2ed None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:33.444792 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292f6a4-fd66-4894-9b77-8f91c9a65286 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:33.479737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2608753-b396-41c9-9216-311afdb61b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:33.480360 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2608753-b396-41c9-9216-311afdb61b55 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:33.480639 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2608753-b396-41c9-9216-311afdb61b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:33.480918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2608753-b396-41c9-9216-311afdb61b55 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:33.481647 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2608753-b396-41c9-9216-311afdb61b55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:33.481956 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2608753-b396-41c9-9216-311afdb61b55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:33.483331 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2608753-b396-41c9-9216-311afdb61b55 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:33.485212 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:33.497801 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 323/650] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:33.498476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2608753-b396-41c9-9216-311afdb61b55 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:33.521456 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:33.540072 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98429d45-ce56-4714-885c-c8a283a9f2ed None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:33.576030 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad9325-64c3-4176-9da5-d81b140dbe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:33.576654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad9325-64c3-4176-9da5-d81b140dbe49 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:33.576926 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad9325-64c3-4176-9da5-d81b140dbe49 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:33.577244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad9325-64c3-4176-9da5-d81b140dbe49 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:33.577984 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad9325-64c3-4176-9da5-d81b140dbe49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:33.578289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad9325-64c3-4176-9da5-d81b140dbe49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:33.579720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad9325-64c3-4176-9da5-d81b140dbe49 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:33.593084 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 328/651] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:33.593995 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad9325-64c3-4176-9da5-d81b140dbe49 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:33.608193 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2608753-b396-41c9-9216-311afdb61b55 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:33.644802 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521a391-967a-4c6c-ab66-37a133632fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:33.645931 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521a391-967a-4c6c-ab66-37a133632fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:33.646427 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521a391-967a-4c6c-ab66-37a133632fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:33.647066 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521a391-967a-4c6c-ab66-37a133632fd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:33.708903 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad9325-64c3-4176-9da5-d81b140dbe49 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:33.712916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:33.721337 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521a391-967a-4c6c-ab66-37a133632fd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:33.722777 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521a391-967a-4c6c-ab66-37a133632fd6 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:33.748945 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278fd7e-6d15-4e1c-a457-7fc2da675bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:33.750240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278fd7e-6d15-4e1c-a457-7fc2da675bca None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:33.750515 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278fd7e-6d15-4e1c-a457-7fc2da675bca None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:33.750798 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278fd7e-6d15-4e1c-a457-7fc2da675bca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:33.761479 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278fd7e-6d15-4e1c-a457-7fc2da675bca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:33.763270 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278fd7e-6d15-4e1c-a457-7fc2da675bca None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:33.765966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:33.780904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-c278fd7e-6d15-4e1c-a457-7fc2da675bca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:33.780904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:33.780904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:33.780904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:33.780904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:33.780904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:33.780904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:33.780904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:33.780904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:33.780904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:33.780904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:33.780904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:33.780904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:33.780904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:33.780904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:33.782013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:33.782013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:33.782013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:33.782013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:33.782013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:33.782013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:33.782013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:33.782013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:33.782013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:33.782013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:33.782013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:33.782013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:33.782013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:33.782013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:33.782013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:33.782013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:33.782013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:33.786049 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:33.786049 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:33.786049 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:33.786049 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:33.786049 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 329/652] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:33.786049 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278fd7e-6d15-4e1c-a457-7fc2da675bca None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:33.831559 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 324/653] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:42:33.832400 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521a391-967a-4c6c-ab66-37a133632fd6 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:33.893740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278fd7e-6d15-4e1c-a457-7fc2da675bca None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:33.928710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb61b1e-6e32-4c07-8ff4-42aabc69c4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:33.929380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb61b1e-6e32-4c07-8ff4-42aabc69c4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:33.929661 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb61b1e-6e32-4c07-8ff4-42aabc69c4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:33.929934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb61b1e-6e32-4c07-8ff4-42aabc69c4f2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:33.937025 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:33.937474 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb61b1e-6e32-4c07-8ff4-42aabc69c4f2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:33.938968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb61b1e-6e32-4c07-8ff4-42aabc69c4f2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:33.947285 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521a391-967a-4c6c-ab66-37a133632fd6 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:33.950986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-2eb61b1e-6e32-4c07-8ff4-42aabc69c4f2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:42:33.950986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:33.950986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:33.950986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:33.950986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:33.950986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:33.950986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:33.950986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:33.950986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:33.950986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:33.950986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:33.950986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:33.950986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:33.950986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:33.950986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:33.950986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:33.952368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:33.952368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:33.952368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:33.952368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:33.952368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:33.952368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:33.952368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:33.952368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:33.952368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:33.952368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:33.952368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:33.952368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:33.952368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:33.952368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:33.952368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:33.952368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:33.952368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:33.952368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:33.954609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:33.954609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:33.954609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:33.954609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:33.954609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:33.954609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:33.954609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:33.954609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:33.954609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:42:33.954609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:33.956942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 330/654] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:42:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:33.957864 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb61b1e-6e32-4c07-8ff4-42aabc69c4f2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:33.993356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033be65-bedb-4acc-9031-45584afa3682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:33.994342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033be65-bedb-4acc-9031-45584afa3682 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:33.994342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033be65-bedb-4acc-9031-45584afa3682 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:33.994544 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033be65-bedb-4acc-9031-45584afa3682 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:33.995279 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033be65-bedb-4acc-9031-45584afa3682 None admin] RBAC: Adding query filter params (role.id=f8cbbf969cfc442595755799825094f6, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=5ac367247aa54671ae5c33d251017470) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:33.995574 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033be65-bedb-4acc-9031-45584afa3682 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:33.996992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033be65-bedb-4acc-9031-45584afa3682 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:34.003020 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 325/655] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:42:33 2022] GET /identity/v3/role_assignments?user.id=5ac367247aa54671ae5c33d251017470&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=f8cbbf969cfc442595755799825094f6 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:34.013378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033be65-bedb-4acc-9031-45584afa3682 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:34.034868 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:34.092448 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb61b1e-6e32-4c07-8ff4-42aabc69c4f2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:34.127032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033be65-bedb-4acc-9031-45584afa3682 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:34.134764 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fa11b-42f2-4e7a-add0-883170e90e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:34.136022 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fa11b-42f2-4e7a-add0-883170e90e32 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:34.136300 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fa11b-42f2-4e7a-add0-883170e90e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:34.136571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fa11b-42f2-4e7a-add0-883170e90e32 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:34.138102 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297fa11b-42f2-4e7a-add0-883170e90e32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:34.138488 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297fa11b-42f2-4e7a-add0-883170e90e32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:34.140505 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297fa11b-42f2-4e7a-add0-883170e90e32 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:34.158582 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 331/656] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:34.159658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fa11b-42f2-4e7a-add0-883170e90e32 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:34.167352 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc649a0e-4606-4562-8cbc-998649ad2934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:34.168096 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc649a0e-4606-4562-8cbc-998649ad2934 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:34.168376 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc649a0e-4606-4562-8cbc-998649ad2934 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:34.168652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc649a0e-4606-4562-8cbc-998649ad2934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:34.184051 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc649a0e-4606-4562-8cbc-998649ad2934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:34.185581 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc649a0e-4606-4562-8cbc-998649ad2934 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:34.206646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-bc649a0e-4606-4562-8cbc-998649ad2934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:34.206646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:34.206646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:34.206646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:34.206646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:34.206646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:34.206646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:34.206646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:34.206646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:34.206646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:34.206646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:34.206646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:34.206646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:34.206646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:34.206646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:34.207592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:34.207592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:34.207592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:34.207592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:34.207592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:34.207592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:34.207592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:34.207592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:34.207592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:34.207592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:34.207592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:34.207592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:34.207592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:34.207592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:34.207592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:34.207592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:34.207592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:34.208742 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:34.208742 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:34.208742 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:34.208742 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:34.214833 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 326/657] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:34.215839 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc649a0e-4606-4562-8cbc-998649ad2934 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:34.230101 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:34.290591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fa11b-42f2-4e7a-add0-883170e90e32 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:34.318029 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:34.339605 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc649a0e-4606-4562-8cbc-998649ad2934 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:34.343389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30b1ac-b863-4901-b36a-a908e6da9eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:34.344016 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30b1ac-b863-4901-b36a-a908e6da9eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:34.344297 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30b1ac-b863-4901-b36a-a908e6da9eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:34.344571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30b1ac-b863-4901-b36a-a908e6da9eb3 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:34.346238 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30b1ac-b863-4901-b36a-a908e6da9eb3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:34.346238 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30b1ac-b863-4901-b36a-a908e6da9eb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:34.347518 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30b1ac-b863-4901-b36a-a908e6da9eb3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:34.370665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 332/658] 10.222.0.96 () {56 vars in 1137 bytes} [Thu Jul 28 17:42:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:34.372015 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30b1ac-b863-4901-b36a-a908e6da9eb3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:34.389194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797a668-7531-4329-bfce-30a164a0ed50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:34.390368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797a668-7531-4329-bfce-30a164a0ed50 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:34.390850 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797a668-7531-4329-bfce-30a164a0ed50 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:34.391295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797a668-7531-4329-bfce-30a164a0ed50 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:34.401016 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797a668-7531-4329-bfce-30a164a0ed50 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:34.402643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797a668-7531-4329-bfce-30a164a0ed50 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:34.416627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-3797a668-7531-4329-bfce-30a164a0ed50 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 17:42:34.416627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:34.416627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:34.416627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:34.416627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:34.416627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:34.416627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:34.416627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:34.416627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:34.416627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:34.416627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:34.416627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:34.416627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:34.416627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:34.416627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:34.416627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:34.417840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:34.417840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:34.417840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:34.417840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:34.417840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:34.417840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:34.417840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:34.417840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:34.417840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:34.417840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:34.417840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:34.417840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:34.417840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:34.417840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:34.417840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:34.417840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:34.417840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:34.417840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:34.418958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:34.418958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:34.418958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:34.418958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:34.418958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:34.418958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:34.418958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:34.418958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:34.418958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 17:42:34.418958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:34.418958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 327/659] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:42:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:34.419618 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797a668-7531-4329-bfce-30a164a0ed50 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:34.497599 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:34.501445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30b1ac-b863-4901-b36a-a908e6da9eb3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:34.539394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc3112-5ef2-406c-b835-77fa79cbe158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:34.539642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797a668-7531-4329-bfce-30a164a0ed50 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:34.540026 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc3112-5ef2-406c-b835-77fa79cbe158 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:34.540302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc3112-5ef2-406c-b835-77fa79cbe158 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:34.540571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc3112-5ef2-406c-b835-77fa79cbe158 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:34.541364 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc3112-5ef2-406c-b835-77fa79cbe158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:34.541609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc3112-5ef2-406c-b835-77fa79cbe158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:34.543763 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc3112-5ef2-406c-b835-77fa79cbe158 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:34.560653 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 333/660] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:34.561636 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc3112-5ef2-406c-b835-77fa79cbe158 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:34.581518 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8476da-7d12-47e2-bcad-115fe6bca74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:34.582612 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8476da-7d12-47e2-bcad-115fe6bca74a None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:34.583545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8476da-7d12-47e2-bcad-115fe6bca74a None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:34.583975 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8476da-7d12-47e2-bcad-115fe6bca74a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:34.607282 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:34.659748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8476da-7d12-47e2-bcad-115fe6bca74a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:34.662066 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8476da-7d12-47e2-bcad-115fe6bca74a None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:34.685223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc3112-5ef2-406c-b835-77fa79cbe158 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:34.720710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc43499-ad00-423d-b4a2-eff18deb1921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:34.721380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc43499-ad00-423d-b4a2-eff18deb1921 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:34.721654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc43499-ad00-423d-b4a2-eff18deb1921 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:34.721933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc43499-ad00-423d-b4a2-eff18deb1921 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:34.722717 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc43499-ad00-423d-b4a2-eff18deb1921 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:34.723023 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc43499-ad00-423d-b4a2-eff18deb1921 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:34.724536 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc43499-ad00-423d-b4a2-eff18deb1921 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:34.733582 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:34.744891 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 334/661] 10.222.0.96 () {56 vars in 1139 bytes} [Thu Jul 28 17:42:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:34.745769 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc43499-ad00-423d-b4a2-eff18deb1921 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:34.772510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 328/662] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:42:34.773840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11b6bc-a808-45a0-899a-e7fe284227cd None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:34.774126 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11b6bc-a808-45a0-899a-e7fe284227cd None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:34.774401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11b6bc-a808-45a0-899a-e7fe284227cd None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:34.775822 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 329/663] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:34.776338 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11b6bc-a808-45a0-899a-e7fe284227cd None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:34.854282 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:34.865425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc43499-ad00-423d-b4a2-eff18deb1921 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:34.886321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11b6bc-a808-45a0-899a-e7fe284227cd None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:34.904972 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593d370-5e7b-4c89-b41e-fa8838ad3ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:34.905934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593d370-5e7b-4c89-b41e-fa8838ad3ede None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:34.906214 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593d370-5e7b-4c89-b41e-fa8838ad3ede None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:34.906481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593d370-5e7b-4c89-b41e-fa8838ad3ede None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:34.913680 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593d370-5e7b-4c89-b41e-fa8838ad3ede None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:34.915166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593d370-5e7b-4c89-b41e-fa8838ad3ede None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:34.924560 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a439e32-5b67-45fc-ac52-fb35d0926913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:34.925217 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a439e32-5b67-45fc-ac52-fb35d0926913 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:34.925498 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a439e32-5b67-45fc-ac52-fb35d0926913 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:34.925773 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a439e32-5b67-45fc-ac52-fb35d0926913 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:34.928442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-c593d370-5e7b-4c89-b41e-fa8838ad3ede None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:34.928442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:34.928442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:34.928442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:34.928442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:34.928442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:34.928442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:34.928442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:34.928442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:34.928442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:34.928442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:34.928442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:34.928442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:34.928442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:34.928442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:34.929470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:34.929470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:34.929470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:34.929470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:34.929470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:34.929470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:34.929470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:34.929470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:34.929470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:34.929470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:34.929470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:34.929470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:34.929470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:34.929470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:34.929470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:34.929470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:34.929470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:34.930464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:34.930464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:34.930464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:34.930464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:34.930464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:34.930464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:34.930464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:34.930464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:34.930464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 335/664] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:34.931010 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593d370-5e7b-4c89-b41e-fa8838ad3ede None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:34.973646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:35.003891 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a439e32-5b67-45fc-ac52-fb35d0926913 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:35.005602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a439e32-5b67-45fc-ac52-fb35d0926913 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:35.045269 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593d370-5e7b-4c89-b41e-fa8838ad3ede None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:35.079117 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fef50-b8b0-42c4-a3fa-8bbb805f5450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:35.079759 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fef50-b8b0-42c4-a3fa-8bbb805f5450 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:35.080037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fef50-b8b0-42c4-a3fa-8bbb805f5450 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:35.080309 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fef50-b8b0-42c4-a3fa-8bbb805f5450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:35.091279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fef50-b8b0-42c4-a3fa-8bbb805f5450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:35.092752 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fef50-b8b0-42c4-a3fa-8bbb805f5450 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:35.107928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-4d5fef50-b8b0-42c4-a3fa-8bbb805f5450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:35.107928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:35.107928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:35.107928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:35.107928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:35.107928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:35.107928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:35.107928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:35.107928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:35.107928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:35.107928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:35.107928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:35.107928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:35.107928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:35.107928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:35.108944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:35.108944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:35.108944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:35.108944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:35.108944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:35.108944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:35.108944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:35.108944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:35.108944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:35.108944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:35.108944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:35.108944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:35.108944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:35.108944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:35.108944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:35.108944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:35.108944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:35.109879 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:35.109879 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:35.109879 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:35.109879 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:35.109879 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 336/665] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:35.110557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3d14a-29c4-440e-be9d-e777255d5d35 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:35.110832 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3d14a-29c4-440e-be9d-e777255d5d35 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:35.111106 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3d14a-29c4-440e-be9d-e777255d5d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:35.119378 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:35.120992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 330/666] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:42:35.122097 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a439e32-5b67-45fc-ac52-fb35d0926913 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:35.130748 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-84f3d14a-29c4-440e-be9d-e777255d5d35 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:35.132033 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-84f3d14a-29c4-440e-be9d-e777255d5d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:35.199608 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:35.203296 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 337/667] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:35.204395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3d14a-29c4-440e-be9d-e777255d5d35 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:35.243035 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a439e32-5b67-45fc-ac52-fb35d0926913 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:35.286658 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93b280-08a6-4ace-a1b3-5e1daa78a19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:35.287617 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93b280-08a6-4ace-a1b3-5e1daa78a19d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:35.287892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93b280-08a6-4ace-a1b3-5e1daa78a19d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:35.288768 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93b280-08a6-4ace-a1b3-5e1daa78a19d None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:35.289827 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93b280-08a6-4ace-a1b3-5e1daa78a19d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:35.290156 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93b280-08a6-4ace-a1b3-5e1daa78a19d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:35.292528 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93b280-08a6-4ace-a1b3-5e1daa78a19d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:35.313093 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 331/668] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:35.313093 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93b280-08a6-4ace-a1b3-5e1daa78a19d None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:35.325266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3d14a-29c4-440e-be9d-e777255d5d35 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:35.365007 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c271593-7ff3-49ec-8fab-696693362086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:35.365650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c271593-7ff3-49ec-8fab-696693362086 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:35.365934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c271593-7ff3-49ec-8fab-696693362086 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:35.366206 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c271593-7ff3-49ec-8fab-696693362086 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:35.366900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c271593-7ff3-49ec-8fab-696693362086 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:35.367234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c271593-7ff3-49ec-8fab-696693362086 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:35.368675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c271593-7ff3-49ec-8fab-696693362086 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:35.370451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:35.387607 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 338/669] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:35.387607 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c271593-7ff3-49ec-8fab-696693362086 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:35.425242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93b280-08a6-4ace-a1b3-5e1daa78a19d None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:35.455693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:35.463270 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eac4ed-051b-425e-b0c8-e214f4cd02a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:35.463919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eac4ed-051b-425e-b0c8-e214f4cd02a8 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:35.464203 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eac4ed-051b-425e-b0c8-e214f4cd02a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:35.464476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eac4ed-051b-425e-b0c8-e214f4cd02a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:35.475171 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eac4ed-051b-425e-b0c8-e214f4cd02a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:35.476647 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eac4ed-051b-425e-b0c8-e214f4cd02a8 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:35.490846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-a8eac4ed-051b-425e-b0c8-e214f4cd02a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:35.490846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:35.490846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:35.490846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:35.490846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:35.490846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:35.490846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:35.490846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:35.490846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:35.490846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:35.490846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:35.490846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:35.490846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:35.490846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:35.490846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:35.491726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:35.491726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:35.491726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:35.491726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:35.491726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:35.491726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:35.491726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:35.491726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:35.491726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:35.491726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:35.491726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:35.491726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:35.491726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:35.491726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:35.491726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:35.491726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:35.491726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:35.492633 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:35.492633 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:35.492633 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:35.492633 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:35.499808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c271593-7ff3-49ec-8fab-696693362086 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:35.499926 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 332/670] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:35.500621 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eac4ed-051b-425e-b0c8-e214f4cd02a8 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:35.536329 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a303766-6362-418f-b105-b282e06d50a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:35.537081 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a303766-6362-418f-b105-b282e06d50a3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:35.537369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a303766-6362-418f-b105-b282e06d50a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:35.537646 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a303766-6362-418f-b105-b282e06d50a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:35.547594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a303766-6362-418f-b105-b282e06d50a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:35.553322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-3a303766-6362-418f-b105-b282e06d50a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:35.553322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:35.553322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:35.553322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:35.553322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:35.553322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:35.553322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:35.553322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:35.553322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:35.553322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:35.553322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:35.553322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:35.553322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:35.553322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:35.553322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:35.553322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:35.554231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:35.554231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:35.554231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:35.554231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:35.554231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:35.554231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:35.554231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:35.554231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:35.554231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:35.554231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:35.554231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:35.554231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:35.554231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:35.554231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:35.554231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:35.554231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:35.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:35.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:35.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:35.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:35.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:35.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:35.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:35.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:35.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:35.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:35.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:35.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:35.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 339/671] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:42:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:35.555718 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a303766-6362-418f-b105-b282e06d50a3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:35.614493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eac4ed-051b-425e-b0c8-e214f4cd02a8 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:35.617658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:35.648474 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace51bf-ef15-498f-a93b-2d855fe8ef5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:35.649112 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace51bf-ef15-498f-a93b-2d855fe8ef5e None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:35.649395 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace51bf-ef15-498f-a93b-2d855fe8ef5e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:35.649666 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace51bf-ef15-498f-a93b-2d855fe8ef5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:35.650452 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace51bf-ef15-498f-a93b-2d855fe8ef5e None admin] RBAC: Adding query filter params (role.id=f8cbbf969cfc442595755799825094f6, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=98465c2d73e540b5bf506f5a7423e035) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:35.650758 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace51bf-ef15-498f-a93b-2d855fe8ef5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:35.652195 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace51bf-ef15-498f-a93b-2d855fe8ef5e None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:35.658302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 333/672] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:42:35 2022] GET /identity/v3/role_assignments?user.id=98465c2d73e540b5bf506f5a7423e035&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=f8cbbf969cfc442595755799825094f6 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:35.659076 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace51bf-ef15-498f-a93b-2d855fe8ef5e None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:35.682359 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a303766-6362-418f-b105-b282e06d50a3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:35.720391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:35.726861 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed000cf2-0ab0-4fc3-b422-0b571d6c70c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:35.727610 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed000cf2-0ab0-4fc3-b422-0b571d6c70c1 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:35.727889 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed000cf2-0ab0-4fc3-b422-0b571d6c70c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:35.728162 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed000cf2-0ab0-4fc3-b422-0b571d6c70c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:35.736898 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed000cf2-0ab0-4fc3-b422-0b571d6c70c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:35.738528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed000cf2-0ab0-4fc3-b422-0b571d6c70c1 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:35.752912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-ed000cf2-0ab0-4fc3-b422-0b571d6c70c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:35.752912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:35.752912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:35.752912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:35.752912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:35.752912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:35.752912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:35.752912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:35.752912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:35.752912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:35.752912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:35.752912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:35.752912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:35.752912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:35.752912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:35.753883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:35.753883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:35.753883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:35.753883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:35.753883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:35.753883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:35.753883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:35.753883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:35.753883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:35.753883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:35.753883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:35.753883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:35.753883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:35.753883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:35.753883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:35.753883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:35.753883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:35.754753 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:35.754753 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:35.754753 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:35.754753 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:35.754753 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:35.754753 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:35.754753 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:35.754753 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:35.759441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 340/673] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:35.760964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed000cf2-0ab0-4fc3-b422-0b571d6c70c1 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:35.795593 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace51bf-ef15-498f-a93b-2d855fe8ef5e None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:35.835101 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18bf6b-31f8-458a-9798-2d6f09c3185d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:35.836217 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18bf6b-31f8-458a-9798-2d6f09c3185d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:35.836698 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18bf6b-31f8-458a-9798-2d6f09c3185d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:35.837241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18bf6b-31f8-458a-9798-2d6f09c3185d None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:35.838148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18bf6b-31f8-458a-9798-2d6f09c3185d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:35.838657 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18bf6b-31f8-458a-9798-2d6f09c3185d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:35.840490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18bf6b-31f8-458a-9798-2d6f09c3185d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:35.854632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 334/674] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:35.855645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18bf6b-31f8-458a-9798-2d6f09c3185d None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:35.885740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed000cf2-0ab0-4fc3-b422-0b571d6c70c1 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:35.902647 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:35.931067 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed4ded-af5b-4849-bd9d-3a710aac4a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:35.932085 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed4ded-af5b-4849-bd9d-3a710aac4a62 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:35.932428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed4ded-af5b-4849-bd9d-3a710aac4a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:35.932766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed4ded-af5b-4849-bd9d-3a710aac4a62 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:35.933686 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed4ded-af5b-4849-bd9d-3a710aac4a62 None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:35.933984 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed4ded-af5b-4849-bd9d-3a710aac4a62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:35.935406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed4ded-af5b-4849-bd9d-3a710aac4a62 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:35.945009 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 341/675] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Jul 28 17:42:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:35.946532 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed4ded-af5b-4849-bd9d-3a710aac4a62 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:35.975419 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18bf6b-31f8-458a-9798-2d6f09c3185d None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:35.990187 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:36.029655 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3558e26-a766-4680-bd79-9741299776ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:36.030707 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3558e26-a766-4680-bd79-9741299776ae None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:36.031989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3558e26-a766-4680-bd79-9741299776ae None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:36.032376 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3558e26-a766-4680-bd79-9741299776ae None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:36.033303 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3558e26-a766-4680-bd79-9741299776ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:36.033727 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3558e26-a766-4680-bd79-9741299776ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:36.035312 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3558e26-a766-4680-bd79-9741299776ae None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:36.050547 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 335/676] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:36.051440 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3558e26-a766-4680-bd79-9741299776ae None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:36.073759 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed4ded-af5b-4849-bd9d-3a710aac4a62 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:36.116555 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59c5e3-ceca-41b2-b459-e6640c6629c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:36.117424 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59c5e3-ceca-41b2-b459-e6640c6629c8 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:36.117799 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59c5e3-ceca-41b2-b459-e6640c6629c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:36.118262 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59c5e3-ceca-41b2-b459-e6640c6629c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:36.126399 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59c5e3-ceca-41b2-b459-e6640c6629c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:36.128166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59c5e3-ceca-41b2-b459-e6640c6629c8 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:36.141598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-8d59c5e3-ceca-41b2-b459-e6640c6629c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:36.141598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:36.141598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:36.141598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:36.141598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:36.141598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:36.141598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:36.141598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:36.141598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:36.141598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:36.141598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:36.141598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:36.141598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:36.141598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:36.141598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:36.142671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:36.142671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:36.142671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:36.142671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:36.142671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:36.142671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:36.142671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:36.142671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:36.142671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:36.142671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:36.142671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:36.142671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:36.142671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:36.142671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:36.142671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:36.142671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:36.142671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:36.143738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:36.143738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:36.143738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:36.143738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:36.143738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:36.143738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:36.143738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:36.143738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:36.146232 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 342/677] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:36.147061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59c5e3-ceca-41b2-b459-e6640c6629c8 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:36.161459 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3558e26-a766-4680-bd79-9741299776ae None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:36.186415 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:36.198023 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d2ce9-7524-44fc-b220-c057aeb67231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:36.198672 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d2ce9-7524-44fc-b220-c057aeb67231 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:36.198951 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d2ce9-7524-44fc-b220-c057aeb67231 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:36.199224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d2ce9-7524-44fc-b220-c057aeb67231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:36.211897 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d2ce9-7524-44fc-b220-c057aeb67231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:36.213478 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d2ce9-7524-44fc-b220-c057aeb67231 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:36.230064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-9c1d2ce9-7524-44fc-b220-c057aeb67231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:36.230064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:36.230064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:36.230064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:36.230064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:36.230064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:36.230064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:36.230064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:36.230064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:36.230064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:36.230064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:36.230064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:36.230064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:36.230064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:36.230064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:36.232237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:36.232237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:36.232237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:36.232237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:36.232237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:36.232237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:36.232237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:36.232237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:36.232237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:36.232237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:36.232237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:36.232237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:36.232237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:36.232237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:36.232237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:36.232237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:36.232237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:36.234441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:36.234441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:36.234441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:36.234441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:36.234441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 336/678] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:36.234441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d2ce9-7524-44fc-b220-c057aeb67231 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:36.253863 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:36.260551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59c5e3-ceca-41b2-b459-e6640c6629c8 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:36.301109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e07d33-1741-4cd9-9402-1cc3efde84fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:36.301744 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e07d33-1741-4cd9-9402-1cc3efde84fc None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:36.302116 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e07d33-1741-4cd9-9402-1cc3efde84fc None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:36.302586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e07d33-1741-4cd9-9402-1cc3efde84fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:36.303445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e07d33-1741-4cd9-9402-1cc3efde84fc None admin] RBAC: Adding query filter params (role.id=f8cbbf969cfc442595755799825094f6, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=e6d20d753e37498e8664f983b0988e3d) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:36.303757 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e07d33-1741-4cd9-9402-1cc3efde84fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:36.305269 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e07d33-1741-4cd9-9402-1cc3efde84fc None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:36.311585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 343/679] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:42:36 2022] GET /identity/v3/role_assignments?user.id=e6d20d753e37498e8664f983b0988e3d&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=f8cbbf969cfc442595755799825094f6 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:36.312407 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e07d33-1741-4cd9-9402-1cc3efde84fc None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:36.353416 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d2ce9-7524-44fc-b220-c057aeb67231 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:36.396813 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4758bb-b84e-49ef-bd2e-602fb108ff25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:36.397561 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4758bb-b84e-49ef-bd2e-602fb108ff25 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:36.397905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4758bb-b84e-49ef-bd2e-602fb108ff25 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:36.398252 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4758bb-b84e-49ef-bd2e-602fb108ff25 None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:36.399154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4758bb-b84e-49ef-bd2e-602fb108ff25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:36.399531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4758bb-b84e-49ef-bd2e-602fb108ff25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:36.401145 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4758bb-b84e-49ef-bd2e-602fb108ff25 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:36.417034 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 337/680] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:36.418577 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38653f0-c144-439e-bb74-20c1070f05a7 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:36.418932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38653f0-c144-439e-bb74-20c1070f05a7 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:36.419271 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38653f0-c144-439e-bb74-20c1070f05a7 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:36.421136 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 338/681] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:36.429626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468d307-4d81-4419-bddd-69697eccfcee None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:36.429626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468d307-4d81-4419-bddd-69697eccfcee None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:36.429626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468d307-4d81-4419-bddd-69697eccfcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:36.451280 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-e468d307-4d81-4419-bddd-69697eccfcee None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:36.452861 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e468d307-4d81-4419-bddd-69697eccfcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:36.541084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 339/682] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:42:36.541084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468d307-4d81-4419-bddd-69697eccfcee None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:36.546332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:36.571648 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:36.575931 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e07d33-1741-4cd9-9402-1cc3efde84fc None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:36.631514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdf29e-09c0-405f-bf34-a3c07a6aabf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:36.632147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdf29e-09c0-405f-bf34-a3c07a6aabf4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:36.632424 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdf29e-09c0-405f-bf34-a3c07a6aabf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:36.632697 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdf29e-09c0-405f-bf34-a3c07a6aabf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:36.633422 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fdf29e-09c0-405f-bf34-a3c07a6aabf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:36.633727 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fdf29e-09c0-405f-bf34-a3c07a6aabf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:36.635689 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fdf29e-09c0-405f-bf34-a3c07a6aabf4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:36.653248 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 344/683] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:36.654350 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdf29e-09c0-405f-bf34-a3c07a6aabf4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:36.667976 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468d307-4d81-4419-bddd-69697eccfcee None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:36.713921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e5aca-ea3c-4ad3-826c-59fc68361a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:36.714552 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e5aca-ea3c-4ad3-826c-59fc68361a8b None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:36.714830 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e5aca-ea3c-4ad3-826c-59fc68361a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:36.715136 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e5aca-ea3c-4ad3-826c-59fc68361a8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:36.716478 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e5aca-ea3c-4ad3-826c-59fc68361a8b None admin] RBAC: Adding query filter params (role.id=f8cbbf969cfc442595755799825094f6, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=76add49d4be940ad846d32fa16431988) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:36.716900 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e5aca-ea3c-4ad3-826c-59fc68361a8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:36.719032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e5aca-ea3c-4ad3-826c-59fc68361a8b None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:36.729152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 340/684] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:42:36 2022] GET /identity/v3/role_assignments?user.id=76add49d4be940ad846d32fa16431988&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=f8cbbf969cfc442595755799825094f6 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:36.730895 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e5aca-ea3c-4ad3-826c-59fc68361a8b None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:36.794378 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdf29e-09c0-405f-bf34-a3c07a6aabf4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:36.866619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36cc2a-9689-4ad0-9d8f-3eb5130b0458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:36.869339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36cc2a-9689-4ad0-9d8f-3eb5130b0458 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:36.870428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36cc2a-9689-4ad0-9d8f-3eb5130b0458 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:36.870943 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:36.871784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36cc2a-9689-4ad0-9d8f-3eb5130b0458 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:36.903523 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36cc2a-9689-4ad0-9d8f-3eb5130b0458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:36.913611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-fc36cc2a-9689-4ad0-9d8f-3eb5130b0458 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:42:36.913611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:36.913611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:36.913611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:36.913611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:36.913611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:36.913611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:36.913611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:36.913611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:36.913611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:36.913611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:36.913611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:36.913611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:36.913611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:36.913611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:36.913611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:36.914826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:36.914826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:36.914826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:36.914826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:36.914826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:36.914826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:36.914826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:36.914826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:36.914826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:36.914826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:36.914826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:36.914826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:36.914826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:36.914826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:36.914826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:36.914826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:36.915854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:36.915854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:36.915854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:36.915854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:36.915854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:36.915854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:36.915854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:36.915854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:36.915854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:36.915854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:36.915854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:42:36.915854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:36.926037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 345/685] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:42:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:36.927757 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36cc2a-9689-4ad0-9d8f-3eb5130b0458 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:36.941239 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e5aca-ea3c-4ad3-826c-59fc68361a8b None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:36.960066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:36.992832 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aff3df-7edb-4872-99ba-c9ea7c73faeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:36.993667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aff3df-7edb-4872-99ba-c9ea7c73faeb None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:36.993945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aff3df-7edb-4872-99ba-c9ea7c73faeb None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:36.994483 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aff3df-7edb-4872-99ba-c9ea7c73faeb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:37.004593 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aff3df-7edb-4872-99ba-c9ea7c73faeb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:37.006830 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aff3df-7edb-4872-99ba-c9ea7c73faeb None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:37.024631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-c6aff3df-7edb-4872-99ba-c9ea7c73faeb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:42:37.024631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:37.024631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:37.024631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:37.024631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:37.024631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:37.024631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:37.024631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:37.024631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:37.024631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:37.024631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:37.024631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:37.024631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:37.024631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:37.024631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:37.024631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:37.025601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:37.025601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:37.025601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:37.025601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:37.025601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:37.025601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:37.025601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:37.025601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:37.025601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:37.025601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:37.025601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:37.025601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:37.025601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:37.025601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:37.025601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:37.025601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:37.025601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:37.025601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:37.026539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:37.026539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:37.026539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:37.026539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:37.026539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:37.026539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:37.026539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:37.026539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:37.026539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:42:37.026539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:37.026539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 341/686] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:42:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:37.034877 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aff3df-7edb-4872-99ba-c9ea7c73faeb None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:37.069320 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36cc2a-9689-4ad0-9d8f-3eb5130b0458 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:37.105704 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58503370-544d-49db-a09b-12ef01d676a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:37.106313 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58503370-544d-49db-a09b-12ef01d676a9 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:37.106592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58503370-544d-49db-a09b-12ef01d676a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:37.106862 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58503370-544d-49db-a09b-12ef01d676a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:37.107566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58503370-544d-49db-a09b-12ef01d676a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:37.107868 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58503370-544d-49db-a09b-12ef01d676a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:37.109294 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58503370-544d-49db-a09b-12ef01d676a9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:37.122793 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 346/687] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:42:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:37.124717 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58503370-544d-49db-a09b-12ef01d676a9 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:37.156731 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aff3df-7edb-4872-99ba-c9ea7c73faeb None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:37.195136 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:37.204767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0fc71-de66-459c-ab1e-69a41f1a1b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:37.205424 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0fc71-de66-459c-ab1e-69a41f1a1b96 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:37.205708 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0fc71-de66-459c-ab1e-69a41f1a1b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:37.205986 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0fc71-de66-459c-ab1e-69a41f1a1b96 None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:37.206794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0fc71-de66-459c-ab1e-69a41f1a1b96 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:37.207104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0fc71-de66-459c-ab1e-69a41f1a1b96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:37.208629 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0fc71-de66-459c-ab1e-69a41f1a1b96 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:37.231584 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 342/688] 10.222.0.96 () {56 vars in 1135 bytes} [Thu Jul 28 17:42:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:37.233253 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0fc71-de66-459c-ab1e-69a41f1a1b96 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:37.309433 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:37.316136 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58503370-544d-49db-a09b-12ef01d676a9 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:37.348173 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0fc71-de66-459c-ab1e-69a41f1a1b96 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:37.365801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5663efc-4b77-4b42-b518-22277079455c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:37.366860 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5663efc-4b77-4b42-b518-22277079455c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:37.367341 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5663efc-4b77-4b42-b518-22277079455c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:37.367814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5663efc-4b77-4b42-b518-22277079455c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:37.388974 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5663efc-4b77-4b42-b518-22277079455c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:37.390811 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5663efc-4b77-4b42-b518-22277079455c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:37.416609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-c5663efc-4b77-4b42-b518-22277079455c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:37.416609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:37.416609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:37.416609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:37.416609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:37.416609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:37.416609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:37.416609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:37.416609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:37.416609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:37.416609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:37.416609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:37.416609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:37.416609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:37.416609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:37.417564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:37.417564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:37.417564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:37.417564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:37.417564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:37.417564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:37.417564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:37.417564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:37.417564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:37.417564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:37.417564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:37.417564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:37.417564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:37.417564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:37.417564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:37.417564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:37.417564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:37.418451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:37.418451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:37.418451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:37.418451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:37.421145 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbe45a-237e-4e5c-b09f-cdf0585b207d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:37.422012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbe45a-237e-4e5c-b09f-cdf0585b207d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:37.422506 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbe45a-237e-4e5c-b09f-cdf0585b207d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:37.422973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbe45a-237e-4e5c-b09f-cdf0585b207d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:37.427326 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 347/689] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:37.433029 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5663efc-4b77-4b42-b518-22277079455c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:37.534562 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:37.566160 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbe45a-237e-4e5c-b09f-cdf0585b207d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:37.567658 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbe45a-237e-4e5c-b09f-cdf0585b207d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:37.589022 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5663efc-4b77-4b42-b518-22277079455c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:37.660479 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a12204-3359-4ef5-b2f5-dfd86fdbd36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:37.661209 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a12204-3359-4ef5-b2f5-dfd86fdbd36e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:37.661495 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a12204-3359-4ef5-b2f5-dfd86fdbd36e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:37.661998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a12204-3359-4ef5-b2f5-dfd86fdbd36e None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:37.662703 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a12204-3359-4ef5-b2f5-dfd86fdbd36e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:37.663002 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a12204-3359-4ef5-b2f5-dfd86fdbd36e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:37.664386 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a12204-3359-4ef5-b2f5-dfd86fdbd36e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:37.669427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:37.694522 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 348/690] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:37.697521 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a12204-3359-4ef5-b2f5-dfd86fdbd36e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:37.754057 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 343/691] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:42:37.755333 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbe45a-237e-4e5c-b09f-cdf0585b207d None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:37.843127 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a12204-3359-4ef5-b2f5-dfd86fdbd36e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:37.904658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2b974-4d1a-457b-bef1-63df632f695b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:37.905757 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2b974-4d1a-457b-bef1-63df632f695b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:37.905757 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2b974-4d1a-457b-bef1-63df632f695b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:37.905930 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2b974-4d1a-457b-bef1-63df632f695b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:37.920129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2b974-4d1a-457b-bef1-63df632f695b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:37.920384 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:37.921582 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2b974-4d1a-457b-bef1-63df632f695b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:37.936821 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbe45a-237e-4e5c-b09f-cdf0585b207d None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:37.950994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-eeb2b974-4d1a-457b-bef1-63df632f695b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:42:37.950994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:37.950994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:37.950994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:37.950994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:37.950994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:37.950994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:37.950994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:37.950994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:37.950994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:37.950994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:37.950994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:37.950994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:37.950994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:37.950994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:37.950994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:37.952166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:37.952166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:37.952166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:37.952166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:37.952166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:37.952166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:37.952166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:37.952166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:37.952166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:37.952166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:37.952166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:37.952166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:37.952166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:37.952166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:37.952166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:37.952166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:37.952166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:37.952166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:37.953394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:37.953394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:37.953394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:37.953394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:37.953394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:37.953394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:37.953394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:37.953394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:37.953394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:42:37.953394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:37.958015 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 349/692] 10.222.0.96 () {56 vars in 1093 bytes} [Thu Jul 28 17:42:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:37.960006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2b974-4d1a-457b-bef1-63df632f695b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:38.001097 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa6d12-2484-44db-a8d8-0ea1cc8bd8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:38.001752 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa6d12-2484-44db-a8d8-0ea1cc8bd8bd None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:38.002028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa6d12-2484-44db-a8d8-0ea1cc8bd8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:38.002308 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa6d12-2484-44db-a8d8-0ea1cc8bd8bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:38.029986 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa6d12-2484-44db-a8d8-0ea1cc8bd8bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:38.031481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa6d12-2484-44db-a8d8-0ea1cc8bd8bd None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:38.062531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-c5fa6d12-2484-44db-a8d8-0ea1cc8bd8bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:38.062531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:38.062531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:38.062531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:38.062531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:38.062531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:38.062531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:38.062531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:38.062531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:38.062531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:38.062531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:38.062531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:38.062531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:38.062531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:38.062531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:38.063486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:38.063486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:38.063486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:38.063486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:38.063486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:38.063486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:38.063486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:38.063486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:38.063486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:38.063486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:38.063486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:38.063486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:38.063486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:38.063486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:38.063486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:38.063486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:38.063486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:38.064372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:38.064372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:38.064372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:38.064372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:38.068660 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 344/693] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:38.072711 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:38.073630 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa6d12-2484-44db-a8d8-0ea1cc8bd8bd None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:38.109613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2b974-4d1a-457b-bef1-63df632f695b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:38.159646 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7f690-a13c-4d88-9358-743e782e1656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:38.161290 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7f690-a13c-4d88-9358-743e782e1656 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:38.161777 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7f690-a13c-4d88-9358-743e782e1656 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:38.162264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7f690-a13c-4d88-9358-743e782e1656 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:38.163696 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7f690-a13c-4d88-9358-743e782e1656 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:38.164215 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7f690-a13c-4d88-9358-743e782e1656 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:38.166583 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7f690-a13c-4d88-9358-743e782e1656 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:38.187633 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa6d12-2484-44db-a8d8-0ea1cc8bd8bd None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:38.189921 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 350/694] 10.222.0.96 () {56 vars in 1133 bytes} [Thu Jul 28 17:42:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:38.191414 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3f7a6-9822-45dd-b31d-d37d6f792cfc None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:38.191839 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3f7a6-9822-45dd-b31d-d37d6f792cfc None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:38.192283 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3f7a6-9822-45dd-b31d-d37d6f792cfc None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:38.194096 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 351/695] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:38.195055 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3f7a6-9822-45dd-b31d-d37d6f792cfc None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:38.228113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467c121-979a-4315-8a7e-47db74f91880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:38.228905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467c121-979a-4315-8a7e-47db74f91880 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:38.229321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467c121-979a-4315-8a7e-47db74f91880 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:38.229692 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467c121-979a-4315-8a7e-47db74f91880 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:38.230523 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467c121-979a-4315-8a7e-47db74f91880 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:38.230933 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467c121-979a-4315-8a7e-47db74f91880 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:38.232586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467c121-979a-4315-8a7e-47db74f91880 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:38.247613 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 345/696] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:38.249151 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b64d7-5546-4a6f-aecd-261eccd0d6bf None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:38.249533 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b64d7-5546-4a6f-aecd-261eccd0d6bf None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:38.249899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b64d7-5546-4a6f-aecd-261eccd0d6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:38.257897 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:38.272190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-d79b64d7-5546-4a6f-aecd-261eccd0d6bf None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:38.273646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-d79b64d7-5546-4a6f-aecd-261eccd0d6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:38.313841 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3f7a6-9822-45dd-b31d-d37d6f792cfc None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:38.328612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:38.352813 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0a8ce-da2c-48ee-a112-f87e0199fac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:38.353754 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0a8ce-da2c-48ee-a112-f87e0199fac4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:38.354198 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0a8ce-da2c-48ee-a112-f87e0199fac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:38.354643 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0a8ce-da2c-48ee-a112-f87e0199fac4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:38.373126 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 346/697] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:38.374275 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b64d7-5546-4a6f-aecd-261eccd0d6bf None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:38.457976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0a8ce-da2c-48ee-a112-f87e0199fac4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:38.460449 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0a8ce-da2c-48ee-a112-f87e0199fac4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:38.489666 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b64d7-5546-4a6f-aecd-261eccd0d6bf None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:38.521738 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:38.527187 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc84f91-1160-4ac8-aa9b-8f3e22787764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:38.528121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc84f91-1160-4ac8-aa9b-8f3e22787764 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:38.528628 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc84f91-1160-4ac8-aa9b-8f3e22787764 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:38.529111 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc84f91-1160-4ac8-aa9b-8f3e22787764 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:38.536375 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc84f91-1160-4ac8-aa9b-8f3e22787764 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:38.538271 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc84f91-1160-4ac8-aa9b-8f3e22787764 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:38.590437 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 352/698] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:42:38.591371 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0a8ce-da2c-48ee-a112-f87e0199fac4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:38.608452 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:38.679243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-1dc84f91-1160-4ac8-aa9b-8f3e22787764 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:38.679243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:38.679243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:38.679243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:38.679243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:38.679243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:38.679243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:38.679243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:38.679243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:38.679243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:38.679243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:38.679243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:38.679243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:38.679243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:38.679243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:38.680236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:38.680236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:38.680236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:38.680236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:38.680236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:38.680236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:38.680236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:38.680236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:38.680236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:38.680236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:38.680236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:38.680236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:38.680236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:38.680236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:38.680236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:38.680236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:38.680236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:38.681251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:38.681251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:38.681251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:38.681251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:38.681251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:38.681251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:38.681251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:38.681251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:38.683056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 347/699] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:38.684051 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc84f91-1160-4ac8-aa9b-8f3e22787764 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:38.707610 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0a8ce-da2c-48ee-a112-f87e0199fac4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:38.744957 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0c21f-66a3-4159-aaf7-4efa63f2b146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:38.746158 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0c21f-66a3-4159-aaf7-4efa63f2b146 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:38.746622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0c21f-66a3-4159-aaf7-4efa63f2b146 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:38.747070 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0c21f-66a3-4159-aaf7-4efa63f2b146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:38.758819 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0c21f-66a3-4159-aaf7-4efa63f2b146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:38.760305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0c21f-66a3-4159-aaf7-4efa63f2b146 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:38.777451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-5ee0c21f-66a3-4159-aaf7-4efa63f2b146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:38.777451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:38.777451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:38.777451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:38.777451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:38.777451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:38.777451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:38.777451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:38.777451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:38.777451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:38.777451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:38.777451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:38.777451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:38.777451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:38.777451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:38.778360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:38.778360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:38.778360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:38.778360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:38.778360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:38.778360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:38.778360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:38.778360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:38.778360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:38.778360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:38.778360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:38.778360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:38.778360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:38.778360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:38.778360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:38.778360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:38.778360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:38.779246 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:38.779246 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:38.779246 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:38.779246 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:38.779246 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 353/700] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:38.780035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846a8dd-6877-48ed-87a6-5a69078c2759 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:38.780142 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846a8dd-6877-48ed-87a6-5a69078c2759 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:38.780397 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846a8dd-6877-48ed-87a6-5a69078c2759 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:38.781742 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 354/701] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:38.782296 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846a8dd-6877-48ed-87a6-5a69078c2759 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:38.796463 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc84f91-1160-4ac8-aa9b-8f3e22787764 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:38.831142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4549fd4-de26-49f8-b0df-77ee3d155649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:38.832124 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4549fd4-de26-49f8-b0df-77ee3d155649 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:38.832573 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4549fd4-de26-49f8-b0df-77ee3d155649 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:38.832987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4549fd4-de26-49f8-b0df-77ee3d155649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:38.844975 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4549fd4-de26-49f8-b0df-77ee3d155649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:38.846455 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4549fd4-de26-49f8-b0df-77ee3d155649 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:38.851166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:38.861302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-c4549fd4-de26-49f8-b0df-77ee3d155649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:38.861302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:38.861302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:38.861302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:38.861302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:38.861302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:38.861302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:38.861302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:38.861302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:38.861302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:38.861302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:38.861302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:38.861302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:38.861302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:38.861302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:38.862198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:38.862198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:38.862198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:38.862198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:38.862198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:38.862198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:38.862198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:38.862198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:38.862198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:38.862198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:38.862198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:38.862198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:38.862198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:38.862198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:38.862198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:38.862198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:38.862198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:38.863189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:38.863189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:38.863189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:38.863189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:38.863189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 348/702] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:38.863950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4549fd4-de26-49f8-b0df-77ee3d155649 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:38.899724 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846a8dd-6877-48ed-87a6-5a69078c2759 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:38.913712 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:38.941412 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3d0fd-6a2e-450d-8a4a-0a4330da5312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:38.942129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3d0fd-6a2e-450d-8a4a-0a4330da5312 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:38.942325 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3d0fd-6a2e-450d-8a4a-0a4330da5312 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:38.942757 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3d0fd-6a2e-450d-8a4a-0a4330da5312 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:38.944243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3d0fd-6a2e-450d-8a4a-0a4330da5312 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:38.944243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3d0fd-6a2e-450d-8a4a-0a4330da5312 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:38.945288 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3d0fd-6a2e-450d-8a4a-0a4330da5312 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:38.958043 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 355/703] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:38.962901 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73402b78-c248-4c30-9a60-5991b46def00 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:38.963413 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73402b78-c248-4c30-9a60-5991b46def00 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:38.963840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73402b78-c248-4c30-9a60-5991b46def00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:38.974366 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4549fd4-de26-49f8-b0df-77ee3d155649 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:38.981964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-73402b78-c248-4c30-9a60-5991b46def00 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:38.983147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-73402b78-c248-4c30-9a60-5991b46def00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:39.012099 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf9fd0-60e1-4192-afb6-5996088b9887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:39.013511 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf9fd0-60e1-4192-afb6-5996088b9887 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:39.013955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf9fd0-60e1-4192-afb6-5996088b9887 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:39.014367 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf9fd0-60e1-4192-afb6-5996088b9887 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:39.015200 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf9fd0-60e1-4192-afb6-5996088b9887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:39.015708 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf9fd0-60e1-4192-afb6-5996088b9887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:39.017113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf9fd0-60e1-4192-afb6-5996088b9887 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:39.037672 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 349/704] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:39.037672 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf9fd0-60e1-4192-afb6-5996088b9887 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:39.065849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 356/705] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:39.065849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73402b78-c248-4c30-9a60-5991b46def00 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:39.130758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:39.139442 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf9fd0-60e1-4192-afb6-5996088b9887 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:39.142590 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:39.174701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214ba46-86c1-4c49-929f-1e43074accf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:39.175330 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214ba46-86c1-4c49-929f-1e43074accf5 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:39.175631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214ba46-86c1-4c49-929f-1e43074accf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:39.175903 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214ba46-86c1-4c49-929f-1e43074accf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:39.176586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214ba46-86c1-4c49-929f-1e43074accf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:39.176962 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214ba46-86c1-4c49-929f-1e43074accf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:39.177938 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73402b78-c248-4c30-9a60-5991b46def00 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:39.178614 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214ba46-86c1-4c49-929f-1e43074accf5 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:39.190133 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 350/706] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:39.191130 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214ba46-86c1-4c49-929f-1e43074accf5 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:39.212434 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e30b20-778f-465d-8340-a2ce25a2f787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:39.213079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e30b20-778f-465d-8340-a2ce25a2f787 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:39.213359 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e30b20-778f-465d-8340-a2ce25a2f787 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:39.213627 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e30b20-778f-465d-8340-a2ce25a2f787 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:39.214404 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e30b20-778f-465d-8340-a2ce25a2f787 None admin] RBAC: Adding query filter params (role.id=f8cbbf969cfc442595755799825094f6, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=4ea1a9023eaf427f96f86af909a803fd) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:39.214716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e30b20-778f-465d-8340-a2ce25a2f787 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:39.216141 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e30b20-778f-465d-8340-a2ce25a2f787 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:39.221906 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 357/707] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:42:39 2022] GET /identity/v3/role_assignments?user.id=4ea1a9023eaf427f96f86af909a803fd&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=f8cbbf969cfc442595755799825094f6 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:39.222737 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e30b20-778f-465d-8340-a2ce25a2f787 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:39.302802 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214ba46-86c1-4c49-929f-1e43074accf5 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:39.336280 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e30b20-778f-465d-8340-a2ce25a2f787 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:39.342027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e74b4-e365-4a33-abfe-352c5ff3ea07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:39.342756 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e74b4-e365-4a33-abfe-352c5ff3ea07 None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:39.343094 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e74b4-e365-4a33-abfe-352c5ff3ea07 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:39.343425 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e74b4-e365-4a33-abfe-352c5ff3ea07 None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:39.344207 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e74b4-e365-4a33-abfe-352c5ff3ea07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:39.345795 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e74b4-e365-4a33-abfe-352c5ff3ea07 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:39.356720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:39.376567 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff0b0e-75f7-439d-bd67-9aea8d606c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:39.377558 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 351/708] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Jul 28 17:42:39 2022] POST /identity/v3/users => generated 254 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:42:39.377664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff0b0e-75f7-439d-bd67-9aea8d606c72 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:39.378827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff0b0e-75f7-439d-bd67-9aea8d606c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:39.378827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff0b0e-75f7-439d-bd67-9aea8d606c72 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:39.379026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9f687-856d-4e82-ab9c-65ec3a2a0027 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:39.379026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9f687-856d-4e82-ab9c-65ec3a2a0027 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:39.379162 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff0b0e-75f7-439d-bd67-9aea8d606c72 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:39.379383 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9f687-856d-4e82-ab9c-65ec3a2a0027 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:39.380655 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff0b0e-75f7-439d-bd67-9aea8d606c72 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:39.381325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 352/709] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:39.382149 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9f687-856d-4e82-ab9c-65ec3a2a0027 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:39.399376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-7aff0b0e-75f7-439d-bd67-9aea8d606c72 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:42:39.399376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:39.399376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:42:39.399376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:42:39.399376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:42:39.399376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:42:39.399376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:42:39.399376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:42:39.399376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:42:39.399376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:39.399376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:42:39.399376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:39.399376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:39.399376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:39.399376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:39.399376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:39.400591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:39.400591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:39.400591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:39.400591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:39.400591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:39.400591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:39.400591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:39.400591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:42:39.400591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:42:39.400591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:42:39.400591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:42:39.400591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:39.400591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:39.400591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:39.400591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:39.400591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:39.401620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:39.401620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:39.401620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:39.401620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:39.401620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:39.401620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:39.401620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:39.401620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:39.401620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:39.401620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:39.401620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:39.401620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:42:39.401620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:42:39.401620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:42:39.401620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:39.403987 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 358/710] 10.222.0.96 () {56 vars in 1129 bytes} [Thu Jul 28 17:42:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:39.405642 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1549d9c-2dcf-41d8-a101-b4911e188af9 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:39.405912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1549d9c-2dcf-41d8-a101-b4911e188af9 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:39.406204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1549d9c-2dcf-41d8-a101-b4911e188af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:39.414937 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:39.430614 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f1549d9c-2dcf-41d8-a101-b4911e188af9 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:39.431867 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f1549d9c-2dcf-41d8-a101-b4911e188af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:39.522217 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 359/711] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:39.522217 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1549d9c-2dcf-41d8-a101-b4911e188af9 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:39.537617 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9f687-856d-4e82-ab9c-65ec3a2a0027 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:39.574248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6663cd-24dd-4b3f-811c-8110151840f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:39.574856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6663cd-24dd-4b3f-811c-8110151840f8 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:39.575139 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6663cd-24dd-4b3f-811c-8110151840f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:39.575413 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6663cd-24dd-4b3f-811c-8110151840f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:39.583473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6663cd-24dd-4b3f-811c-8110151840f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:39.585035 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6663cd-24dd-4b3f-811c-8110151840f8 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:39.596960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-dc6663cd-24dd-4b3f-811c-8110151840f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:39.596960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:39.596960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:39.596960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:39.596960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:39.596960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:39.596960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:39.596960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:39.596960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:39.596960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:39.596960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:39.596960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:39.596960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:39.596960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:39.596960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:39.597955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:39.597955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:39.597955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:39.597955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:39.597955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:39.597955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:39.597955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:39.597955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:39.597955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:39.597955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:39.597955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:39.597955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:39.597955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:39.597955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:39.597955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:39.597955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:39.597955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:39.598928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:39.598928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:39.598928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:39.598928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:39.598928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:39.598928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:39.598928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:39.598928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:39.598928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 353/712] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:39.599405 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6663cd-24dd-4b3f-811c-8110151840f8 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:39.651362 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1549d9c-2dcf-41d8-a101-b4911e188af9 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:39.675042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:39.699840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:39.702892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55d7a0-8fdb-4d1f-b80c-905cbd084e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:39.704116 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55d7a0-8fdb-4d1f-b80c-905cbd084e4e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:39.704668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55d7a0-8fdb-4d1f-b80c-905cbd084e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:39.705168 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55d7a0-8fdb-4d1f-b80c-905cbd084e4e None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:39.706493 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55d7a0-8fdb-4d1f-b80c-905cbd084e4e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:39.707040 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55d7a0-8fdb-4d1f-b80c-905cbd084e4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:39.708814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55d7a0-8fdb-4d1f-b80c-905cbd084e4e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:39.714754 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 360/713] 10.222.0.96 () {56 vars in 1124 bytes} [Thu Jul 28 17:42:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:39.715886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55d7a0-8fdb-4d1f-b80c-905cbd084e4e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:39.723133 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6663cd-24dd-4b3f-811c-8110151840f8 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:39.770920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fbf4a-6150-4aed-abc6-3b3265ea6bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:39.771582 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fbf4a-6150-4aed-abc6-3b3265ea6bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:39.771856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fbf4a-6150-4aed-abc6-3b3265ea6bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:39.772135 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fbf4a-6150-4aed-abc6-3b3265ea6bc4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:39.772775 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fbf4a-6150-4aed-abc6-3b3265ea6bc4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:39.774183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fbf4a-6150-4aed-abc6-3b3265ea6bc4 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:39.789642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-309fbf4a-6150-4aed-abc6-3b3265ea6bc4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:42:39.789642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:39.789642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:42:39.789642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:42:39.789642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:42:39.789642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:42:39.789642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:42:39.789642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:42:39.789642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:42:39.789642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:39.789642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:42:39.789642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:39.789642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:39.789642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:39.789642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:39.789642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:39.789642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:39.790663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:39.790663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:39.790663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:39.790663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:39.790663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:39.790663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:39.790663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:42:39.790663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:42:39.790663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:42:39.790663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:42:39.790663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:39.790663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:39.790663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:39.790663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:39.790663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:39.790663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:39.791481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:39.791481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:39.791481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:39.791481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:39.791481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:39.791481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:39.791481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:39.791481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:39.791481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:39.791481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:39.791481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:42:39.791481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:42:39.791481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:42:39.791481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:39.791481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 354/714] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:39 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:39.792331 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fbf4a-6150-4aed-abc6-3b3265ea6bc4 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:39.834783 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55d7a0-8fdb-4d1f-b80c-905cbd084e4e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:39.879094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe05cc3-6cfe-4599-ba0d-47307f957d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:39.879742 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe05cc3-6cfe-4599-ba0d-47307f957d3b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:39.880118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe05cc3-6cfe-4599-ba0d-47307f957d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:39.880397 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe05cc3-6cfe-4599-ba0d-47307f957d3b None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:39.881435 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe05cc3-6cfe-4599-ba0d-47307f957d3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:39.881747 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe05cc3-6cfe-4599-ba0d-47307f957d3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:39.883380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe05cc3-6cfe-4599-ba0d-47307f957d3b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:39.897587 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 361/715] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:39.898590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe05cc3-6cfe-4599-ba0d-47307f957d3b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:39.920472 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fbf4a-6150-4aed-abc6-3b3265ea6bc4 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:39.940309 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:39.973182 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb5387-eec8-49e7-a32e-ec97840faf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:39.974128 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb5387-eec8-49e7-a32e-ec97840faf76 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:39.974545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb5387-eec8-49e7-a32e-ec97840faf76 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:39.975186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb5387-eec8-49e7-a32e-ec97840faf76 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:39.976586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb5387-eec8-49e7-a32e-ec97840faf76 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:39.977084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb5387-eec8-49e7-a32e-ec97840faf76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:39.979104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb5387-eec8-49e7-a32e-ec97840faf76 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:39.986725 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 355/716] 10.222.0.96 () {56 vars in 1124 bytes} [Thu Jul 28 17:42:39 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:39.988248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb5387-eec8-49e7-a32e-ec97840faf76 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:40.003629 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:40.029043 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe05cc3-6cfe-4599-ba0d-47307f957d3b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:40.085618 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974fb87-5592-48e7-9bb1-5743325583ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:40.086182 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974fb87-5592-48e7-9bb1-5743325583ae None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:40.086465 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974fb87-5592-48e7-9bb1-5743325583ae None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:40.086741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974fb87-5592-48e7-9bb1-5743325583ae None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:40.087440 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974fb87-5592-48e7-9bb1-5743325583ae None admin] RBAC: Adding query filter params (name=network) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:40.087746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974fb87-5592-48e7-9bb1-5743325583ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:40.093091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974fb87-5592-48e7-9bb1-5743325583ae None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:40.103179 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 362/717] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Jul 28 17:42:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:40.109755 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974fb87-5592-48e7-9bb1-5743325583ae None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:40.178453 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb5387-eec8-49e7-a32e-ec97840faf76 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:40.212794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8dedf-81db-4403-8d22-3299384170fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:40.213452 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8dedf-81db-4403-8d22-3299384170fc None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:40.213737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8dedf-81db-4403-8d22-3299384170fc None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:40.214010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8dedf-81db-4403-8d22-3299384170fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:40.214801 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8dedf-81db-4403-8d22-3299384170fc None admin] RBAC: Adding query filter params (role.id=980cae90acae42189f92fd6dd42867a5, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=5ac367247aa54671ae5c33d251017470) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:40.215113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8dedf-81db-4403-8d22-3299384170fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:40.216562 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8dedf-81db-4403-8d22-3299384170fc None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:40.224678 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 356/718] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:42:39 2022] GET /identity/v3/role_assignments?user.id=5ac367247aa54671ae5c33d251017470&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=980cae90acae42189f92fd6dd42867a5 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:40.264844 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:40.268649 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974fb87-5592-48e7-9bb1-5743325583ae None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:40.312737 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b9258-c0c1-4981-8052-07cc153c02d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:40.313412 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b9258-c0c1-4981-8052-07cc153c02d5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:40.313686 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b9258-c0c1-4981-8052-07cc153c02d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:40.313959 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b9258-c0c1-4981-8052-07cc153c02d5 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:40.314647 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b9258-c0c1-4981-8052-07cc153c02d5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:40.314948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b9258-c0c1-4981-8052-07cc153c02d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:40.316342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b9258-c0c1-4981-8052-07cc153c02d5 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:40.329250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 363/719] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Jul 28 17:42:40 2022] GET /identity/v3/services?type=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:41.889601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ededb-caf9-45b7-b36b-0710cfde5850 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:41.890589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ededb-caf9-45b7-b36b-0710cfde5850 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:41.891093 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ededb-caf9-45b7-b36b-0710cfde5850 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:41.892952 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 357/720] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:41.901481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e837a4-4e1d-431a-8335-c5cb3d2e5237 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:41.901958 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e837a4-4e1d-431a-8335-c5cb3d2e5237 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:41.902151 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e837a4-4e1d-431a-8335-c5cb3d2e5237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:41.930046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d7e837a4-4e1d-431a-8335-c5cb3d2e5237 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:41.931235 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d7e837a4-4e1d-431a-8335-c5cb3d2e5237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:42.002889 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e84109-fe84-4002-9ea2-56855571900b None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:42.003536 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e84109-fe84-4002-9ea2-56855571900b None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:42.004028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e84109-fe84-4002-9ea2-56855571900b None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:42.005971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 358/721] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:42.011606 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54643c0d-0b83-400f-8df0-71c4e31b1a05 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:42.011904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54643c0d-0b83-400f-8df0-71c4e31b1a05 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:42.012187 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54643c0d-0b83-400f-8df0-71c4e31b1a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:42.020150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 364/722] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:42:42.043784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e837a4-4e1d-431a-8335-c5cb3d2e5237 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:42.058098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-54643c0d-0b83-400f-8df0-71c4e31b1a05 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:42.059613 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-54643c0d-0b83-400f-8df0-71c4e31b1a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:42.185544 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:42.193604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e837a4-4e1d-431a-8335-c5cb3d2e5237 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:42.203283 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 359/723] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:42.236517 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207c987-ffa0-465c-aa32-2a4715b1daa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:42.237223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207c987-ffa0-465c-aa32-2a4715b1daa1 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:42.237503 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207c987-ffa0-465c-aa32-2a4715b1daa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:42.237776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207c987-ffa0-465c-aa32-2a4715b1daa1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:42.240541 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54643c0d-0b83-400f-8df0-71c4e31b1a05 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:42.242907 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:42.251790 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207c987-ffa0-465c-aa32-2a4715b1daa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:42.257400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-6207c987-ffa0-465c-aa32-2a4715b1daa1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:42:42.257400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:42.257400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:42.257400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:42.257400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:42.257400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:42.257400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:42.257400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:42.257400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:42.257400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:42.257400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:42.257400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:42.257400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:42.257400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:42.257400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:42.257400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:42.258315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:42.258315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:42.258315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:42.258315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:42.258315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:42.258315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:42.258315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:42.258315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:42.258315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:42.258315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:42.258315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:42.258315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:42.258315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:42.258315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:42.258315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:42.258315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:42.259155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:42.259155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:42.259155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:42.259155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:42.259155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:42.259155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:42.259155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:42.259155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:42.259155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:42.259155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:42.259155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:42:42.259155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:42.259155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 365/724] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:42:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:42:42.264997 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207c987-ffa0-465c-aa32-2a4715b1daa1 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:42.372556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207c987-ffa0-465c-aa32-2a4715b1daa1 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:42.430363 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54643c0d-0b83-400f-8df0-71c4e31b1a05 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:42.432552 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0ee5f-efb7-4866-8c7f-f8d47cb5a3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:42.433317 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0ee5f-efb7-4866-8c7f-f8d47cb5a3dc None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:42.433603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0ee5f-efb7-4866-8c7f-f8d47cb5a3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:42.433882 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0ee5f-efb7-4866-8c7f-f8d47cb5a3dc None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:42.434616 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0ee5f-efb7-4866-8c7f-f8d47cb5a3dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:42.434917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0ee5f-efb7-4866-8c7f-f8d47cb5a3dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:42.436406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0ee5f-efb7-4866-8c7f-f8d47cb5a3dc None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:42.455618 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 366/725] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:42:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:42.461890 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0ee5f-efb7-4866-8c7f-f8d47cb5a3dc None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:42.479789 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade57757-4601-4928-a9e8-6d34412b87e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:42.480481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade57757-4601-4928-a9e8-6d34412b87e7 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:42.480763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade57757-4601-4928-a9e8-6d34412b87e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:42.481041 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade57757-4601-4928-a9e8-6d34412b87e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:42.481666 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:42.510061 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade57757-4601-4928-a9e8-6d34412b87e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:42.515443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-ade57757-4601-4928-a9e8-6d34412b87e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:42.515443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:42.515443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:42.515443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:42.515443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:42.515443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:42.515443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:42.515443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:42.515443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:42.515443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:42.515443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:42.515443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:42.515443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:42.515443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:42.515443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:42.515443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:42.517653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:42.517653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:42.517653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:42.517653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:42.517653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:42.517653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:42.517653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:42.517653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:42.517653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:42.517653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:42.517653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:42.517653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:42.517653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:42.517653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:42.517653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:42.517653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:42.519667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:42.519667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:42.519667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:42.519667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:42.519667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:42.519667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:42.519667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:42.519667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:42.519667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:42.519667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:42.519667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:42.519667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:42.519667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 360/726] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:42:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:42:42.526429 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade57757-4601-4928-a9e8-6d34412b87e7 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:42.593908 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0ee5f-efb7-4866-8c7f-f8d47cb5a3dc None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:42.607209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:42.642421 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83e58a-be32-4a8c-8391-c2866f19fb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:42.643602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83e58a-be32-4a8c-8391-c2866f19fb7c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:42.644365 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83e58a-be32-4a8c-8391-c2866f19fb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:42.645112 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83e58a-be32-4a8c-8391-c2866f19fb7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:42.650461 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade57757-4601-4928-a9e8-6d34412b87e7 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:42.659310 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83e58a-be32-4a8c-8391-c2866f19fb7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:42.661592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83e58a-be32-4a8c-8391-c2866f19fb7c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:42.681640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-4b83e58a-be32-4a8c-8391-c2866f19fb7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:42.681640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:42.681640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:42.681640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:42.681640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:42.681640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:42.681640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:42.681640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:42.681640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:42.681640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:42.681640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:42.681640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:42.681640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:42.681640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:42.681640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:42.682574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:42.682574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:42.682574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:42.682574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:42.682574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:42.682574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:42.682574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:42.682574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:42.682574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:42.682574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:42.682574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:42.682574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:42.682574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:42.682574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:42.682574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:42.682574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:42.682574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:42.683469 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:42.683469 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:42.683469 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:42.683469 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:42.683469 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 367/727] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:42.684456 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545cbe0-3d29-40f2-9dc5-ec1b263dad25 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:42.684740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545cbe0-3d29-40f2-9dc5-ec1b263dad25 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:42.685012 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545cbe0-3d29-40f2-9dc5-ec1b263dad25 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:42.685209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0910e7-00d1-48dc-92c5-a20d2da729bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:42.685725 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0910e7-00d1-48dc-92c5-a20d2da729bb None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:42.686004 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0910e7-00d1-48dc-92c5-a20d2da729bb None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:42.690287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0910e7-00d1-48dc-92c5-a20d2da729bb None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:42.690412 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 368/728] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:42.690491 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0910e7-00d1-48dc-92c5-a20d2da729bb None admin] RBAC: Adding query filter params (name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:42.690491 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0910e7-00d1-48dc-92c5-a20d2da729bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:42.690617 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98f784-288f-4cae-b0c8-e0c91ac27fd0 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:42.690617 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98f784-288f-4cae-b0c8-e0c91ac27fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:42.690617 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98f784-288f-4cae-b0c8-e0c91ac27fd0 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:42.690810 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0910e7-00d1-48dc-92c5-a20d2da729bb None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:42.690878 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 369/729] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:42.690878 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98f784-288f-4cae-b0c8-e0c91ac27fd0 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:42.706202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 361/730] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Jul 28 17:42:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:42.708396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342e1f2-3dc1-4732-89fa-f4841860c5f8 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:42.708958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342e1f2-3dc1-4732-89fa-f4841860c5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:42.709664 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342e1f2-3dc1-4732-89fa-f4841860c5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:42.734730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-2342e1f2-3dc1-4732-89fa-f4841860c5f8 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:42.735947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-2342e1f2-3dc1-4732-89fa-f4841860c5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:42.775326 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:42.807776 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 362/731] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:42.809044 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899aa63-78b8-4023-b31e-2ccfd6aa3acc None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:42.809357 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899aa63-78b8-4023-b31e-2ccfd6aa3acc None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:42.809639 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899aa63-78b8-4023-b31e-2ccfd6aa3acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:42.813471 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98f784-288f-4cae-b0c8-e0c91ac27fd0 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:42.827250 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-e899aa63-78b8-4023-b31e-2ccfd6aa3acc None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:42.828442 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e899aa63-78b8-4023-b31e-2ccfd6aa3acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:42.848738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68efac-664c-4712-9b50-099dff64cb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:42.849535 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68efac-664c-4712-9b50-099dff64cb72 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:42.849812 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68efac-664c-4712-9b50-099dff64cb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:42.850079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68efac-664c-4712-9b50-099dff64cb72 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:42.850762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68efac-664c-4712-9b50-099dff64cb72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:42.851060 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68efac-664c-4712-9b50-099dff64cb72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:42.852440 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68efac-664c-4712-9b50-099dff64cb72 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:42.864943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 370/732] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:42.865764 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68efac-664c-4712-9b50-099dff64cb72 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:42.878812 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:42.898290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 363/733] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:42.900257 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6d276-6633-4e15-a137-f691c961acf7 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:42.900548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6d276-6633-4e15-a137-f691c961acf7 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:42.900830 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6d276-6633-4e15-a137-f691c961acf7 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:42.902145 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 364/734] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:42.902854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6d276-6633-4e15-a137-f691c961acf7 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:42.969780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68efac-664c-4712-9b50-099dff64cb72 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:42.997690 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:43.006031 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb0f9d-dffc-4210-ba05-7f07201bc9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:43.006684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb0f9d-dffc-4210-ba05-7f07201bc9ab None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:43.006960 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb0f9d-dffc-4210-ba05-7f07201bc9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:43.007239 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb0f9d-dffc-4210-ba05-7f07201bc9ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:43.010818 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6d276-6633-4e15-a137-f691c961acf7 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:43.020319 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb0f9d-dffc-4210-ba05-7f07201bc9ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:43.022123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb0f9d-dffc-4210-ba05-7f07201bc9ab None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:43.037740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-6acb0f9d-dffc-4210-ba05-7f07201bc9ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:43.037740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:43.037740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:43.037740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:43.037740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:43.037740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:43.037740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:43.037740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:43.037740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:43.037740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:43.037740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:43.037740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:43.037740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:43.037740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:43.037740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:43.038779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:43.038779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:43.038779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:43.038779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:43.038779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:43.038779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:43.038779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:43.038779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:43.038779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:43.038779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:43.038779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:43.038779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:43.038779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:43.038779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:43.038779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:43.038779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:43.038779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:43.039666 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:43.039666 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:43.039666 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:43.039666 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:43.039666 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 371/735] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:43.039954 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb0f9d-dffc-4210-ba05-7f07201bc9ab None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:43.058048 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497930ad-7b74-4d44-9519-c081e1847792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:43.058696 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497930ad-7b74-4d44-9519-c081e1847792 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:43.058971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497930ad-7b74-4d44-9519-c081e1847792 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:43.059222 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497930ad-7b74-4d44-9519-c081e1847792 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:43.070036 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497930ad-7b74-4d44-9519-c081e1847792 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:43.074979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-497930ad-7b74-4d44-9519-c081e1847792 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:42:43.074979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:43.074979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:43.074979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:43.074979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:43.074979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:43.074979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:43.074979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:43.074979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:43.074979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:43.074979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:43.074979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:43.074979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:43.074979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:43.074979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:43.074979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:43.075958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:43.075958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:43.075958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:43.075958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:43.075958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:43.075958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:43.075958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:43.075958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:43.075958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:43.075958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:43.075958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:43.075958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:43.075958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:43.075958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:43.075958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:43.075958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:43.076816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:43.076816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:43.076816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:43.076816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:43.076816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:43.076816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:43.076816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:43.076816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:43.076816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:43.076816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:43.076816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:42:43.076816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:43.076816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 365/736] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:42:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:43.077786 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbc241-1579-4639-b187-511634e04ec2 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:43.077786 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbc241-1579-4639-b187-511634e04ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:43.077919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbc241-1579-4639-b187-511634e04ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:43.096100 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-34cbc241-1579-4639-b187-511634e04ec2 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:43.097323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-34cbc241-1579-4639-b187-511634e04ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:43.135660 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:43.149676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb0f9d-dffc-4210-ba05-7f07201bc9ab None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:43.163588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 366/737] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:42:43.177257 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbc241-1579-4639-b187-511634e04ec2 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:43.185235 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face165a-7a7d-4d5d-bc77-e4bfecffe8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:43.185892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face165a-7a7d-4d5d-bc77-e4bfecffe8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:43.186158 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face165a-7a7d-4d5d-bc77-e4bfecffe8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:43.186428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face165a-7a7d-4d5d-bc77-e4bfecffe8a6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:43.194081 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face165a-7a7d-4d5d-bc77-e4bfecffe8a6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:43.195519 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face165a-7a7d-4d5d-bc77-e4bfecffe8a6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:43.206683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-face165a-7a7d-4d5d-bc77-e4bfecffe8a6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:42:43.206683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:43.206683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:43.206683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:43.206683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:43.206683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:43.206683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:43.206683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:43.206683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:43.206683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:43.206683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:43.206683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:43.206683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:43.206683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:43.206683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:43.206683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:43.207702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:43.207702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:43.207702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:43.207702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:43.207702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:43.207702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:43.207702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:43.207702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:43.207702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:43.207702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:43.207702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:43.207702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:43.207702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:43.207702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:43.207702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:43.207702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:43.207702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:43.207702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:43.208933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:43.208933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:43.208933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:43.208933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:43.208933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:43.208933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:43.208933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:43.208933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:43.208933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:42:43.208933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:43.208933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 372/738] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:42:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:43.208933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face165a-7a7d-4d5d-bc77-e4bfecffe8a6 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:43.252960 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:43.261908 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbc241-1579-4639-b187-511634e04ec2 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:43.294940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31260c90-1a25-4895-b59e-053e9dbd3216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:43.295542 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31260c90-1a25-4895-b59e-053e9dbd3216 None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:43.295825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31260c90-1a25-4895-b59e-053e9dbd3216 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:43.296098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31260c90-1a25-4895-b59e-053e9dbd3216 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:43.296790 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31260c90-1a25-4895-b59e-053e9dbd3216 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:43.298163 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31260c90-1a25-4895-b59e-053e9dbd3216 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:43.312984 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face165a-7a7d-4d5d-bc77-e4bfecffe8a6 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:43.314863 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 367/739] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Jul 28 17:42:43 2022] POST /identity/v3/services => generated 251 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:42:43.315682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31260c90-1a25-4895-b59e-053e9dbd3216 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:43.355723 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:43.374527 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cadcf-1073-44e2-a369-7fd6b8ccfb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:43.375165 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cadcf-1073-44e2-a369-7fd6b8ccfb36 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:43.375447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cadcf-1073-44e2-a369-7fd6b8ccfb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:43.375733 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cadcf-1073-44e2-a369-7fd6b8ccfb36 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:43.376439 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cadcf-1073-44e2-a369-7fd6b8ccfb36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:43.376744 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cadcf-1073-44e2-a369-7fd6b8ccfb36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:43.378226 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cadcf-1073-44e2-a369-7fd6b8ccfb36 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:43.392007 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 373/740] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:43.394377 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cadcf-1073-44e2-a369-7fd6b8ccfb36 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:43.435846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31260c90-1a25-4895-b59e-053e9dbd3216 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:43.481084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c02273-fd4a-4f2d-926c-5bfd5a488ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:43.481751 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c02273-fd4a-4f2d-926c-5bfd5a488ebd None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:43.482031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c02273-fd4a-4f2d-926c-5bfd5a488ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:43.482306 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c02273-fd4a-4f2d-926c-5bfd5a488ebd None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:43.483104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c02273-fd4a-4f2d-926c-5bfd5a488ebd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:43.483408 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c02273-fd4a-4f2d-926c-5bfd5a488ebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:43.484843 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c02273-fd4a-4f2d-926c-5bfd5a488ebd None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:43.494017 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 368/741] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:42:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:43.494670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c02273-fd4a-4f2d-926c-5bfd5a488ebd None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:43.515556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:43.524372 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cadcf-1073-44e2-a369-7fd6b8ccfb36 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:43.563038 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a66c3c-4de9-49ae-a88f-862b5f88f6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:43.563678 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a66c3c-4de9-49ae-a88f-862b5f88f6ed None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:43.563957 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a66c3c-4de9-49ae-a88f-862b5f88f6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:43.564230 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a66c3c-4de9-49ae-a88f-862b5f88f6ed None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:43.564977 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a66c3c-4de9-49ae-a88f-862b5f88f6ed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:43.566447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a66c3c-4de9-49ae-a88f-862b5f88f6ed None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:43.584380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 374/742] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Jul 28 17:42:43 2022] POST /identity/v3/services => generated 240 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:42:43.585545 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a66c3c-4de9-49ae-a88f-862b5f88f6ed None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:43.609172 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:43.617147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c02273-fd4a-4f2d-926c-5bfd5a488ebd None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:43.664721 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ee4e1-6ed7-4e34-985f-6075b7ecc7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:43.665609 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ee4e1-6ed7-4e34-985f-6075b7ecc7ee None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:43.665988 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ee4e1-6ed7-4e34-985f-6075b7ecc7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:43.666390 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ee4e1-6ed7-4e34-985f-6075b7ecc7ee None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:43.667317 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ee4e1-6ed7-4e34-985f-6075b7ecc7ee None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:43.667764 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ee4e1-6ed7-4e34-985f-6075b7ecc7ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:43.669603 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ee4e1-6ed7-4e34-985f-6075b7ecc7ee None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:43.697327 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 369/743] 10.222.0.96 () {56 vars in 1135 bytes} [Thu Jul 28 17:42:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:43.698508 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ee4e1-6ed7-4e34-985f-6075b7ecc7ee None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:43.733558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a66c3c-4de9-49ae-a88f-862b5f88f6ed None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:43.788050 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f7905-5870-4da9-a7d6-cba44c7217ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:43.788645 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f7905-5870-4da9-a7d6-cba44c7217ee None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:43.788935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f7905-5870-4da9-a7d6-cba44c7217ee None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:43.789272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f7905-5870-4da9-a7d6-cba44c7217ee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:43.800104 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f7905-5870-4da9-a7d6-cba44c7217ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:43.801214 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f7905-5870-4da9-a7d6-cba44c7217ee None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:43.814597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-609f7905-5870-4da9-a7d6-cba44c7217ee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:42:43.814597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:43.814597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:43.814597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:43.814597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:43.814597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:43.814597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:43.814597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:43.814597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:43.814597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:43.814597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:43.814597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:43.814597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:43.814597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:43.814597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:43.814597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:43.815570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:43.815570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:43.815570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:43.815570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:43.815570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:43.815570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:43.815570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:43.815570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:43.815570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:43.815570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:43.815570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:43.815570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:43.815570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:43.815570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:43.815570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:43.815570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:43.815570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:43.815570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:43.816497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:43.816497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:43.816497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:43.816497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:43.816497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:43.816497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:43.816497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:43.816497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:43.816497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:42:43.816497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:43.818988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 375/744] 10.222.0.96 () {56 vars in 1117 bytes} [Thu Jul 28 17:42:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:43.820062 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f7905-5870-4da9-a7d6-cba44c7217ee None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:43.840111 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ee4e1-6ed7-4e34-985f-6075b7ecc7ee None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:43.843795 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:43.885890 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8aad6-3017-4bb5-ab14-b64493b21fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:43.886875 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8aad6-3017-4bb5-ab14-b64493b21fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:43.887334 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8aad6-3017-4bb5-ab14-b64493b21fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:43.888325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8aad6-3017-4bb5-ab14-b64493b21fd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:43.900644 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8aad6-3017-4bb5-ab14-b64493b21fd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:43.903175 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8aad6-3017-4bb5-ab14-b64493b21fd7 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:43.919767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-bff8aad6-3017-4bb5-ab14-b64493b21fd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:43.919767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:43.919767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:43.919767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:43.919767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:43.919767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:43.919767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:43.919767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:43.919767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:43.919767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:43.919767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:43.919767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:43.919767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:43.919767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:43.919767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:43.920710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:43.920710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:43.920710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:43.920710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:43.920710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:43.920710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:43.920710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:43.920710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:43.920710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:43.920710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:43.920710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:43.920710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:43.920710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:43.920710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:43.920710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:43.920710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:43.920710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:43.921611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:43.921611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:43.921611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:43.921611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:43.923885 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 370/745] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:43.925087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8aad6-3017-4bb5-ab14-b64493b21fd7 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:43.928894 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:43.946405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f7905-5870-4da9-a7d6-cba44c7217ee None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:43.997452 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52669dc9-6815-4d6e-ac8d-e8af98fb7828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:43.999471 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52669dc9-6815-4d6e-ac8d-e8af98fb7828 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:43.999903 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52669dc9-6815-4d6e-ac8d-e8af98fb7828 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:44.000595 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52669dc9-6815-4d6e-ac8d-e8af98fb7828 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:44.043866 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8aad6-3017-4bb5-ab14-b64493b21fd7 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:44.087795 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e08e4-52cb-4ff6-88e2-f2be052e89c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:44.088760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e08e4-52cb-4ff6-88e2-f2be052e89c0 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:44.089372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e08e4-52cb-4ff6-88e2-f2be052e89c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:44.089795 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e08e4-52cb-4ff6-88e2-f2be052e89c0 None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:44.091345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e08e4-52cb-4ff6-88e2-f2be052e89c0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:44.091830 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e08e4-52cb-4ff6-88e2-f2be052e89c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:44.093692 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e08e4-52cb-4ff6-88e2-f2be052e89c0 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:44.097232 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52669dc9-6815-4d6e-ac8d-e8af98fb7828 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:44.098936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52669dc9-6815-4d6e-ac8d-e8af98fb7828 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:44.117088 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:44.118189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 371/746] 10.222.0.96 () {56 vars in 1149 bytes} [Thu Jul 28 17:42:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:44.119579 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e08e4-52cb-4ff6-88e2-f2be052e89c0 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:44.190242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:44.211616 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 376/747] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:42:44.211616 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52669dc9-6815-4d6e-ac8d-e8af98fb7828 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:44.240399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e08e4-52cb-4ff6-88e2-f2be052e89c0 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:44.276515 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55258b9-0781-4234-9c9a-6874f9f251e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:44.277456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55258b9-0781-4234-9c9a-6874f9f251e9 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:44.277880 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55258b9-0781-4234-9c9a-6874f9f251e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:44.278298 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55258b9-0781-4234-9c9a-6874f9f251e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:44.279142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55258b9-0781-4234-9c9a-6874f9f251e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:44.279691 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55258b9-0781-4234-9c9a-6874f9f251e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:44.281242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55258b9-0781-4234-9c9a-6874f9f251e9 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:44.294189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 372/748] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:44.295397 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55258b9-0781-4234-9c9a-6874f9f251e9 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:44.313165 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52669dc9-6815-4d6e-ac8d-e8af98fb7828 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:44.330469 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:44.350199 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cac98-2e28-47b9-8ff3-671a738aef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:44.350836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cac98-2e28-47b9-8ff3-671a738aef50 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:44.351111 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cac98-2e28-47b9-8ff3-671a738aef50 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:44.351380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cac98-2e28-47b9-8ff3-671a738aef50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:44.403665 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55258b9-0781-4234-9c9a-6874f9f251e9 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:44.423941 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cac98-2e28-47b9-8ff3-671a738aef50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:44.425297 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:44.425409 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cac98-2e28-47b9-8ff3-671a738aef50 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:44.441701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e2936-7bc9-48fc-9edb-0cc4487bdcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:44.442899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e2936-7bc9-48fc-9edb-0cc4487bdcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:44.443627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e2936-7bc9-48fc-9edb-0cc4487bdcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:44.444110 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e2936-7bc9-48fc-9edb-0cc4487bdcb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:44.455736 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e2936-7bc9-48fc-9edb-0cc4487bdcb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:44.457548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e2936-7bc9-48fc-9edb-0cc4487bdcb6 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:44.472844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-d44e2936-7bc9-48fc-9edb-0cc4487bdcb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:44.472844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:44.472844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:44.472844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:44.472844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:44.472844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:44.472844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:44.472844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:44.472844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:44.472844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:44.472844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:44.472844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:44.472844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:44.472844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:44.472844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:44.474209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:44.474209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:44.474209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:44.474209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:44.474209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:44.474209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:44.474209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:44.474209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:44.474209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:44.474209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:44.474209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:44.474209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:44.474209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:44.474209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:44.474209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:44.474209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:44.474209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:44.475334 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:44.475334 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:44.475334 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:44.475334 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:44.482006 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 373/749] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:44.483351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e2936-7bc9-48fc-9edb-0cc4487bdcb6 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:44.535442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 377/750] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:44 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:42:44.536568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cac98-2e28-47b9-8ff3-671a738aef50 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:44.554732 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:44.591421 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e2936-7bc9-48fc-9edb-0cc4487bdcb6 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:44.626803 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13b8b5-19c8-40c5-ac41-1824342f75d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:44.627613 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13b8b5-19c8-40c5-ac41-1824342f75d2 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:44.627989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13b8b5-19c8-40c5-ac41-1824342f75d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:44.628363 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13b8b5-19c8-40c5-ac41-1824342f75d2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:44.637090 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13b8b5-19c8-40c5-ac41-1824342f75d2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:44.638870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13b8b5-19c8-40c5-ac41-1824342f75d2 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:44.643504 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cac98-2e28-47b9-8ff3-671a738aef50 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:44.651265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-bf13b8b5-19c8-40c5-ac41-1824342f75d2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:42:44.651265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:44.651265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:44.651265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:44.651265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:44.651265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:44.651265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:44.651265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:44.651265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:44.651265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:44.651265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:44.651265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:44.651265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:44.651265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:44.651265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:44.651265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:44.652208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:44.652208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:44.652208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:44.652208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:44.652208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:44.652208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:44.652208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:44.652208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:44.652208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:44.652208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:44.652208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:44.652208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:44.652208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:44.652208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:44.652208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:44.652208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:44.652208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:44.652208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:44.653302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:44.653302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:44.653302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:44.653302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:44.653302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:44.653302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:44.653302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:44.653302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:44.653302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:42:44.653302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:44.653302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 374/751] 10.222.0.96 () {56 vars in 1093 bytes} [Thu Jul 28 17:42:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:44.654360 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13b8b5-19c8-40c5-ac41-1824342f75d2 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:44.684003 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a8e6b-47be-455f-9c63-9326f54b1820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:44.684977 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a8e6b-47be-455f-9c63-9326f54b1820 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:44.685540 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a8e6b-47be-455f-9c63-9326f54b1820 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:44.685981 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a8e6b-47be-455f-9c63-9326f54b1820 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:44.686864 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a8e6b-47be-455f-9c63-9326f54b1820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:44.687334 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a8e6b-47be-455f-9c63-9326f54b1820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:44.687843 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:44.689289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a8e6b-47be-455f-9c63-9326f54b1820 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:44.702256 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 378/752] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:44.703538 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a8e6b-47be-455f-9c63-9326f54b1820 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:44.767394 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13b8b5-19c8-40c5-ac41-1824342f75d2 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:44.786586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:44.807194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c140a-a6bf-4358-bce7-1cab92db3ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:44.808314 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c140a-a6bf-4358-bce7-1cab92db3ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:44.808893 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c140a-a6bf-4358-bce7-1cab92db3ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:44.809335 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c140a-a6bf-4358-bce7-1cab92db3ed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:44.815090 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a8e6b-47be-455f-9c63-9326f54b1820 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:44.821534 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c140a-a6bf-4358-bce7-1cab92db3ed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:44.823087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c140a-a6bf-4358-bce7-1cab92db3ed1 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:44.838687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-e97c140a-a6bf-4358-bce7-1cab92db3ed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:44.838687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:44.838687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:44.838687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:44.838687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:44.838687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:44.838687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:44.838687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:44.838687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:44.838687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:44.838687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:44.838687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:44.838687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:44.838687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:44.838687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:44.839763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:44.839763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:44.839763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:44.839763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:44.839763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:44.839763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:44.839763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:44.839763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:44.839763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:44.839763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:44.839763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:44.839763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:44.839763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:44.839763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:44.839763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:44.839763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:44.839763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:44.841045 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:44.841045 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:44.841045 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:44.841045 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:44.841045 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 375/753] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:44.841629 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c140a-a6bf-4358-bce7-1cab92db3ed1 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:44.855917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532de93a-ac7d-4aee-a986-6e6b698ab6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:44.856963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532de93a-ac7d-4aee-a986-6e6b698ab6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:44.857449 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532de93a-ac7d-4aee-a986-6e6b698ab6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:44.857911 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532de93a-ac7d-4aee-a986-6e6b698ab6b4 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:44.858901 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532de93a-ac7d-4aee-a986-6e6b698ab6b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:44.859400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532de93a-ac7d-4aee-a986-6e6b698ab6b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:44.861156 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532de93a-ac7d-4aee-a986-6e6b698ab6b4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:44.880267 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 379/754] 10.222.0.96 () {56 vars in 1133 bytes} [Thu Jul 28 17:42:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:44.881587 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532de93a-ac7d-4aee-a986-6e6b698ab6b4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:44.932441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:44.949888 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c140a-a6bf-4358-bce7-1cab92db3ed1 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:44.985693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b64fbe-4a2b-4a55-a647-b5db53777aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:44.986339 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b64fbe-4a2b-4a55-a647-b5db53777aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:44.986620 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b64fbe-4a2b-4a55-a647-b5db53777aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:44.986894 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b64fbe-4a2b-4a55-a647-b5db53777aa8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:44.989130 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532de93a-ac7d-4aee-a986-6e6b698ab6b4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:44.994303 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b64fbe-4a2b-4a55-a647-b5db53777aa8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:44.995767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b64fbe-4a2b-4a55-a647-b5db53777aa8 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:45.007993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-88b64fbe-4a2b-4a55-a647-b5db53777aa8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:45.007993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:45.007993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:45.007993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:45.007993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:45.007993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:45.007993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:45.007993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:45.007993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:45.007993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:45.007993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:45.007993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:45.007993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:45.007993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:45.007993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:45.008916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:45.008916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:45.008916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:45.008916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:45.008916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:45.008916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:45.008916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:45.008916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:45.008916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:45.008916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:45.008916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:45.008916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:45.008916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:45.008916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:45.008916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:45.008916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:45.008916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:45.010226 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:45.010226 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:45.010226 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:45.010226 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:45.010226 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:45.010226 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:45.010226 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:45.010226 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:45.010226 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 376/755] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:45.014905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b64fbe-4a2b-4a55-a647-b5db53777aa8 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:45.040505 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4e7c5-6910-4753-a16d-93f57ec29e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:45.041842 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4e7c5-6910-4753-a16d-93f57ec29e87 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:45.042496 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4e7c5-6910-4753-a16d-93f57ec29e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:45.043013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4e7c5-6910-4753-a16d-93f57ec29e87 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:45.043898 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4e7c5-6910-4753-a16d-93f57ec29e87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:45.044419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4e7c5-6910-4753-a16d-93f57ec29e87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:45.046083 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4e7c5-6910-4753-a16d-93f57ec29e87 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:45.047912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:45.061518 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 380/756] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:45.062849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4e7c5-6910-4753-a16d-93f57ec29e87 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:45.123406 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b64fbe-4a2b-4a55-a647-b5db53777aa8 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:45.159746 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb6e35-6864-49a6-afbf-b399589c3538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:45.160409 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb6e35-6864-49a6-afbf-b399589c3538 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:45.160696 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb6e35-6864-49a6-afbf-b399589c3538 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:45.160968 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb6e35-6864-49a6-afbf-b399589c3538 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:45.172497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4e7c5-6910-4753-a16d-93f57ec29e87 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:45.172702 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb6e35-6864-49a6-afbf-b399589c3538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:45.174116 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb6e35-6864-49a6-afbf-b399589c3538 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:45.176825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:45.190737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-24eb6e35-6864-49a6-afbf-b399589c3538 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:45.190737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:45.190737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:45.190737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:45.190737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:45.190737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:45.190737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:45.190737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:45.190737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:45.190737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:45.190737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:45.190737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:45.190737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:45.190737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:45.190737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:45.191682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:45.191682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:45.191682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:45.191682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:45.191682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:45.191682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:45.191682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:45.191682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:45.191682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:45.191682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:45.191682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:45.191682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:45.191682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:45.191682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:45.191682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:45.191682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:45.191682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:45.193363 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:45.193363 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:45.193363 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:45.193363 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:45.193363 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 377/757] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:45.193363 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb6e35-6864-49a6-afbf-b399589c3538 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:45.213853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e0c66-071d-4da4-9877-6debb8e3ec90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:45.214909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e0c66-071d-4da4-9877-6debb8e3ec90 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:45.215382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e0c66-071d-4da4-9877-6debb8e3ec90 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:45.215913 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e0c66-071d-4da4-9877-6debb8e3ec90 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:45.216863 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e0c66-071d-4da4-9877-6debb8e3ec90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:45.217413 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e0c66-071d-4da4-9877-6debb8e3ec90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:45.219098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e0c66-071d-4da4-9877-6debb8e3ec90 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:45.232918 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 381/758] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:45.234162 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e0c66-071d-4da4-9877-6debb8e3ec90 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:45.294091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:45.305645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb6e35-6864-49a6-afbf-b399589c3538 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:45.341931 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea9ee3-31fd-42a8-8383-5049ae684e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:45.342501 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea9ee3-31fd-42a8-8383-5049ae684e6a None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:45.342783 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea9ee3-31fd-42a8-8383-5049ae684e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:45.343059 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea9ee3-31fd-42a8-8383-5049ae684e6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:45.344821 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e0c66-071d-4da4-9877-6debb8e3ec90 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:45.350823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea9ee3-31fd-42a8-8383-5049ae684e6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:45.352301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea9ee3-31fd-42a8-8383-5049ae684e6a None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:45.364388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-beea9ee3-31fd-42a8-8383-5049ae684e6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:45.364388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:45.364388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:45.364388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:45.364388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:45.364388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:45.364388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:45.364388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:45.364388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:45.364388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:45.364388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:45.364388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:45.364388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:45.364388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:45.364388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:45.365356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:45.365356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:45.365356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:45.365356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:45.365356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:45.365356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:45.365356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:45.365356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:45.365356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:45.365356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:45.365356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:45.365356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:45.365356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:45.365356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:45.365356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:45.365356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:45.365356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:45.366241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:45.366241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:45.366241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:45.366241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:45.366241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:45.366241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:45.366241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:45.366241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:45.366241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 378/759] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:45.366715 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea9ee3-31fd-42a8-8383-5049ae684e6a None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:45.387996 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf4c2c-6955-4807-a14b-b317e76d72d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:45.389218 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf4c2c-6955-4807-a14b-b317e76d72d7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:45.389758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf4c2c-6955-4807-a14b-b317e76d72d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:45.390215 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf4c2c-6955-4807-a14b-b317e76d72d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:45.391222 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf4c2c-6955-4807-a14b-b317e76d72d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:45.391735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf4c2c-6955-4807-a14b-b317e76d72d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:45.393457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf4c2c-6955-4807-a14b-b317e76d72d7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:45.406819 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 382/760] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:45.408039 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf4c2c-6955-4807-a14b-b317e76d72d7 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:45.430160 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:45.483582 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea9ee3-31fd-42a8-8383-5049ae684e6a None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:45.520637 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf4c2c-6955-4807-a14b-b317e76d72d7 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:45.521929 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a576062-519c-4c12-9fb8-5a72cba94b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:45.522556 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a576062-519c-4c12-9fb8-5a72cba94b6c None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:45.522837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a576062-519c-4c12-9fb8-5a72cba94b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:45.523839 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a576062-519c-4c12-9fb8-5a72cba94b6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:45.523947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a576062-519c-4c12-9fb8-5a72cba94b6c None admin] RBAC: Adding query filter params (role.id=980cae90acae42189f92fd6dd42867a5, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=4ea1a9023eaf427f96f86af909a803fd) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:45.524204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a576062-519c-4c12-9fb8-5a72cba94b6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:45.525679 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a576062-519c-4c12-9fb8-5a72cba94b6c None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:45.531771 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 379/761] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:42:45 2022] GET /identity/v3/role_assignments?user.id=4ea1a9023eaf427f96f86af909a803fd&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=980cae90acae42189f92fd6dd42867a5 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:45.532371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a576062-519c-4c12-9fb8-5a72cba94b6c None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:45.553681 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:45.571004 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233f420-1034-4f48-b8cd-32fec593e402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:45.571638 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233f420-1034-4f48-b8cd-32fec593e402 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:45.571934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233f420-1034-4f48-b8cd-32fec593e402 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:45.572186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233f420-1034-4f48-b8cd-32fec593e402 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:45.573011 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233f420-1034-4f48-b8cd-32fec593e402 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:45.573352 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233f420-1034-4f48-b8cd-32fec593e402 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:45.574817 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233f420-1034-4f48-b8cd-32fec593e402 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:45.593609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 383/762] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:45.595075 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0b3fd-15df-41cd-bd04-f5162ce9c5fb None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:45.595365 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0b3fd-15df-41cd-bd04-f5162ce9c5fb None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:45.595643 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0b3fd-15df-41cd-bd04-f5162ce9c5fb None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:45.598020 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 384/763] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:45.599409 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0b3fd-15df-41cd-bd04-f5162ce9c5fb None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:45.684875 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a576062-519c-4c12-9fb8-5a72cba94b6c None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:45.713668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:45.723769 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0b3fd-15df-41cd-bd04-f5162ce9c5fb None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:45.730003 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70299ca-7dff-4069-8eef-d4d7224b4b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:45.730649 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70299ca-7dff-4069-8eef-d4d7224b4b2d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:45.730929 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70299ca-7dff-4069-8eef-d4d7224b4b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:45.731204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70299ca-7dff-4069-8eef-d4d7224b4b2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:45.738243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70299ca-7dff-4069-8eef-d4d7224b4b2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:45.739792 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70299ca-7dff-4069-8eef-d4d7224b4b2d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:45.751554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-f70299ca-7dff-4069-8eef-d4d7224b4b2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:45.751554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:45.751554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:45.751554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:45.751554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:45.751554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:45.751554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:45.751554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:45.751554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:45.751554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:45.751554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:45.751554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:45.751554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:45.751554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:45.751554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:45.752465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:45.752465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:45.752465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:45.752465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:45.752465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:45.752465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:45.752465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:45.752465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:45.752465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:45.752465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:45.752465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:45.752465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:45.752465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:45.752465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:45.752465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:45.752465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:45.752465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:45.753379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:45.753379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:45.753379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:45.753379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:45.753379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:45.753379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:45.753379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:45.753379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:45.757643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 380/764] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:45.758937 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd396bb-8667-4e20-9094-dae20b744f1f None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:45.759219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd396bb-8667-4e20-9094-dae20b744f1f None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:45.759487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd396bb-8667-4e20-9094-dae20b744f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:45.762433 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0116a57-2d99-441b-8439-0e1a7e1573d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:45.763428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0116a57-2d99-441b-8439-0e1a7e1573d3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:45.763673 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0116a57-2d99-441b-8439-0e1a7e1573d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:45.763949 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0116a57-2d99-441b-8439-0e1a7e1573d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:45.764795 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0116a57-2d99-441b-8439-0e1a7e1573d3 None admin] RBAC: Adding query filter params (role.id=f8cbbf969cfc442595755799825094f6, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=a1936a2649c349d481f56304b3ee55b3) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:45.765134 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0116a57-2d99-441b-8439-0e1a7e1573d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:45.766572 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0116a57-2d99-441b-8439-0e1a7e1573d3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:45.781088 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 385/765] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:42:45 2022] GET /identity/v3/role_assignments?user.id=a1936a2649c349d481f56304b3ee55b3&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=f8cbbf969cfc442595755799825094f6 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:45.781088 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61045826-09fa-428b-b38d-316c84e343cc None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:45.781088 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61045826-09fa-428b-b38d-316c84e343cc None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:45.781088 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61045826-09fa-428b-b38d-316c84e343cc None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:45.781088 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 386/766] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:45.781088 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61045826-09fa-428b-b38d-316c84e343cc None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:45.787385 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-3cd396bb-8667-4e20-9094-dae20b744f1f None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:45.788838 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-3cd396bb-8667-4e20-9094-dae20b744f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:45.847859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:45.877095 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 381/767] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:42:45.877095 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7071057-0a3f-4282-8ba0-db21c48490db None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:45.877095 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7071057-0a3f-4282-8ba0-db21c48490db None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:45.877095 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7071057-0a3f-4282-8ba0-db21c48490db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:45.895819 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-b7071057-0a3f-4282-8ba0-db21c48490db None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:45.897627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b7071057-0a3f-4282-8ba0-db21c48490db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:45.971118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61045826-09fa-428b-b38d-316c84e343cc None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:45.997091 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 382/768] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:42:45.998678 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7071057-0a3f-4282-8ba0-db21c48490db None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:46.019157 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85f505-f5a4-4cfc-a46b-96b54387eec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:46.020342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85f505-f5a4-4cfc-a46b-96b54387eec7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:46.020342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85f505-f5a4-4cfc-a46b-96b54387eec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:46.020342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85f505-f5a4-4cfc-a46b-96b54387eec7 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:46.021361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85f505-f5a4-4cfc-a46b-96b54387eec7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:46.021776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85f505-f5a4-4cfc-a46b-96b54387eec7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:46.028631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85f505-f5a4-4cfc-a46b-96b54387eec7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:46.042258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 387/769] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:46.046469 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85f505-f5a4-4cfc-a46b-96b54387eec7 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:46.055556 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:46.117120 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7071057-0a3f-4282-8ba0-db21c48490db None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:46.152758 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02b2cf-7129-4c39-9f46-43d4bde308a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:46.153441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02b2cf-7129-4c39-9f46-43d4bde308a1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:46.153727 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02b2cf-7129-4c39-9f46-43d4bde308a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:46.154006 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02b2cf-7129-4c39-9f46-43d4bde308a1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:46.154643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02b2cf-7129-4c39-9f46-43d4bde308a1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:46.156035 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02b2cf-7129-4c39-9f46-43d4bde308a1 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:46.158623 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:46.163369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85f505-f5a4-4cfc-a46b-96b54387eec7 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:46.166286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-6a02b2cf-7129-4c39-9f46-43d4bde308a1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:42:46.166286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:46.166286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:42:46.166286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:42:46.166286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:42:46.166286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:42:46.166286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:42:46.166286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:42:46.166286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:42:46.166286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:46.166286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:42:46.166286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:46.166286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:46.166286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:46.166286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:46.166286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:46.167358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:46.167358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:46.167358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:46.167358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:46.167358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:46.167358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:46.167358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:46.167358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:42:46.167358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:42:46.167358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:42:46.167358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:42:46.167358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:46.167358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:46.167358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:46.167358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:46.167358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:46.168343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:46.168343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:46.168343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:46.168343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:46.168343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:46.168343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:46.168343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:46.168343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:46.168343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:46.168343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:46.168343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:46.168343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:42:46.168343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:42:46.168343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:42:46.168343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:46.172802 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 383/770] 10.222.0.96 () {56 vars in 1129 bytes} [Thu Jul 28 17:42:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:46.173662 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02b2cf-7129-4c39-9f46-43d4bde308a1 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:46.204177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e49a0a-d83e-4eb3-83b2-571e218643be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:46.205144 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e49a0a-d83e-4eb3-83b2-571e218643be None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:46.205612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e49a0a-d83e-4eb3-83b2-571e218643be None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:46.206056 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e49a0a-d83e-4eb3-83b2-571e218643be None admin] PATH_INFO: `/v3/services/network` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:46.206949 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e49a0a-d83e-4eb3-83b2-571e218643be None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:46.208609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e49a0a-d83e-4eb3-83b2-571e218643be None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:46.219197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-68e49a0a-d83e-4eb3-83b2-571e218643be None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:42:46.219197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:46.219197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:42:46.219197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:42:46.219197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:42:46.219197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:42:46.219197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:42:46.219197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:42:46.219197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:42:46.219197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:46.219197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:42:46.219197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:46.219197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:46.219197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:46.219197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:46.219197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:46.219197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:46.220428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:46.220428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:46.220428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:46.220428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:46.220428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:46.220428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:46.220428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:42:46.220428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:42:46.220428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:42:46.220428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:42:46.220428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:46.220428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:46.220428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:46.220428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:46.220428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:46.220428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:46.221388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:46.221388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:46.221388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:46.221388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:46.221388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:46.221388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:46.221388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:46.221388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:46.221388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:46.221388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:46.221388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:42:46.221388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:42:46.221388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:42:46.221388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:46.223969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 388/771] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:46 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:46.225004 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e49a0a-d83e-4eb3-83b2-571e218643be None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:46.279071 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02b2cf-7129-4c39-9f46-43d4bde308a1 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:46.281779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:46.323456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a8a3e-53ee-4a87-92c6-8c59694c556e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:46.324195 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a8a3e-53ee-4a87-92c6-8c59694c556e None admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:46.324551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a8a3e-53ee-4a87-92c6-8c59694c556e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:46.325098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a8a3e-53ee-4a87-92c6-8c59694c556e None admin] PATH_INFO: `/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/5ac367247aa54671ae5c33d251017470/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:46.327838 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a8a3e-53ee-4a87-92c6-8c59694c556e None admin] RBAC: Authorizing `identity:create_grant(project_id=db5ce5e789e949d09c183dbe04e53f19, user_id=5ac367247aa54671ae5c33d251017470, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:46.329877 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a8a3e-53ee-4a87-92c6-8c59694c556e None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:46.336996 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e49a0a-d83e-4eb3-83b2-571e218643be None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:46.348797 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 384/772] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:42:46 2022] PUT /identity/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/5ac367247aa54671ae5c33d251017470/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:42:46.349987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a8a3e-53ee-4a87-92c6-8c59694c556e None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:46.406035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf7fd6-43d1-4fa1-90e7-0615384e5d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:46.407018 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf7fd6-43d1-4fa1-90e7-0615384e5d47 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:46.407448 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf7fd6-43d1-4fa1-90e7-0615384e5d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:46.407922 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf7fd6-43d1-4fa1-90e7-0615384e5d47 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:46.409528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf7fd6-43d1-4fa1-90e7-0615384e5d47 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:46.410053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf7fd6-43d1-4fa1-90e7-0615384e5d47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:46.412025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf7fd6-43d1-4fa1-90e7-0615384e5d47 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:46.419031 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 389/773] 10.222.0.96 () {56 vars in 1124 bytes} [Thu Jul 28 17:42:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:46.426128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf7fd6-43d1-4fa1-90e7-0615384e5d47 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:46.463123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:46.556081 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf7fd6-43d1-4fa1-90e7-0615384e5d47 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:46.570725 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a8a3e-53ee-4a87-92c6-8c59694c556e None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:46.597479 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1c817-02f1-4dc3-a92d-86893c15e4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:46.598108 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1c817-02f1-4dc3-a92d-86893c15e4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:46.598385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1c817-02f1-4dc3-a92d-86893c15e4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:46.598708 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1c817-02f1-4dc3-a92d-86893c15e4f6 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:46.599581 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1c817-02f1-4dc3-a92d-86893c15e4f6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:46.599784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1c817-02f1-4dc3-a92d-86893c15e4f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:46.601252 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1c817-02f1-4dc3-a92d-86893c15e4f6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:46.606917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 390/774] 10.222.0.96 () {56 vars in 1124 bytes} [Thu Jul 28 17:42:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:46.616817 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1c817-02f1-4dc3-a92d-86893c15e4f6 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:46.623136 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496c95b-55b1-4405-a986-4d2216bc71d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:46.624000 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496c95b-55b1-4405-a986-4d2216bc71d1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:46.624429 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496c95b-55b1-4405-a986-4d2216bc71d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:46.624849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496c95b-55b1-4405-a986-4d2216bc71d1 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:46.626240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496c95b-55b1-4405-a986-4d2216bc71d1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:46.626694 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496c95b-55b1-4405-a986-4d2216bc71d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:46.628841 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496c95b-55b1-4405-a986-4d2216bc71d1 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:46.636431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 385/775] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Jul 28 17:42:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:46.642067 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496c95b-55b1-4405-a986-4d2216bc71d1 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:46.713053 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:46.795301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:46.806903 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1c817-02f1-4dc3-a92d-86893c15e4f6 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:46.842652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e3639-7e38-4fc7-8fdd-2ab67d6dadc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:46.843376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e3639-7e38-4fc7-8fdd-2ab67d6dadc2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:46.843729 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e3639-7e38-4fc7-8fdd-2ab67d6dadc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:46.844067 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e3639-7e38-4fc7-8fdd-2ab67d6dadc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:46.844951 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e3639-7e38-4fc7-8fdd-2ab67d6dadc2 None admin] RBAC: Adding query filter params (interface=public, service_id=54d97e16427a4b79be5d3436413667c7, region_id=RegionOne) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:46.845348 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e3639-7e38-4fc7-8fdd-2ab67d6dadc2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:46.846859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e3639-7e38-4fc7-8fdd-2ab67d6dadc2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:46.848096 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496c95b-55b1-4405-a986-4d2216bc71d1 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:46.855575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 391/776] 10.222.0.96 () {56 vars in 1251 bytes} [Thu Jul 28 17:42:46 2022] GET /identity/v3/endpoints?service_id=54d97e16427a4b79be5d3436413667c7&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:46.860985 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e3639-7e38-4fc7-8fdd-2ab67d6dadc2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:46.892663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ee176-a6c8-4d48-821c-d8aade34fcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:46.893590 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ee176-a6c8-4d48-821c-d8aade34fcc1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:46.894003 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ee176-a6c8-4d48-821c-d8aade34fcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:46.894428 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ee176-a6c8-4d48-821c-d8aade34fcc1 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:46.895267 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ee176-a6c8-4d48-821c-d8aade34fcc1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:46.898344 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ee176-a6c8-4d48-821c-d8aade34fcc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:46.899875 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ee176-a6c8-4d48-821c-d8aade34fcc1 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:46.915604 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 386/777] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Jul 28 17:42:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:46.918090 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ee176-a6c8-4d48-821c-d8aade34fcc1 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:47.050496 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e3639-7e38-4fc7-8fdd-2ab67d6dadc2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:47.103688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:47.123098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ee176-a6c8-4d48-821c-d8aade34fcc1 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:47.127276 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bb4ca-b120-4e99-8daa-a91e013cfa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:47.127924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bb4ca-b120-4e99-8daa-a91e013cfa1e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:47.128198 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bb4ca-b120-4e99-8daa-a91e013cfa1e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:47.128467 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bb4ca-b120-4e99-8daa-a91e013cfa1e None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:47.129168 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bb4ca-b120-4e99-8daa-a91e013cfa1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:47.130775 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bb4ca-b120-4e99-8daa-a91e013cfa1e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:47.142475 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 392/778] 10.222.0.96 () {56 vars in 1087 bytes} [Thu Jul 28 17:42:46 2022] GET /identity/v3/services => generated 772 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:47.187151 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf972f-5e2f-40bb-addb-e517ac9a93b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:47.187789 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf972f-5e2f-40bb-addb-e517ac9a93b1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:47.188064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf972f-5e2f-40bb-addb-e517ac9a93b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:47.188338 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf972f-5e2f-40bb-addb-e517ac9a93b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:47.189121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf972f-5e2f-40bb-addb-e517ac9a93b1 None admin] RBAC: Adding query filter params (interface=public, service_id=70681afcc0b54f4ebd67c21670a95208, region_id=RegionOne) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:47.189427 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf972f-5e2f-40bb-addb-e517ac9a93b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:47.190907 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf972f-5e2f-40bb-addb-e517ac9a93b1 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:47.204339 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 387/779] 10.222.0.96 () {56 vars in 1251 bytes} [Thu Jul 28 17:42:46 2022] GET /identity/v3/endpoints?service_id=70681afcc0b54f4ebd67c21670a95208&interface=public®ion_id=RegionOne => generated 194 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:47.210246 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bb4ca-b120-4e99-8daa-a91e013cfa1e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:47.237533 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:47.331483 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bb4ca-b120-4e99-8daa-a91e013cfa1e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:47.366324 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5fd97-728c-4788-b71d-5dac7739683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:47.366946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5fd97-728c-4788-b71d-5dac7739683b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:47.367221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5fd97-728c-4788-b71d-5dac7739683b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:47.367489 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5fd97-728c-4788-b71d-5dac7739683b None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:47.368135 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5fd97-728c-4788-b71d-5dac7739683b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:47.369533 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5fd97-728c-4788-b71d-5dac7739683b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:47.375221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 393/780] 10.222.0.96 () {56 vars in 1087 bytes} [Thu Jul 28 17:42:47 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:47.756655 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb34445-fbb7-42c2-bc31-dc8d4e17e770 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:47.757121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb34445-fbb7-42c2-bc31-dc8d4e17e770 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:47.757298 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb34445-fbb7-42c2-bc31-dc8d4e17e770 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:47.758804 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 388/781] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:47.765439 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86f7c6-ced5-4cb4-9d3a-a52b661994ae None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:47.765725 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86f7c6-ced5-4cb4-9d3a-a52b661994ae None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:47.766011 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86f7c6-ced5-4cb4-9d3a-a52b661994ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:47.785848 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7e86f7c6-ced5-4cb4-9d3a-a52b661994ae None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:47.787628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7e86f7c6-ced5-4cb4-9d3a-a52b661994ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:47.857218 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 394/782] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:42:47.879635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb34445-fbb7-42c2-bc31-dc8d4e17e770 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:48.009111 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb34445-fbb7-42c2-bc31-dc8d4e17e770 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:48.054549 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ce72e-eb82-4f9f-9a81-c021e06a87ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:48.055244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ce72e-eb82-4f9f-9a81-c021e06a87ca None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:48.055523 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ce72e-eb82-4f9f-9a81-c021e06a87ca None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:48.055794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ce72e-eb82-4f9f-9a81-c021e06a87ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:48.070498 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ce72e-eb82-4f9f-9a81-c021e06a87ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:48.075458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-b65ce72e-eb82-4f9f-9a81-c021e06a87ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:42:48.075458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:48.075458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:48.075458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:48.075458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:48.075458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:48.075458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:48.075458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:48.075458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:48.075458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:48.075458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:48.075458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:48.075458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:48.075458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:48.075458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:48.075458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:48.076374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:48.076374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:48.076374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:48.076374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:48.076374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:48.076374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:48.076374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:48.076374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:48.076374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:48.076374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:48.076374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:48.076374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:48.076374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:48.076374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:48.076374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:48.076374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:48.077235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:48.077235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:48.077235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:48.077235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:48.077235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:48.077235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:48.077235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:48.077235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:48.077235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:48.077235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:48.077235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:42:48.077235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:48.077235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 389/783] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:42:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:48.083046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86f7c6-ced5-4cb4-9d3a-a52b661994ae None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:48.101434 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:48.185097 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86f7c6-ced5-4cb4-9d3a-a52b661994ae None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:48.220150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b0d54-3812-486d-a81f-dd4a94bad488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:48.220780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0d54-3812-486d-a81f-dd4a94bad488 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:48.221054 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0d54-3812-486d-a81f-dd4a94bad488 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:48.221348 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0d54-3812-486d-a81f-dd4a94bad488 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:48.222070 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b0d54-3812-486d-a81f-dd4a94bad488 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:48.222431 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b0d54-3812-486d-a81f-dd4a94bad488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:48.224087 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b0d54-3812-486d-a81f-dd4a94bad488 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:48.233144 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 395/784] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:42:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:48.238842 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ce72e-eb82-4f9f-9a81-c021e06a87ca None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:48.265410 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:48.325975 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45124cab-80a6-4860-8203-c4d6f57926ab None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:48.326625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45124cab-80a6-4860-8203-c4d6f57926ab None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:48.326970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45124cab-80a6-4860-8203-c4d6f57926ab None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:48.328665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 396/785] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:48.334378 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ae2da-2d26-4686-9b2a-82fb4a7a65ec None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:48.334808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ae2da-2d26-4686-9b2a-82fb4a7a65ec None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:48.335164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ae2da-2d26-4686-9b2a-82fb4a7a65ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:48.358125 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ce72e-eb82-4f9f-9a81-c021e06a87ca None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:48.373323 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-ec6ae2da-2d26-4686-9b2a-82fb4a7a65ec None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:48.374617 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ec6ae2da-2d26-4686-9b2a-82fb4a7a65ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:48.402061 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c2e4c-ccfb-44db-95ae-7bb1ebed9db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:48.403029 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c2e4c-ccfb-44db-95ae-7bb1ebed9db5 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:48.405189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c2e4c-ccfb-44db-95ae-7bb1ebed9db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:48.405639 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c2e4c-ccfb-44db-95ae-7bb1ebed9db5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:48.428725 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c2e4c-ccfb-44db-95ae-7bb1ebed9db5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:48.433085 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c2e4c-ccfb-44db-95ae-7bb1ebed9db5 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:48.463718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-030c2e4c-ccfb-44db-95ae-7bb1ebed9db5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:48.463718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:48.463718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:48.463718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:48.463718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:48.463718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:48.463718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:48.463718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:48.463718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:48.463718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:48.463718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:48.463718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:48.463718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:48.463718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:48.463718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:48.464865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:48.464865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:48.464865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:48.464865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:48.464865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:48.464865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:48.464865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:48.464865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:48.464865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:48.464865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:48.464865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:48.464865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:48.464865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:48.464865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:48.464865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:48.464865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:48.464865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:48.465804 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:48.465804 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:48.465804 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:48.465804 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:48.465804 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 390/786] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:48.472848 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c2e4c-ccfb-44db-95ae-7bb1ebed9db5 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:48.491309 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 397/787] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:42:48.530713 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ae2da-2d26-4686-9b2a-82fb4a7a65ec None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:48.533892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:48.568112 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:48.630521 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c2e4c-ccfb-44db-95ae-7bb1ebed9db5 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:48.678174 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396b68e-fbef-44d5-b21c-0fa77e91b1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:48.679227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396b68e-fbef-44d5-b21c-0fa77e91b1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:48.679710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396b68e-fbef-44d5-b21c-0fa77e91b1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:48.680185 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396b68e-fbef-44d5-b21c-0fa77e91b1f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:48.681122 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396b68e-fbef-44d5-b21c-0fa77e91b1f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:48.681656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396b68e-fbef-44d5-b21c-0fa77e91b1f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:48.683264 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396b68e-fbef-44d5-b21c-0fa77e91b1f9 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:48.701886 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 391/788] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:48.703603 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713789e-a879-469a-96c8-47d1b37e2479 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:48.704099 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713789e-a879-469a-96c8-47d1b37e2479 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:48.704316 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ae2da-2d26-4686-9b2a-82fb4a7a65ec None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:48.704795 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713789e-a879-469a-96c8-47d1b37e2479 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:48.706605 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 392/789] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:48.707499 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713789e-a879-469a-96c8-47d1b37e2479 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:48.741568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838db33-39c1-4ccd-a8c0-7be21343b8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:48.742222 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838db33-39c1-4ccd-a8c0-7be21343b8af None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:48.742501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838db33-39c1-4ccd-a8c0-7be21343b8af None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:48.742775 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838db33-39c1-4ccd-a8c0-7be21343b8af None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:48.753517 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838db33-39c1-4ccd-a8c0-7be21343b8af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:48.758577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-b838db33-39c1-4ccd-a8c0-7be21343b8af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:48.758577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:48.758577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:48.758577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:48.758577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:48.758577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:48.758577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:48.758577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:48.758577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:48.758577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:48.758577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:48.758577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:48.758577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:48.758577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:48.758577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:48.758577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:48.759542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:48.759542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:48.759542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:48.759542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:48.759542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:48.759542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:48.759542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:48.759542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:48.759542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:48.759542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:48.759542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:48.759542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:48.759542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:48.759542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:48.759542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:48.759542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:48.760405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:48.760405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:48.760405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:48.760405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:48.760405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:48.760405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:48.760405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:48.760405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:48.760405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:48.760405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:48.760405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:48.760405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:48.760405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 398/790] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:42:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:42:48.761753 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2440c0c-781f-4bed-bc11-3de5ee1b1ebd None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:48.761753 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2440c0c-781f-4bed-bc11-3de5ee1b1ebd None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:48.761925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2440c0c-781f-4bed-bc11-3de5ee1b1ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:48.780984 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d2440c0c-781f-4bed-bc11-3de5ee1b1ebd None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:48.782149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d2440c0c-781f-4bed-bc11-3de5ee1b1ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:48.829049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713789e-a879-469a-96c8-47d1b37e2479 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:48.845494 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:48.865092 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 399/791] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:42:48.865092 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2440c0c-781f-4bed-bc11-3de5ee1b1ebd None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:48.871701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:48.884664 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29a475-accf-4bf2-9782-f4ef024a2c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:48.889024 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29a475-accf-4bf2-9782-f4ef024a2c0d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:48.889620 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29a475-accf-4bf2-9782-f4ef024a2c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:48.890168 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29a475-accf-4bf2-9782-f4ef024a2c0d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:48.905924 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29a475-accf-4bf2-9782-f4ef024a2c0d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:48.907798 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29a475-accf-4bf2-9782-f4ef024a2c0d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:48.922026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-ed29a475-accf-4bf2-9782-f4ef024a2c0d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:42:48.922026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:48.922026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:48.922026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:48.922026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:48.922026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:48.922026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:48.922026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:48.922026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:48.922026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:48.922026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:48.922026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:48.922026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:48.922026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:48.922026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:48.922026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:48.923087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:48.923087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:48.923087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:48.923087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:48.923087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:48.923087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:48.923087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:48.923087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:48.923087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:48.923087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:48.923087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:48.923087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:48.923087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:48.923087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:48.923087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:48.923087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:48.923087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:48.923087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:48.924012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:48.924012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:48.924012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:48.924012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:48.924012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:48.924012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:48.924012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:48.924012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:48.924012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:42:48.924012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:48.931812 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 393/792] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:42:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:48.932960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29a475-accf-4bf2-9782-f4ef024a2c0d None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:48.961593 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2440c0c-781f-4bed-bc11-3de5ee1b1ebd None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:48.999405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597ed85-511a-4332-8724-1d3c2419b4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:49.000037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597ed85-511a-4332-8724-1d3c2419b4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:49.000316 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597ed85-511a-4332-8724-1d3c2419b4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:49.000648 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597ed85-511a-4332-8724-1d3c2419b4f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:49.001405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597ed85-511a-4332-8724-1d3c2419b4f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:49.001708 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597ed85-511a-4332-8724-1d3c2419b4f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:49.003092 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597ed85-511a-4332-8724-1d3c2419b4f1 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:49.012950 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 400/793] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Jul 28 17:42:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:49.013864 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597ed85-511a-4332-8724-1d3c2419b4f1 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:49.046521 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29a475-accf-4bf2-9782-f4ef024a2c0d None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:49.073321 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:49.091300 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd4dc7-6dbe-4174-8cf2-937383365812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:49.092383 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd4dc7-6dbe-4174-8cf2-937383365812 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:49.092877 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd4dc7-6dbe-4174-8cf2-937383365812 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:49.093336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd4dc7-6dbe-4174-8cf2-937383365812 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:49.108534 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd4dc7-6dbe-4174-8cf2-937383365812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:49.116153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-9ecd4dc7-6dbe-4174-8cf2-937383365812 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:42:49.116153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:49.116153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:49.116153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:49.116153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:49.116153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:49.116153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:49.116153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:49.116153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:49.116153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:49.116153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:49.116153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:49.116153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:49.116153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:49.116153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:49.116153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:49.117527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:49.117527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:49.117527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:49.117527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:49.117527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:49.117527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:49.117527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:49.117527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:49.117527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:49.117527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:49.117527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:49.117527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:49.117527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:49.117527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:49.117527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:49.117527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:49.118570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:49.118570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:49.118570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:49.118570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:49.118570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:49.118570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:49.118570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:49.118570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:49.118570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:49.118570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:49.118570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:42:49.118570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:49.121656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 394/794] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:42:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:49.122930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd4dc7-6dbe-4174-8cf2-937383365812 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:49.129291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597ed85-511a-4332-8724-1d3c2419b4f1 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:49.165668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4d13d-c311-4128-ba3b-1337b70c7882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:49.166466 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4d13d-c311-4128-ba3b-1337b70c7882 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:49.166856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4d13d-c311-4128-ba3b-1337b70c7882 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:49.167221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4d13d-c311-4128-ba3b-1337b70c7882 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:49.168106 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4d13d-c311-4128-ba3b-1337b70c7882 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:49.168519 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4d13d-c311-4128-ba3b-1337b70c7882 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:49.170483 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4d13d-c311-4128-ba3b-1337b70c7882 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:49.186747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:49.190503 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 401/795] 10.222.0.96 () {56 vars in 1135 bytes} [Thu Jul 28 17:42:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:49.191563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4d13d-c311-4128-ba3b-1337b70c7882 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:49.249999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd4dc7-6dbe-4174-8cf2-937383365812 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:49.295918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6deb3f-6edc-4261-92b4-d48cf88b99f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:49.297679 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6deb3f-6edc-4261-92b4-d48cf88b99f9 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:49.298510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6deb3f-6edc-4261-92b4-d48cf88b99f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:49.298992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6deb3f-6edc-4261-92b4-d48cf88b99f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:49.300120 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4d13d-c311-4128-ba3b-1337b70c7882 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:49.313397 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6deb3f-6edc-4261-92b4-d48cf88b99f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:49.315526 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:49.317753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6deb3f-6edc-4261-92b4-d48cf88b99f9 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:49.338354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-df6deb3f-6edc-4261-92b4-d48cf88b99f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:49.338354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:49.338354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:49.338354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:49.338354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:49.338354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:49.338354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:49.338354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:49.338354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:49.338354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:49.338354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:49.338354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:49.338354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:49.338354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:49.338354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:49.339342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:49.339342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:49.339342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:49.339342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:49.339342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:49.339342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:49.339342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:49.339342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:49.339342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:49.339342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:49.339342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:49.339342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:49.339342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:49.339342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:49.339342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:49.339342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:49.339342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:49.340231 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:49.340231 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:49.340231 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:49.340231 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:49.340459 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99db3ff-fc36-449c-9414-92b330e6005c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:49.340459 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99db3ff-fc36-449c-9414-92b330e6005c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:49.340459 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99db3ff-fc36-449c-9414-92b330e6005c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:49.340459 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99db3ff-fc36-449c-9414-92b330e6005c None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:49.340722 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99db3ff-fc36-449c-9414-92b330e6005c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:49.340798 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99db3ff-fc36-449c-9414-92b330e6005c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:49.342233 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99db3ff-fc36-449c-9414-92b330e6005c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:49.343181 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 395/796] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:49.344463 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6deb3f-6edc-4261-92b4-d48cf88b99f9 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:49.352767 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 402/797] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:42:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:49.353754 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99db3ff-fc36-449c-9414-92b330e6005c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:49.462626 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99db3ff-fc36-449c-9414-92b330e6005c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:49.481039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:49.484782 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6deb3f-6edc-4261-92b4-d48cf88b99f9 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:49.513345 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c051af0-d222-4190-af1a-e31006f759a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:49.515014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c051af0-d222-4190-af1a-e31006f759a5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:49.515482 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c051af0-d222-4190-af1a-e31006f759a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:49.515940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c051af0-d222-4190-af1a-e31006f759a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:49.517455 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c051af0-d222-4190-af1a-e31006f759a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:49.518183 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c051af0-d222-4190-af1a-e31006f759a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:49.520525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c051af0-d222-4190-af1a-e31006f759a5 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:49.525445 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c883e-fbfb-4df8-8bf7-18e1da1fa6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:49.526224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c883e-fbfb-4df8-8bf7-18e1da1fa6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:49.526625 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c883e-fbfb-4df8-8bf7-18e1da1fa6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:49.526967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c883e-fbfb-4df8-8bf7-18e1da1fa6b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:49.535471 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 403/798] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:49.537168 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c051af0-d222-4190-af1a-e31006f759a5 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:49.540478 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c883e-fbfb-4df8-8bf7-18e1da1fa6b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:49.543020 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c883e-fbfb-4df8-8bf7-18e1da1fa6b3 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:49.561141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-bf3c883e-fbfb-4df8-8bf7-18e1da1fa6b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:49.561141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:49.561141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:49.561141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:49.561141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:49.561141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:49.561141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:49.561141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:49.561141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:49.561141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:49.561141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:49.561141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:49.561141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:49.561141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:49.561141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:49.562049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:49.562049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:49.562049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:49.562049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:49.562049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:49.562049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:49.562049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:49.562049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:49.562049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:49.562049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:49.562049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:49.562049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:49.562049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:49.562049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:49.562049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:49.562049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:49.562049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:49.562930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:49.562930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:49.562930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:49.562930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:49.562930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 396/799] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:49.563909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c883e-fbfb-4df8-8bf7-18e1da1fa6b3 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:49.585771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:49.680791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c051af0-d222-4190-af1a-e31006f759a5 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:49.694384 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c883e-fbfb-4df8-8bf7-18e1da1fa6b3 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:49.731992 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9269c3f-d183-438f-b606-26858d9f58d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:49.732652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9269c3f-d183-438f-b606-26858d9f58d8 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:49.732936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9269c3f-d183-438f-b606-26858d9f58d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:49.733235 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9269c3f-d183-438f-b606-26858d9f58d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:49.736653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71e7c7-e124-4eba-a475-4dede245aad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:49.737558 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71e7c7-e124-4eba-a475-4dede245aad4 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:49.738017 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71e7c7-e124-4eba-a475-4dede245aad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:49.738467 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71e7c7-e124-4eba-a475-4dede245aad4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:49.743848 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9269c3f-d183-438f-b606-26858d9f58d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:49.745334 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9269c3f-d183-438f-b606-26858d9f58d8 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:49.747475 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71e7c7-e124-4eba-a475-4dede245aad4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:49.749122 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71e7c7-e124-4eba-a475-4dede245aad4 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:49.760109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-d9269c3f-d183-438f-b606-26858d9f58d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:49.760109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:49.760109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:49.760109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:49.760109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:49.760109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:49.760109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:49.760109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:49.760109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:49.760109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:49.760109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:49.760109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:49.760109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:49.760109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:49.760109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:49.761008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:49.761008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:49.761008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:49.761008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:49.761008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:49.761008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:49.761008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:49.761008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:49.761008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:49.761008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:49.761008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:49.761008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:49.761008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:49.761008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:49.761008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:49.761008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:49.761008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:49.762059 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:49.762059 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:49.762059 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:49.762059 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:49.762059 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 404/800] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:49.762862 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9269c3f-d183-438f-b606-26858d9f58d8 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:49.764351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-1a71e7c7-e124-4eba-a475-4dede245aad4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:42:49.764351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:49.764351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:49.764351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:49.764351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:49.764351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:49.764351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:49.764351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:49.764351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:49.764351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:49.764351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:49.764351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:49.764351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:49.764351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:49.764351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:49.764351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:49.765443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:49.765443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:49.765443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:49.765443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:49.765443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:49.765443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:49.765443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:49.765443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:49.765443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:49.765443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:49.765443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:49.765443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:49.765443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:49.765443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:49.765443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:49.765443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:49.765443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:49.765443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:49.766386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:49.766386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:49.766386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:49.766386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:49.766386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:49.766386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:49.766386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:49.766386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:49.766386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:42:49.766386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:49.768380 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 397/801] 10.222.0.96 () {56 vars in 1117 bytes} [Thu Jul 28 17:42:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:49.769593 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fa81e-7fad-48d0-8f2f-32d3689ead71 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:49.769877 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fa81e-7fad-48d0-8f2f-32d3689ead71 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:49.770151 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fa81e-7fad-48d0-8f2f-32d3689ead71 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:49.771730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 398/802] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:49.772272 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fa81e-7fad-48d0-8f2f-32d3689ead71 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:49.791654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:49.862465 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:49.878380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9269c3f-d183-438f-b606-26858d9f58d8 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:49.888701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fa81e-7fad-48d0-8f2f-32d3689ead71 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:49.914484 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070f12a-46e1-4d31-b94c-3223dd0fab3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:49.915108 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070f12a-46e1-4d31-b94c-3223dd0fab3e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:49.915386 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070f12a-46e1-4d31-b94c-3223dd0fab3e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:49.915657 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070f12a-46e1-4d31-b94c-3223dd0fab3e None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:49.916342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070f12a-46e1-4d31-b94c-3223dd0fab3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:49.916645 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070f12a-46e1-4d31-b94c-3223dd0fab3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:49.918051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070f12a-46e1-4d31-b94c-3223dd0fab3e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:49.925897 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af006d-6b7e-40f3-9b17-d8159d7acdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:49.926785 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af006d-6b7e-40f3-9b17-d8159d7acdeb None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:49.927282 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af006d-6b7e-40f3-9b17-d8159d7acdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:49.927557 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af006d-6b7e-40f3-9b17-d8159d7acdeb None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:49.928383 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af006d-6b7e-40f3-9b17-d8159d7acdeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:49.928686 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af006d-6b7e-40f3-9b17-d8159d7acdeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:49.934659 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af006d-6b7e-40f3-9b17-d8159d7acdeb None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:49.934828 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 405/803] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:49.934828 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070f12a-46e1-4d31-b94c-3223dd0fab3e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:49.949161 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 399/804] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:49.949161 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd99a3-046c-43bc-8e96-68c96d54ec8a None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:49.949161 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd99a3-046c-43bc-8e96-68c96d54ec8a None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:49.949161 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd99a3-046c-43bc-8e96-68c96d54ec8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:49.965894 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-4acd99a3-046c-43bc-8e96-68c96d54ec8a None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:49.967096 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-4acd99a3-046c-43bc-8e96-68c96d54ec8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:50.034091 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 400/805] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:42:50.034929 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd99a3-046c-43bc-8e96-68c96d54ec8a None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:50.037313 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:50.039775 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070f12a-46e1-4d31-b94c-3223dd0fab3e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:50.074628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffaa1b9-c752-4234-a52a-63a35efb3cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:50.075249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaa1b9-c752-4234-a52a-63a35efb3cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:50.075527 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaa1b9-c752-4234-a52a-63a35efb3cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:50.075802 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaa1b9-c752-4234-a52a-63a35efb3cf7 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:50.076581 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffaa1b9-c752-4234-a52a-63a35efb3cf7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:50.076894 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffaa1b9-c752-4234-a52a-63a35efb3cf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:50.078435 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffaa1b9-c752-4234-a52a-63a35efb3cf7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:50.097966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 406/806] 10.222.0.96 () {56 vars in 1149 bytes} [Thu Jul 28 17:42:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:50.100036 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83189e24-1267-4066-a304-195cec1c7279 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:50.100329 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83189e24-1267-4066-a304-195cec1c7279 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:50.100663 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83189e24-1267-4066-a304-195cec1c7279 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:50.102126 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 407/807] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:50.102789 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83189e24-1267-4066-a304-195cec1c7279 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:50.116953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:50.161271 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd99a3-046c-43bc-8e96-68c96d54ec8a None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:50.196888 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d41c5-8711-4a9a-9285-ce8ff6e2ca89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:50.197559 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d41c5-8711-4a9a-9285-ce8ff6e2ca89 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:50.197838 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d41c5-8711-4a9a-9285-ce8ff6e2ca89 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:50.198168 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d41c5-8711-4a9a-9285-ce8ff6e2ca89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:50.204693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d41c5-8711-4a9a-9285-ce8ff6e2ca89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:50.206286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d41c5-8711-4a9a-9285-ce8ff6e2ca89 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:50.217905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-5b3d41c5-8711-4a9a-9285-ce8ff6e2ca89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:50.217905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:50.217905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:50.217905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:50.217905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:50.217905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:50.217905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:50.217905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:50.217905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:50.217905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:50.217905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:50.217905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:50.217905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:50.217905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:50.217905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:50.218909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:50.218909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:50.218909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:50.218909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:50.218909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:50.218909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:50.218909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:50.218909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:50.218909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:50.218909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:50.218909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:50.218909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:50.218909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:50.218909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:50.218909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:50.218909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:50.218909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:50.219964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:50.219964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:50.219964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:50.219964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:50.219964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:50.219964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:50.219964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:50.219964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:50.219964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 401/808] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:50.219964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d41c5-8711-4a9a-9285-ce8ff6e2ca89 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:50.222101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83189e24-1267-4066-a304-195cec1c7279 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:50.257375 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488e6e9-476e-4d2d-bd3e-fef319201dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:50.258024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488e6e9-476e-4d2d-bd3e-fef319201dec None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:50.258307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488e6e9-476e-4d2d-bd3e-fef319201dec None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:50.258615 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488e6e9-476e-4d2d-bd3e-fef319201dec None admin] PATH_INFO: `/v3/users/nova` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:50.266238 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488e6e9-476e-4d2d-bd3e-fef319201dec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:50.267761 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488e6e9-476e-4d2d-bd3e-fef319201dec None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:50.279448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:50.280619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-b488e6e9-476e-4d2d-bd3e-fef319201dec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:42:50.280619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:50.280619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:50.280619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:50.280619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:50.280619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:50.280619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:50.280619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:50.280619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:50.280619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:50.280619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:50.280619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:50.280619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:50.280619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:50.280619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:50.280619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:50.287042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:50.287042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:50.287042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:50.287042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:50.287042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:50.287042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:50.287042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:50.287042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:50.287042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:50.287042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:50.287042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:50.287042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:50.287042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:50.287042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:50.287042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:50.287042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:50.287042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:50.287042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:50.288066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:50.288066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:50.288066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:50.288066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:50.288066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:50.288066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:50.288066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:50.288066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:50.288066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:42:50.288066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:50.288066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 408/809] 10.222.0.96 () {56 vars in 1093 bytes} [Thu Jul 28 17:42:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:50.288066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488e6e9-476e-4d2d-bd3e-fef319201dec None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:50.318188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d41c5-8711-4a9a-9285-ce8ff6e2ca89 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:50.350504 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:50.350720 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0dbaf-aa77-4872-bcea-9d1a31b79ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:50.351357 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0dbaf-aa77-4872-bcea-9d1a31b79ffc None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:50.351693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0dbaf-aa77-4872-bcea-9d1a31b79ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:50.352043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0dbaf-aa77-4872-bcea-9d1a31b79ffc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:50.352525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0dbaf-aa77-4872-bcea-9d1a31b79ffc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:50.353969 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0dbaf-aa77-4872-bcea-9d1a31b79ffc None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:50.362632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-83d0dbaf-aa77-4872-bcea-9d1a31b79ffc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:42:50.362632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:50.362632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:42:50.362632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:42:50.362632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:42:50.362632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:42:50.362632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:42:50.362632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:42:50.362632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:42:50.362632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:50.362632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:42:50.362632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:50.362632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:50.362632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:50.362632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:50.362632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:50.363699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:50.363699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:50.363699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:50.363699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:50.363699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:50.363699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:50.363699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:50.363699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:42:50.363699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:42:50.363699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:42:50.363699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:42:50.363699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:50.363699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:50.363699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:50.363699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:50.363699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:50.370152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:50.370152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:50.370152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:50.370152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:50.370152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:50.370152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:50.370152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:50.370152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:50.370152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:50.370152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:50.370152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:50.370152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:42:50.370152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:42:50.370152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:42:50.370152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:50.370152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 402/810] 10.222.0.96 () {56 vars in 1129 bytes} [Thu Jul 28 17:42:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:50.371113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d729140-b2e3-40c9-83b5-5aad2b712b2e None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:50.371113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d729140-b2e3-40c9-83b5-5aad2b712b2e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:50.371113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d729140-b2e3-40c9-83b5-5aad2b712b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:50.383435 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-2d729140-b2e3-40c9-83b5-5aad2b712b2e None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:50.384615 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-2d729140-b2e3-40c9-83b5-5aad2b712b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:50.394483 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488e6e9-476e-4d2d-bd3e-fef319201dec None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:50.428179 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342b9df-cd89-4981-8d63-9041c5130bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:50.428814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342b9df-cd89-4981-8d63-9041c5130bea None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:50.429116 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342b9df-cd89-4981-8d63-9041c5130bea None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:50.429393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342b9df-cd89-4981-8d63-9041c5130bea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:50.440326 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342b9df-cd89-4981-8d63-9041c5130bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:50.441797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342b9df-cd89-4981-8d63-9041c5130bea None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:50.452816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 403/811] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:42:50.453682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d729140-b2e3-40c9-83b5-5aad2b712b2e None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:50.456091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-c342b9df-cd89-4981-8d63-9041c5130bea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:50.456091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:50.456091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:50.456091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:50.456091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:50.456091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:50.456091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:50.456091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:50.456091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:50.456091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:50.456091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:50.456091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:50.456091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:50.456091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:50.456091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:50.457123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:50.457123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:50.457123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:50.457123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:50.457123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:50.457123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:50.457123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:50.457123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:50.457123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:50.457123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:50.457123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:50.457123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:50.457123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:50.457123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:50.457123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:50.457123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:50.457123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:50.458173 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:50.458173 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:50.458173 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:50.458173 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:50.458173 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 409/812] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:50.458173 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342b9df-cd89-4981-8d63-9041c5130bea None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:50.526782 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:50.569976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342b9df-cd89-4981-8d63-9041c5130bea None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:50.571844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d729140-b2e3-40c9-83b5-5aad2b712b2e None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:50.587051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:50.605548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4f5eb-047c-4a82-bef7-700a8b15960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:50.605976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7164b7-a393-48fe-906e-b7c82d3e7b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:50.606166 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4f5eb-047c-4a82-bef7-700a8b15960e None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:50.606449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4f5eb-047c-4a82-bef7-700a8b15960e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:50.606602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7164b7-a393-48fe-906e-b7c82d3e7b93 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:50.606722 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4f5eb-047c-4a82-bef7-700a8b15960e None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:50.606883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7164b7-a393-48fe-906e-b7c82d3e7b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:50.607158 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7164b7-a393-48fe-906e-b7c82d3e7b93 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:50.607467 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4f5eb-047c-4a82-bef7-700a8b15960e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:50.607771 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4f5eb-047c-4a82-bef7-700a8b15960e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:50.607952 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7164b7-a393-48fe-906e-b7c82d3e7b93 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:50.608265 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7164b7-a393-48fe-906e-b7c82d3e7b93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:50.609228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4f5eb-047c-4a82-bef7-700a8b15960e None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:50.609725 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7164b7-a393-48fe-906e-b7c82d3e7b93 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:50.620492 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 404/813] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:50.621256 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4f5eb-047c-4a82-bef7-700a8b15960e None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:50.628021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 410/814] 10.222.0.96 () {56 vars in 1133 bytes} [Thu Jul 28 17:42:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:50.628761 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7164b7-a393-48fe-906e-b7c82d3e7b93 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:50.722267 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4f5eb-047c-4a82-bef7-700a8b15960e None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:50.726852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7164b7-a393-48fe-906e-b7c82d3e7b93 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:50.738064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:50.755818 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802850d-f3ea-4939-aff7-3da02e7df5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:50.756444 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802850d-f3ea-4939-aff7-3da02e7df5ca None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:50.756755 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802850d-f3ea-4939-aff7-3da02e7df5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:50.757025 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802850d-f3ea-4939-aff7-3da02e7df5ca None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:50.757736 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802850d-f3ea-4939-aff7-3da02e7df5ca None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:50.758011 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802850d-f3ea-4939-aff7-3da02e7df5ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:50.759390 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802850d-f3ea-4939-aff7-3da02e7df5ca None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:50.764150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f0795-d18b-4431-97fe-211fc83c6698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:50.764686 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 405/815] 10.222.0.96 () {56 vars in 1124 bytes} [Thu Jul 28 17:42:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:50.764897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f0795-d18b-4431-97fe-211fc83c6698 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:50.765194 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f0795-d18b-4431-97fe-211fc83c6698 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:50.765492 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802850d-f3ea-4939-aff7-3da02e7df5ca None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:50.765597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f0795-d18b-4431-97fe-211fc83c6698 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:50.766210 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f0795-d18b-4431-97fe-211fc83c6698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:50.766520 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f0795-d18b-4431-97fe-211fc83c6698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:50.767887 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f0795-d18b-4431-97fe-211fc83c6698 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:50.780181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 411/816] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:50.781154 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f0795-d18b-4431-97fe-211fc83c6698 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:50.817135 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:50.869751 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802850d-f3ea-4939-aff7-3da02e7df5ca None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:50.880966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f0795-d18b-4431-97fe-211fc83c6698 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:50.903295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06642997-1387-4b82-942b-a9df3ba50d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:50.903928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06642997-1387-4b82-942b-a9df3ba50d7e None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:50.904206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06642997-1387-4b82-942b-a9df3ba50d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:50.904474 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06642997-1387-4b82-942b-a9df3ba50d7e None admin] PATH_INFO: `/v3/services/network` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:50.905109 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06642997-1387-4b82-942b-a9df3ba50d7e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:50.906478 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06642997-1387-4b82-942b-a9df3ba50d7e None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:50.914804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d56f4-faca-413d-bf78-267f1c8ade5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:50.915140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-06642997-1387-4b82-942b-a9df3ba50d7e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:42:50.915140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:50.915140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:42:50.915140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:42:50.915140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:42:50.915140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:42:50.915140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:42:50.915140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:42:50.915140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:42:50.915140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:50.915140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:42:50.915140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:50.915140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:50.915140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:50.915140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:50.915140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:50.915140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:50.916078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:50.916078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:50.916078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:50.916078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:50.916078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:50.916078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:50.916078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:42:50.916078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:42:50.916078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:42:50.916078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:42:50.916078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:50.916078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:50.916078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:50.916078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:50.916078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:50.916078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:50.916917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:50.916917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:50.916917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:50.916917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:50.916917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:50.916917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:50.916917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:50.916917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:50.916917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:50.916917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:50.916917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:42:50.916917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:42:50.916917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:42:50.916917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:50.917703 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d56f4-faca-413d-bf78-267f1c8ade5d None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:50.917703 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d56f4-faca-413d-bf78-267f1c8ade5d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:50.917703 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d56f4-faca-413d-bf78-267f1c8ade5d None admin] PATH_INFO: `/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/4ea1a9023eaf427f96f86af909a803fd/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:50.917888 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 406/817] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:50 2022] GET /identity/v3/services/network => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:50.917888 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06642997-1387-4b82-942b-a9df3ba50d7e None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:50.922592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d56f4-faca-413d-bf78-267f1c8ade5d None admin] RBAC: Authorizing `identity:create_grant(project_id=db5ce5e789e949d09c183dbe04e53f19, user_id=4ea1a9023eaf427f96f86af909a803fd, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:50.924032 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d56f4-faca-413d-bf78-267f1c8ade5d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:50.938805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 412/818] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:42:50 2022] PUT /identity/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/4ea1a9023eaf427f96f86af909a803fd/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:42:50.939683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d56f4-faca-413d-bf78-267f1c8ade5d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:50.972387 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:51.046910 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06642997-1387-4b82-942b-a9df3ba50d7e None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:51.078855 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:51.085887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62871bd9-89e8-44ae-9b21-f8d9a891fd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:51.086710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62871bd9-89e8-44ae-9b21-f8d9a891fd37 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:51.086989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62871bd9-89e8-44ae-9b21-f8d9a891fd37 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:51.087265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62871bd9-89e8-44ae-9b21-f8d9a891fd37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:51.087535 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d56f4-faca-413d-bf78-267f1c8ade5d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:51.138369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d05156-a65d-469f-abe6-9762d577c2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:51.138925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d05156-a65d-469f-abe6-9762d577c2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:51.139222 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d05156-a65d-469f-abe6-9762d577c2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:51.139477 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d05156-a65d-469f-abe6-9762d577c2a5 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:51.140172 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d05156-a65d-469f-abe6-9762d577c2a5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:51.140483 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d05156-a65d-469f-abe6-9762d577c2a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:51.141992 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d05156-a65d-469f-abe6-9762d577c2a5 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:51.153188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 413/819] 10.222.0.96 () {56 vars in 1124 bytes} [Thu Jul 28 17:42:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:51.153188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d05156-a65d-469f-abe6-9762d577c2a5 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:51.164667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62871bd9-89e8-44ae-9b21-f8d9a891fd37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:51.166771 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62871bd9-89e8-44ae-9b21-f8d9a891fd37 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:51.217649 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:51.265895 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d05156-a65d-469f-abe6-9762d577c2a5 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:51.275530 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 407/820] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:42:51.276409 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62871bd9-89e8-44ae-9b21-f8d9a891fd37 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:51.307155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ddc17-0149-4589-ac88-5a54cd68838e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:51.307893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ddc17-0149-4589-ac88-5a54cd68838e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:51.308194 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ddc17-0149-4589-ac88-5a54cd68838e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:51.308453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ddc17-0149-4589-ac88-5a54cd68838e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:51.315434 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ddc17-0149-4589-ac88-5a54cd68838e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:51.317005 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ddc17-0149-4589-ac88-5a54cd68838e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:51.329128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-7d5ddc17-0149-4589-ac88-5a54cd68838e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:51.329128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:51.329128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:51.329128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:51.329128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:51.329128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:51.329128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:51.329128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:51.329128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:51.329128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:51.329128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:51.329128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:51.329128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:51.329128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:51.329128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:51.330047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:51.330047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:51.330047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:51.330047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:51.330047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:51.330047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:51.330047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:51.330047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:51.330047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:51.330047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:51.330047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:51.330047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:51.330047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:51.330047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:51.330047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:51.330047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:51.330047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:51.330934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:51.330934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:51.330934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:51.330934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:51.330934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:51.330934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:51.330934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:51.330934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:51.330934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 414/821] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:51.336122 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ddc17-0149-4589-ac88-5a54cd68838e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:51.357777 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:51.379667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62871bd9-89e8-44ae-9b21-f8d9a891fd37 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:51.414837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45ba77-d683-4d72-9111-92a0ce84c313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:51.415371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45ba77-d683-4d72-9111-92a0ce84c313 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:51.415659 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45ba77-d683-4d72-9111-92a0ce84c313 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:51.415964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45ba77-d683-4d72-9111-92a0ce84c313 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:51.416640 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45ba77-d683-4d72-9111-92a0ce84c313 None admin] RBAC: Adding query filter params (name=network) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:51.416948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45ba77-d683-4d72-9111-92a0ce84c313 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:51.418375 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45ba77-d683-4d72-9111-92a0ce84c313 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:51.424222 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 408/822] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Jul 28 17:42:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:51.425088 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45ba77-d683-4d72-9111-92a0ce84c313 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:51.435976 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:51.452430 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ddc17-0149-4589-ac88-5a54cd68838e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:51.489855 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78316146-e213-41f4-b4bc-1deeebe99ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:51.490460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78316146-e213-41f4-b4bc-1deeebe99ae2 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:51.490754 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78316146-e213-41f4-b4bc-1deeebe99ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:51.491023 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78316146-e213-41f4-b4bc-1deeebe99ae2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:51.491720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78316146-e213-41f4-b4bc-1deeebe99ae2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:51.493344 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78316146-e213-41f4-b4bc-1deeebe99ae2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:51.529445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 415/823] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:42:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:42:51.530366 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78316146-e213-41f4-b4bc-1deeebe99ae2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:51.542500 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45ba77-d683-4d72-9111-92a0ce84c313 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:51.587807 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d4013-0ccf-4c36-b23b-97f1b5d6fdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:51.589497 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d4013-0ccf-4c36-b23b-97f1b5d6fdf3 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:51.589497 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d4013-0ccf-4c36-b23b-97f1b5d6fdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:51.589497 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d4013-0ccf-4c36-b23b-97f1b5d6fdf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:51.602164 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d4013-0ccf-4c36-b23b-97f1b5d6fdf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:51.603722 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d4013-0ccf-4c36-b23b-97f1b5d6fdf3 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:51.621460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-ae9d4013-0ccf-4c36-b23b-97f1b5d6fdf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:51.621460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:51.621460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:51.621460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:51.621460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:51.621460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:51.621460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:51.621460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:51.621460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:51.621460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:51.621460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:51.621460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:51.621460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:51.621460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:51.621460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:51.622503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:51.622503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:51.622503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:51.622503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:51.622503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:51.622503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:51.622503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:51.622503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:51.622503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:51.622503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:51.622503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:51.622503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:51.622503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:51.622503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:51.622503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:51.622503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:51.622503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:51.623413 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:51.623413 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:51.623413 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:51.623413 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:51.627799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 409/824] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:51.628792 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d4013-0ccf-4c36-b23b-97f1b5d6fdf3 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:51.655103 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:51.689219 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78316146-e213-41f4-b4bc-1deeebe99ae2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:51.702373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:51.727246 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d533660-063d-4344-b06f-7973ac034568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:51.727892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d533660-063d-4344-b06f-7973ac034568 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:51.728175 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d533660-063d-4344-b06f-7973ac034568 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:51.728453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d533660-063d-4344-b06f-7973ac034568 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:51.729346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d533660-063d-4344-b06f-7973ac034568 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:51.729664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d533660-063d-4344-b06f-7973ac034568 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:51.731132 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d533660-063d-4344-b06f-7973ac034568 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:51.746611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 416/825] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:51.747822 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d533660-063d-4344-b06f-7973ac034568 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:51.764560 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d4013-0ccf-4c36-b23b-97f1b5d6fdf3 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:51.809241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc232b-56c1-4cbc-b402-c6d974c5db95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:51.810298 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc232b-56c1-4cbc-b402-c6d974c5db95 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:51.810583 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc232b-56c1-4cbc-b402-c6d974c5db95 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:51.810862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc232b-56c1-4cbc-b402-c6d974c5db95 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:51.811820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc232b-56c1-4cbc-b402-c6d974c5db95 None admin] RBAC: Adding query filter params (type=network) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:51.812130 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc232b-56c1-4cbc-b402-c6d974c5db95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:51.813821 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc232b-56c1-4cbc-b402-c6d974c5db95 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:51.823945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 410/826] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Jul 28 17:42:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:51.829344 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc232b-56c1-4cbc-b402-c6d974c5db95 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:51.867156 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d533660-063d-4344-b06f-7973ac034568 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:51.906720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd85a69-ecfc-41a9-81f4-70a18d8febc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:51.907395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd85a69-ecfc-41a9-81f4-70a18d8febc3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:51.907674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd85a69-ecfc-41a9-81f4-70a18d8febc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:51.907946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd85a69-ecfc-41a9-81f4-70a18d8febc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:51.908930 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd85a69-ecfc-41a9-81f4-70a18d8febc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:51.909219 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd85a69-ecfc-41a9-81f4-70a18d8febc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:51.910543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd85a69-ecfc-41a9-81f4-70a18d8febc3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:51.913016 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:51.925761 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 417/827] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:51.927044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd85a69-ecfc-41a9-81f4-70a18d8febc3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:51.971997 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc232b-56c1-4cbc-b402-c6d974c5db95 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:52.000115 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:52.020763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc6891-a621-4bb0-8359-684637c22c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:52.021530 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc6891-a621-4bb0-8359-684637c22c77 None admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:52.021882 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc6891-a621-4bb0-8359-684637c22c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:52.022165 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc6891-a621-4bb0-8359-684637c22c77 None admin] PATH_INFO: `/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/a1936a2649c349d481f56304b3ee55b3/roles/f8cbbf969cfc442595755799825094f6` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:52.043933 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc6891-a621-4bb0-8359-684637c22c77 None admin] RBAC: Authorizing `identity:create_grant(project_id=db5ce5e789e949d09c183dbe04e53f19, user_id=a1936a2649c349d481f56304b3ee55b3, role_id=f8cbbf969cfc442595755799825094f6)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:52.046137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc6891-a621-4bb0-8359-684637c22c77 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:52.051714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd85a69-ecfc-41a9-81f4-70a18d8febc3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:52.066889 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 411/828] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:42:51 2022] PUT /identity/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/a1936a2649c349d481f56304b3ee55b3/roles/f8cbbf969cfc442595755799825094f6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:42:52.069622 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc6891-a621-4bb0-8359-684637c22c77 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:52.149858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097e152-c262-4187-be06-29eb434cbcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:52.150541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097e152-c262-4187-be06-29eb434cbcab None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:52.150830 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097e152-c262-4187-be06-29eb434cbcab None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:52.151100 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097e152-c262-4187-be06-29eb434cbcab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:52.151872 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097e152-c262-4187-be06-29eb434cbcab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:52.153360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097e152-c262-4187-be06-29eb434cbcab None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:52.199046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 418/829] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:42:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:42:52.217954 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc6891-a621-4bb0-8359-684637c22c77 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:52.277678 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3a8c5-57ec-4c60-8dcd-048a10962ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:52.278245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3a8c5-57ec-4c60-8dcd-048a10962ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:52.278524 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3a8c5-57ec-4c60-8dcd-048a10962ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:52.278845 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3a8c5-57ec-4c60-8dcd-048a10962ec4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:52.287420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3a8c5-57ec-4c60-8dcd-048a10962ec4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:52.288916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3a8c5-57ec-4c60-8dcd-048a10962ec4 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:52.302227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-9eb3a8c5-57ec-4c60-8dcd-048a10962ec4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:52.302227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:52.302227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:52.302227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:52.302227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:52.302227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:52.302227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:52.302227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:52.302227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:52.302227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:52.302227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:52.302227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:52.302227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:52.302227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:52.302227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:52.304328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:52.304328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:52.304328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:52.304328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:52.304328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:52.304328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:52.304328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:52.304328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:52.304328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:52.304328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:52.304328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:52.304328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:52.304328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:52.304328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:52.304328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:52.304328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:52.304328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:52.306433 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:52.306433 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:52.306433 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:52.306433 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:52.306433 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:52.306433 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:52.306433 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:52.306433 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:52.306433 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 412/830] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:52.310458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097e152-c262-4187-be06-29eb434cbcab None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:52.377234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:52.437635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097e152-c262-4187-be06-29eb434cbcab None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:52.475379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d483e6-5028-44d8-9725-7378b5182de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:52.476019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d483e6-5028-44d8-9725-7378b5182de4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:52.476300 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d483e6-5028-44d8-9725-7378b5182de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:52.476572 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d483e6-5028-44d8-9725-7378b5182de4 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:52.477440 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d483e6-5028-44d8-9725-7378b5182de4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:52.477846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d483e6-5028-44d8-9725-7378b5182de4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:52.479310 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d483e6-5028-44d8-9725-7378b5182de4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:52.492834 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 419/831] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:52.498987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3a8c5-57ec-4c60-8dcd-048a10962ec4 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:52.530039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:52.608343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3a8c5-57ec-4c60-8dcd-048a10962ec4 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:52.646112 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7745ed-dbe9-47a4-9114-87cd965a08a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:52.646921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7745ed-dbe9-47a4-9114-87cd965a08a6 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:52.647205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7745ed-dbe9-47a4-9114-87cd965a08a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:52.647484 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7745ed-dbe9-47a4-9114-87cd965a08a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:52.648352 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7745ed-dbe9-47a4-9114-87cd965a08a6 None admin] RBAC: Adding query filter params (role.id=980cae90acae42189f92fd6dd42867a5, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=5ac367247aa54671ae5c33d251017470) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:52.648671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7745ed-dbe9-47a4-9114-87cd965a08a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:52.650269 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7745ed-dbe9-47a4-9114-87cd965a08a6 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:52.657002 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 413/832] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:42:52 2022] GET /identity/v3/role_assignments?user.id=5ac367247aa54671ae5c33d251017470&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=980cae90acae42189f92fd6dd42867a5 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:53.027228 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e786a6-4ebe-4f42-9bdc-8f01eb03402d None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:53.027530 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e786a6-4ebe-4f42-9bdc-8f01eb03402d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:53.027804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e786a6-4ebe-4f42-9bdc-8f01eb03402d None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:53.029458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 420/833] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:53.034751 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e8aec-b7c1-4649-a684-d12b5bffae14 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:53.035039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e8aec-b7c1-4649-a684-d12b5bffae14 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:53.035316 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e8aec-b7c1-4649-a684-d12b5bffae14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:53.056118 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-fb4e8aec-b7c1-4649-a684-d12b5bffae14 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:53.057365 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-fb4e8aec-b7c1-4649-a684-d12b5bffae14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:53.133392 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 414/834] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:42:53.152807 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e786a6-4ebe-4f42-9bdc-8f01eb03402d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:53.263782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e786a6-4ebe-4f42-9bdc-8f01eb03402d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:53.278243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:53.306109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df178acb-4289-42dc-9ff0-6cf2e0af0fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:53.306766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df178acb-4289-42dc-9ff0-6cf2e0af0fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:53.307048 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df178acb-4289-42dc-9ff0-6cf2e0af0fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:53.307325 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df178acb-4289-42dc-9ff0-6cf2e0af0fc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:53.318439 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df178acb-4289-42dc-9ff0-6cf2e0af0fc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:53.323380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-df178acb-4289-42dc-9ff0-6cf2e0af0fc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:42:53.323380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:53.323380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:53.323380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:53.323380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:53.323380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:53.323380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:53.323380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:53.323380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:53.323380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:53.323380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:53.323380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:53.323380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:53.323380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:53.323380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:53.323380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:53.324298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:53.324298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:53.324298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:53.324298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:53.324298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:53.324298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:53.324298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:53.324298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:53.324298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:53.324298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:53.324298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:53.324298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:53.324298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:53.324298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:53.324298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:53.324298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:53.325144 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:53.325144 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:53.325144 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:53.325144 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:53.325144 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:53.325144 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:53.325144 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:53.325144 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:53.325144 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:53.325144 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:53.325144 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:42:53.325144 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:53.325144 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 421/835] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:42:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:53.332343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e8aec-b7c1-4649-a684-d12b5bffae14 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:53.354948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:53.442329 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e8aec-b7c1-4649-a684-d12b5bffae14 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:53.478840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e906d1-042c-4711-853d-f06de60c8441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:53.479887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e906d1-042c-4711-853d-f06de60c8441 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:53.480383 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e906d1-042c-4711-853d-f06de60c8441 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:53.480906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e906d1-042c-4711-853d-f06de60c8441 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:53.481876 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e906d1-042c-4711-853d-f06de60c8441 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:53.482383 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e906d1-042c-4711-853d-f06de60c8441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:53.484028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e906d1-042c-4711-853d-f06de60c8441 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:53.494123 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 415/836] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:42:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:53.500165 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df178acb-4289-42dc-9ff0-6cf2e0af0fc2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:53.608746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df178acb-4289-42dc-9ff0-6cf2e0af0fc2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:53.645604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14f885-189f-440f-aa48-6882f577c8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:53.646532 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14f885-189f-440f-aa48-6882f577c8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:53.646818 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14f885-189f-440f-aa48-6882f577c8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:53.647098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14f885-189f-440f-aa48-6882f577c8b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:53.657600 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14f885-189f-440f-aa48-6882f577c8b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:53.659061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14f885-189f-440f-aa48-6882f577c8b9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:53.675272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-8f14f885-189f-440f-aa48-6882f577c8b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:53.675272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:53.675272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:53.675272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:53.675272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:53.675272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:53.675272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:53.675272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:53.675272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:53.675272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:53.675272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:53.675272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:53.675272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:53.675272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:53.675272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:53.676258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:53.676258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:53.676258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:53.676258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:53.676258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:53.676258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:53.676258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:53.676258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:53.676258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:53.676258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:53.676258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:53.676258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:53.676258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:53.676258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:53.676258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:53.676258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:53.676258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:53.677211 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:53.677211 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:53.677211 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:53.677211 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:53.677211 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 422/837] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:53.683659 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e906d1-042c-4711-853d-f06de60c8441 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:53.748820 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aac8b4-8301-484b-8120-19a81670d5cc None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:53.749197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aac8b4-8301-484b-8120-19a81670d5cc None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:53.749410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aac8b4-8301-484b-8120-19a81670d5cc None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:53.752154 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 423/838] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:42:53.756247 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d972fc-3287-44e2-be49-3cea60d0d5e9 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:53.756524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d972fc-3287-44e2-be49-3cea60d0d5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:53.756795 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d972fc-3287-44e2-be49-3cea60d0d5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:53.775137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:53.776148 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-59d972fc-3287-44e2-be49-3cea60d0d5e9 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:53.777908 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-59d972fc-3287-44e2-be49-3cea60d0d5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:53.797147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:53.802181 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e906d1-042c-4711-853d-f06de60c8441 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:53.842104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f21e9-87a3-4fc5-860a-1f67a950ab4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:53.843126 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f21e9-87a3-4fc5-860a-1f67a950ab4c None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:53.843595 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f21e9-87a3-4fc5-860a-1f67a950ab4c None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:53.844055 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f21e9-87a3-4fc5-860a-1f67a950ab4c None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:53.845047 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f21e9-87a3-4fc5-860a-1f67a950ab4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:53.845577 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f21e9-87a3-4fc5-860a-1f67a950ab4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:53.847215 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f21e9-87a3-4fc5-860a-1f67a950ab4c None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:53.861878 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 416/839] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:53.866552 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 424/840] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:42:53.867726 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d972fc-3287-44e2-be49-3cea60d0d5e9 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:53.888162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f21e9-87a3-4fc5-860a-1f67a950ab4c None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:53.979692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d972fc-3287-44e2-be49-3cea60d0d5e9 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:53.997309 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f21e9-87a3-4fc5-860a-1f67a950ab4c None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:54.018460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36370f88-a18b-4237-b669-23624e0b9045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:54.019166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36370f88-a18b-4237-b669-23624e0b9045 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:54.019450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36370f88-a18b-4237-b669-23624e0b9045 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:54.019898 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36370f88-a18b-4237-b669-23624e0b9045 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:54.030633 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36370f88-a18b-4237-b669-23624e0b9045 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:54.032109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36370f88-a18b-4237-b669-23624e0b9045 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:54.035097 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e213e8-96c3-498c-a5c1-79439aff0e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:54.035747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e213e8-96c3-498c-a5c1-79439aff0e81 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:54.036052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e213e8-96c3-498c-a5c1-79439aff0e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:54.036319 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e213e8-96c3-498c-a5c1-79439aff0e81 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:54.036943 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e213e8-96c3-498c-a5c1-79439aff0e81 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:54.038526 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e213e8-96c3-498c-a5c1-79439aff0e81 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:54.045827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-36370f88-a18b-4237-b669-23624e0b9045 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:42:54.045827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:54.045827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:54.045827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:54.045827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:54.045827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:54.045827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:54.045827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:54.045827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:54.045827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:54.045827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:54.045827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:54.045827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:54.045827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:54.045827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:54.045827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:54.046905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:54.046905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:54.046905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:54.046905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:54.046905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:54.046905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:54.046905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:54.046905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:54.046905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:54.046905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:54.046905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:54.046905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:54.046905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:54.046905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:54.046905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:54.046905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:54.046905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:54.046905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:54.048070 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:54.048070 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:54.048070 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:54.048070 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:54.048070 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:54.048070 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:54.048070 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:54.048070 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:54.048070 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:42:54.048070 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:54.048070 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 425/841] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:42:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:54.048748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-55e213e8-96c3-498c-a5c1-79439aff0e81 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:42:54.048748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:54.048748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:42:54.048748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:42:54.048748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:42:54.048748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:42:54.048748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:42:54.048748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:42:54.048748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:42:54.048748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:54.048748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:42:54.048748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:54.048748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:54.048748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:54.048748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:54.048748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:54.048748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:54.049705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:54.049705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:54.049705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:54.049705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:54.049705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:54.049705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:54.049705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:42:54.049705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:42:54.049705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:42:54.049705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:42:54.049705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:54.049705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:54.049705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:54.049705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:54.049705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:54.049705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:54.050535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:54.050535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:54.050535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:54.050535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:54.050535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:54.050535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:54.050535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:54.050535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:54.050535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:54.050535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:54.050535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:42:54.050535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:42:54.050535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:42:54.050535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:54.061127 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 417/842] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:42:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:54.061287 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36370f88-a18b-4237-b669-23624e0b9045 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:54.061378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e213e8-96c3-498c-a5c1-79439aff0e81 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:54.066724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:54.076152 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:54.163284 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e213e8-96c3-498c-a5c1-79439aff0e81 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:54.170640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36370f88-a18b-4237-b669-23624e0b9045 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:54.199213 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138183a-95b8-4079-a64f-e57ec95ced6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:54.199864 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138183a-95b8-4079-a64f-e57ec95ced6c None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:54.200382 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138183a-95b8-4079-a64f-e57ec95ced6c None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:54.200488 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138183a-95b8-4079-a64f-e57ec95ced6c None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:54.201213 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138183a-95b8-4079-a64f-e57ec95ced6c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:54.201533 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138183a-95b8-4079-a64f-e57ec95ced6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:54.203033 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138183a-95b8-4079-a64f-e57ec95ced6c None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:54.210070 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9c5cc-3e09-454c-a18b-3926bc4c2a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:54.210969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9c5cc-3e09-454c-a18b-3926bc4c2a7f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:54.211440 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9c5cc-3e09-454c-a18b-3926bc4c2a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:54.211900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9c5cc-3e09-454c-a18b-3926bc4c2a7f None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:54.212971 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9c5cc-3e09-454c-a18b-3926bc4c2a7f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:54.213280 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 418/843] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:42:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:54.213881 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9c5cc-3e09-454c-a18b-3926bc4c2a7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:54.214886 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138183a-95b8-4079-a64f-e57ec95ced6c None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:54.215952 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9c5cc-3e09-454c-a18b-3926bc4c2a7f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:54.242712 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 426/844] 10.222.0.96 () {56 vars in 1135 bytes} [Thu Jul 28 17:42:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:54.244118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9c5cc-3e09-454c-a18b-3926bc4c2a7f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:54.289765 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:54.322818 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138183a-95b8-4079-a64f-e57ec95ced6c None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:54.325099 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:54.357816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1187b79-d629-43cb-94a2-d5c2b36f79fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:54.358437 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1187b79-d629-43cb-94a2-d5c2b36f79fe None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:54.358711 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1187b79-d629-43cb-94a2-d5c2b36f79fe None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:54.358824 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9c5cc-3e09-454c-a18b-3926bc4c2a7f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:54.359026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1187b79-d629-43cb-94a2-d5c2b36f79fe None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:54.359648 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1187b79-d629-43cb-94a2-d5c2b36f79fe None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:54.359950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1187b79-d629-43cb-94a2-d5c2b36f79fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:54.361354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1187b79-d629-43cb-94a2-d5c2b36f79fe None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:54.365851 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 419/845] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:42:54 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:54.367090 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dbae9-8e07-43bb-a86e-5279ca0f054d None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:54.367371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dbae9-8e07-43bb-a86e-5279ca0f054d None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:54.367640 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dbae9-8e07-43bb-a86e-5279ca0f054d None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:54.372877 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 420/846] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:54.374617 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080c67d-732d-4d84-833d-a0e7e8ec34e4 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:54.374895 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080c67d-732d-4d84-833d-a0e7e8ec34e4 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:54.375170 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080c67d-732d-4d84-833d-a0e7e8ec34e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:54.395444 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-b080c67d-732d-4d84-833d-a0e7e8ec34e4 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:54.396680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b080c67d-732d-4d84-833d-a0e7e8ec34e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:54.408228 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2f55e-2ae1-423d-9a51-810acd0c32cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:54.409326 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2f55e-2ae1-423d-9a51-810acd0c32cb None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:54.409775 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2f55e-2ae1-423d-9a51-810acd0c32cb None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:54.410247 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2f55e-2ae1-423d-9a51-810acd0c32cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:54.481175 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 421/847] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:42:54.502457 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080c67d-732d-4d84-833d-a0e7e8ec34e4 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:54.508805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2f55e-2ae1-423d-9a51-810acd0c32cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:54.510747 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2f55e-2ae1-423d-9a51-810acd0c32cb None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:54.575265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:54.598081 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:54.617196 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080c67d-732d-4d84-833d-a0e7e8ec34e4 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:54.643405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 427/848] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:54 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:42:54.644559 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2f55e-2ae1-423d-9a51-810acd0c32cb None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:54.663561 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984c2b0-edaa-4b17-8b8f-56d5eb1db232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:54.664513 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984c2b0-edaa-4b17-8b8f-56d5eb1db232 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:54.664791 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984c2b0-edaa-4b17-8b8f-56d5eb1db232 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:54.665095 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984c2b0-edaa-4b17-8b8f-56d5eb1db232 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:54.680260 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984c2b0-edaa-4b17-8b8f-56d5eb1db232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:54.686494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-1984c2b0-edaa-4b17-8b8f-56d5eb1db232 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:54.686494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:54.686494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:54.686494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:54.686494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:54.686494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:54.686494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:54.686494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:54.686494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:54.686494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:54.686494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:54.686494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:54.686494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:54.686494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:54.686494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:54.686494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:54.687820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:54.687820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:54.687820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:54.687820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:54.687820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:54.687820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:54.687820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:54.687820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:54.687820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:54.687820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:54.687820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:54.687820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:54.687820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:54.687820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:54.687820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:54.687820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:54.688635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:54.688635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:54.688635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:54.688635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:54.688635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:54.688635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:54.688635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:54.688635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:54.688635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:54.688635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:54.688635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:42:54.688635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:54.688635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 422/849] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:42:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:42:54.695030 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984c2b0-edaa-4b17-8b8f-56d5eb1db232 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:54.756749 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2f55e-2ae1-423d-9a51-810acd0c32cb None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:54.793304 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03086619-8ea7-4985-b55e-f7827132b2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:54.794053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03086619-8ea7-4985-b55e-f7827132b2ea None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:54.794439 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03086619-8ea7-4985-b55e-f7827132b2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:54.794782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03086619-8ea7-4985-b55e-f7827132b2ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:54.799326 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984c2b0-edaa-4b17-8b8f-56d5eb1db232 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:54.806159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03086619-8ea7-4985-b55e-f7827132b2ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:54.807817 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03086619-8ea7-4985-b55e-f7827132b2ea None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:54.823860 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:54.825683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-03086619-8ea7-4985-b55e-f7827132b2ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:54.825683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:54.825683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:54.825683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:54.825683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:54.825683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:54.825683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:54.825683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:54.825683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:54.825683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:54.825683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:54.825683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:54.825683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:54.825683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:54.825683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:54.826551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:54.826551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:54.826551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:54.826551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:54.826551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:54.826551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:54.826551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:54.826551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:54.826551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:54.826551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:54.826551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:54.826551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:54.826551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:54.826551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:54.826551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:54.826551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:54.826551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:54.827453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:54.827453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:54.827453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:54.827453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:54.829791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 428/850] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:54.841249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e983807-fcaa-40bf-bb3f-534b39ec8850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:54.841442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03086619-8ea7-4985-b55e-f7827132b2ea None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:54.841537 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e983807-fcaa-40bf-bb3f-534b39ec8850 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:54.841537 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e983807-fcaa-40bf-bb3f-534b39ec8850 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:54.841537 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e983807-fcaa-40bf-bb3f-534b39ec8850 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:54.841537 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e983807-fcaa-40bf-bb3f-534b39ec8850 None admin] RBAC: Adding query filter params (name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:54.841537 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e983807-fcaa-40bf-bb3f-534b39ec8850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:54.841537 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e983807-fcaa-40bf-bb3f-534b39ec8850 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:54.847630 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 423/851] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Jul 28 17:42:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:54.853324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e983807-fcaa-40bf-bb3f-534b39ec8850 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:54.867518 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:54.949706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03086619-8ea7-4985-b55e-f7827132b2ea None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:54.957176 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e983807-fcaa-40bf-bb3f-534b39ec8850 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:54.987118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcae6c-115e-463b-b3d6-fcd2c09489f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:54.988045 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcae6c-115e-463b-b3d6-fcd2c09489f6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:54.988604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcae6c-115e-463b-b3d6-fcd2c09489f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:54.989544 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcae6c-115e-463b-b3d6-fcd2c09489f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:54.990403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcae6c-115e-463b-b3d6-fcd2c09489f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:54.990982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcae6c-115e-463b-b3d6-fcd2c09489f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:54.991351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70f46d-7a37-4533-aa96-35f104d7eae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:54.991996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70f46d-7a37-4533-aa96-35f104d7eae5 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:54.992272 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70f46d-7a37-4533-aa96-35f104d7eae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:54.992552 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70f46d-7a37-4533-aa96-35f104d7eae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:54.993531 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcae6c-115e-463b-b3d6-fcd2c09489f6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:55.002865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70f46d-7a37-4533-aa96-35f104d7eae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:55.004303 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70f46d-7a37-4533-aa96-35f104d7eae5 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:55.011738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 429/852] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:55.013599 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209316c7-e5dd-434a-92f1-49f5bdcfb9a5 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:55.014048 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209316c7-e5dd-434a-92f1-49f5bdcfb9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:55.014461 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209316c7-e5dd-434a-92f1-49f5bdcfb9a5 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:55.019760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-ac70f46d-7a37-4533-aa96-35f104d7eae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:55.019760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:55.019760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:55.019760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:55.019760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:55.019760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:55.019760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:55.019760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:55.019760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:55.019760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:55.019760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:55.019760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:55.019760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:55.019760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:55.019760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:55.020774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:55.020774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:55.020774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:55.020774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:55.020774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:55.020774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:55.020774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:55.020774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:55.020774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:55.020774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:55.020774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:55.020774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:55.020774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:55.020774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:55.020774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:55.020774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:55.020774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:55.021731 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:55.021731 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:55.021731 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:55.021731 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:55.022678 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 430/853] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:55.026604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209316c7-e5dd-434a-92f1-49f5bdcfb9a5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:55.026761 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 424/854] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:42:55.027272 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47f9c5-dedc-4a0e-9485-6921c90a508e None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:55.027633 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47f9c5-dedc-4a0e-9485-6921c90a508e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:55.027980 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47f9c5-dedc-4a0e-9485-6921c90a508e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:55.049487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-df47f9c5-dedc-4a0e-9485-6921c90a508e None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:55.050788 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-df47f9c5-dedc-4a0e-9485-6921c90a508e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:55.084174 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:55.117327 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:55.127467 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 425/855] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:42:55.128485 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47f9c5-dedc-4a0e-9485-6921c90a508e None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:55.146350 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209316c7-e5dd-434a-92f1-49f5bdcfb9a5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:55.184254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb84a8-d1b6-415b-ac42-00bd631577da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:55.185223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb84a8-d1b6-415b-ac42-00bd631577da None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:55.185555 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb84a8-d1b6-415b-ac42-00bd631577da None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:55.185843 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb84a8-d1b6-415b-ac42-00bd631577da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:55.192949 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb84a8-d1b6-415b-ac42-00bd631577da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:55.194605 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb84a8-d1b6-415b-ac42-00bd631577da None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:55.205683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-68bb84a8-d1b6-415b-ac42-00bd631577da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:55.205683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:55.205683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:55.205683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:55.205683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:55.205683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:55.205683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:55.205683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:55.205683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:55.205683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:55.205683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:55.205683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:55.205683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:55.205683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:55.205683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:55.206543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:55.206543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:55.206543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:55.206543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:55.206543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:55.206543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:55.206543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:55.206543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:55.206543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:55.206543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:55.206543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:55.206543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:55.206543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:55.206543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:55.206543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:55.206543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:55.206543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:55.207425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:55.207425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:55.207425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:55.207425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:55.207425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:55.207425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:55.207425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:55.207425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:55.207425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 431/856] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:55.207953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb84a8-d1b6-415b-ac42-00bd631577da None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:55.245628 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47f9c5-dedc-4a0e-9485-6921c90a508e None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:55.283303 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e8aa4-b441-42c0-99ee-805bae6c8af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:55.283973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e8aa4-b441-42c0-99ee-805bae6c8af6 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:55.284340 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e8aa4-b441-42c0-99ee-805bae6c8af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:55.284726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e8aa4-b441-42c0-99ee-805bae6c8af6 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:55.285532 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e8aa4-b441-42c0-99ee-805bae6c8af6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:55.286079 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e8aa4-b441-42c0-99ee-805bae6c8af6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:55.287691 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e8aa4-b441-42c0-99ee-805bae6c8af6 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:55.303376 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 426/857] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:55.304110 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e8aa4-b441-42c0-99ee-805bae6c8af6 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:55.327996 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb84a8-d1b6-415b-ac42-00bd631577da None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:55.335916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:55.363967 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f64777-f9bc-4960-8c30-275e1269c1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:55.365227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f64777-f9bc-4960-8c30-275e1269c1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:55.365511 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f64777-f9bc-4960-8c30-275e1269c1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:55.365789 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f64777-f9bc-4960-8c30-275e1269c1c4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:55.366424 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f64777-f9bc-4960-8c30-275e1269c1c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:55.367792 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f64777-f9bc-4960-8c30-275e1269c1c4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:55.377285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-96f64777-f9bc-4960-8c30-275e1269c1c4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:42:55.377285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:55.377285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:42:55.377285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:42:55.377285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:42:55.377285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:42:55.377285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:42:55.377285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:42:55.377285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:42:55.377285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:55.377285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:42:55.377285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:55.377285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:55.377285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:55.377285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:55.377285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:55.378207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:55.378207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:55.378207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:55.378207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:55.378207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:55.378207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:55.378207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:55.378207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:42:55.378207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:42:55.378207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:42:55.378207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:42:55.378207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:55.378207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:55.378207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:55.378207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:55.378207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:55.379082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:55.379082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:55.379082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:55.379082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:55.379082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:55.379082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:55.379082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:55.379082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:55.379082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:55.379082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:55.379082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:55.379082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:42:55.379082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:42:55.379082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:42:55.379082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:55.379082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 432/858] 10.222.0.96 () {56 vars in 1132 bytes} [Thu Jul 28 17:42:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:55.380091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f64777-f9bc-4960-8c30-275e1269c1c4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:55.392039 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:55.415835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e8aa4-b441-42c0-99ee-805bae6c8af6 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:55.452218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8af40a-43f7-4097-a83f-467a2a0f4d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:55.454367 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8af40a-43f7-4097-a83f-467a2a0f4d8d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:55.454367 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8af40a-43f7-4097-a83f-467a2a0f4d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:55.455509 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8af40a-43f7-4097-a83f-467a2a0f4d8d None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:55.456280 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8af40a-43f7-4097-a83f-467a2a0f4d8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:55.456588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8af40a-43f7-4097-a83f-467a2a0f4d8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:55.459074 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8af40a-43f7-4097-a83f-467a2a0f4d8d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:55.476717 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 427/859] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:55.476717 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8af40a-43f7-4097-a83f-467a2a0f4d8d None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:55.499828 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f64777-f9bc-4960-8c30-275e1269c1c4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:55.538867 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d34ef-d593-4777-a76b-f307a307923b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:55.539433 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d34ef-d593-4777-a76b-f307a307923b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:55.539775 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d34ef-d593-4777-a76b-f307a307923b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:55.539989 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d34ef-d593-4777-a76b-f307a307923b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:55.548103 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d34ef-d593-4777-a76b-f307a307923b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:55.549607 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d34ef-d593-4777-a76b-f307a307923b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:55.561502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-fd4d34ef-d593-4777-a76b-f307a307923b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:42:55.561502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:55.561502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:55.561502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:55.561502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:55.561502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:55.561502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:55.561502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:55.561502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:55.561502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:55.561502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:55.561502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:55.561502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:42:55.561502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:42:55.561502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:42:55.561502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:42:55.562451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:55.562451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:55.562451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:42:55.562451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:55.562451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:42:55.562451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:42:55.562451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:55.562451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:55.562451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:55.562451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:55.562451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:55.562451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:55.562451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:55.562451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:55.562451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:55.562451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:55.562451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:55.562451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:55.563388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:55.563388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:55.563388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:42:55.563388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:42:55.563388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:42:55.563388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:42:55.563388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:42:55.563388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:42:55.563388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:42:55.563388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:55.563388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 433/860] 10.222.0.96 () {56 vars in 1117 bytes} [Thu Jul 28 17:42:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:55.563954 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d34ef-d593-4777-a76b-f307a307923b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:55.565402 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:55.581798 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8af40a-43f7-4097-a83f-467a2a0f4d8d None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:55.618294 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b4115-4828-4086-a01d-fd0530ac1505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:55.619014 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b4115-4828-4086-a01d-fd0530ac1505 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:55.619358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b4115-4828-4086-a01d-fd0530ac1505 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:55.619691 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b4115-4828-4086-a01d-fd0530ac1505 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:55.620308 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b4115-4828-4086-a01d-fd0530ac1505 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:55.620619 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b4115-4828-4086-a01d-fd0530ac1505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:55.622022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b4115-4828-4086-a01d-fd0530ac1505 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:55.627697 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 428/861] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Jul 28 17:42:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:55.628785 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b4115-4828-4086-a01d-fd0530ac1505 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:55.636585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:55.676801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d34ef-d593-4777-a76b-f307a307923b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:55.713350 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a08b6-83b5-40d7-9aa2-ea2298a9a101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:55.713968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a08b6-83b5-40d7-9aa2-ea2298a9a101 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:55.714245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a08b6-83b5-40d7-9aa2-ea2298a9a101 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:55.714514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a08b6-83b5-40d7-9aa2-ea2298a9a101 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:55.715291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a08b6-83b5-40d7-9aa2-ea2298a9a101 None admin] RBAC: Adding query filter params (role.id=980cae90acae42189f92fd6dd42867a5, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=4ea1a9023eaf427f96f86af909a803fd) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:55.715595 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a08b6-83b5-40d7-9aa2-ea2298a9a101 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:55.717017 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a08b6-83b5-40d7-9aa2-ea2298a9a101 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:55.729111 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 434/862] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:42:55 2022] GET /identity/v3/role_assignments?user.id=4ea1a9023eaf427f96f86af909a803fd&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=980cae90acae42189f92fd6dd42867a5 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:55.729111 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a08b6-83b5-40d7-9aa2-ea2298a9a101 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:55.756445 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b4115-4828-4086-a01d-fd0530ac1505 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:55.809049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a493b2-5ba0-40e6-81de-f0e52c74d5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:55.809959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a493b2-5ba0-40e6-81de-f0e52c74d5bd None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:55.810385 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a493b2-5ba0-40e6-81de-f0e52c74d5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:55.810796 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a493b2-5ba0-40e6-81de-f0e52c74d5bd None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:55.811789 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a493b2-5ba0-40e6-81de-f0e52c74d5bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:55.812239 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a493b2-5ba0-40e6-81de-f0e52c74d5bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:55.814680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a493b2-5ba0-40e6-81de-f0e52c74d5bd None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:55.846539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 429/863] 10.222.0.96 () {56 vars in 1149 bytes} [Thu Jul 28 17:42:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:55.847338 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a08b6-83b5-40d7-9aa2-ea2298a9a101 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:55.848511 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a493b2-5ba0-40e6-81de-f0e52c74d5bd None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:55.866849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:55.886145 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:55.894043 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6bb49-12d3-4006-aa56-a1682fa9a25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:55.895386 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6bb49-12d3-4006-aa56-a1682fa9a25c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:55.895662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6bb49-12d3-4006-aa56-a1682fa9a25c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:55.895978 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6bb49-12d3-4006-aa56-a1682fa9a25c None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:55.896664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6bb49-12d3-4006-aa56-a1682fa9a25c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:55.896958 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6bb49-12d3-4006-aa56-a1682fa9a25c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:55.898396 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6bb49-12d3-4006-aa56-a1682fa9a25c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:55.909176 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 435/864] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Jul 28 17:42:55 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:55.977206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a493b2-5ba0-40e6-81de-f0e52c74d5bd None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:56.015849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773670f4-d381-4aa5-946b-db47f57ed6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:56.016506 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773670f4-d381-4aa5-946b-db47f57ed6be None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:56.016783 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773670f4-d381-4aa5-946b-db47f57ed6be None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:56.017073 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773670f4-d381-4aa5-946b-db47f57ed6be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:56.096287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773670f4-d381-4aa5-946b-db47f57ed6be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:56.097717 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773670f4-d381-4aa5-946b-db47f57ed6be None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:56.110207 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:56.205895 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 430/865] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:42:55 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 17:42:56.211737 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6bb49-12d3-4006-aa56-a1682fa9a25c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:56.316960 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6bb49-12d3-4006-aa56-a1682fa9a25c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:56.351860 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184ff85-cac9-4de8-97d0-09eb21ff4339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:56.352622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184ff85-cac9-4de8-97d0-09eb21ff4339 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:56.352837 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184ff85-cac9-4de8-97d0-09eb21ff4339 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:56.353137 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184ff85-cac9-4de8-97d0-09eb21ff4339 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:56.365286 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184ff85-cac9-4de8-97d0-09eb21ff4339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:56.366738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184ff85-cac9-4de8-97d0-09eb21ff4339 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:56.381907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-a184ff85-cac9-4de8-97d0-09eb21ff4339 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:56.381907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:56.381907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:56.381907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:56.381907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:56.381907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:56.381907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:56.381907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:56.381907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:56.381907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:56.381907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:56.381907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:56.381907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:56.381907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:56.381907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:56.382866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:56.382866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:56.382866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:56.382866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:56.382866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:56.382866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:56.382866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:56.382866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:56.382866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:56.382866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:56.382866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:56.382866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:56.382866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:56.382866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:56.382866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:56.382866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:56.382866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:56.383737 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:56.383737 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:56.383737 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:56.383737 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:56.383737 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 436/866] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:56.389510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773670f4-d381-4aa5-946b-db47f57ed6be None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:56.437354 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bdc28-bdd0-4455-917e-d260297539b0 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:56.437633 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bdc28-bdd0-4455-917e-d260297539b0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:56.437914 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bdc28-bdd0-4455-917e-d260297539b0 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:56.439634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 437/867] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:56.451702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfec5e-5a32-4437-b1c9-f9c91f3fc67c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:56.452112 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfec5e-5a32-4437-b1c9-f9c91f3fc67c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:56.452481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfec5e-5a32-4437-b1c9-f9c91f3fc67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:56.475057 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d0dfec5e-5a32-4437-b1c9-f9c91f3fc67c None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:56.476604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d0dfec5e-5a32-4437-b1c9-f9c91f3fc67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:56.505788 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773670f4-d381-4aa5-946b-db47f57ed6be None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:56.525437 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:56.527435 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:56.543417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed1051-6247-4126-bffc-3586a20347bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:56.544407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed1051-6247-4126-bffc-3586a20347bc None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:56.544901 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed1051-6247-4126-bffc-3586a20347bc None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:56.545571 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed1051-6247-4126-bffc-3586a20347bc None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:56.546448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed1051-6247-4126-bffc-3586a20347bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:56.546938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed1051-6247-4126-bffc-3586a20347bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:56.548486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed1051-6247-4126-bffc-3586a20347bc None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:56.563311 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 438/868] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:42:56.568023 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 431/869] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:56.574174 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfec5e-5a32-4437-b1c9-f9c91f3fc67c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:56.581201 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed1051-6247-4126-bffc-3586a20347bc None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:56.680235 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfec5e-5a32-4437-b1c9-f9c91f3fc67c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:56.682769 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed1051-6247-4126-bffc-3586a20347bc None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:56.717149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da211d9-ca8b-4b3f-861e-384826603f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:56.717801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da211d9-ca8b-4b3f-861e-384826603f86 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:56.718079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da211d9-ca8b-4b3f-861e-384826603f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:56.718353 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da211d9-ca8b-4b3f-861e-384826603f86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:56.718844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48b7c6-ef7e-4518-bfe1-f653c1dac647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:56.719678 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48b7c6-ef7e-4518-bfe1-f653c1dac647 None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:56.720143 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48b7c6-ef7e-4518-bfe1-f653c1dac647 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:56.720601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48b7c6-ef7e-4518-bfe1-f653c1dac647 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:56.721525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48b7c6-ef7e-4518-bfe1-f653c1dac647 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:56.723082 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48b7c6-ef7e-4518-bfe1-f653c1dac647 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:56.725801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da211d9-ca8b-4b3f-861e-384826603f86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:56.727257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da211d9-ca8b-4b3f-861e-384826603f86 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:56.740682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-5da211d9-ca8b-4b3f-861e-384826603f86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:56.740682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:56.740682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:56.740682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:56.740682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:56.740682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:56.740682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:56.740682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:56.740682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:56.740682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:56.740682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:56.740682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:56.740682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:42:56.740682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:42:56.740682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:42:56.741660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:42:56.741660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:56.741660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:56.741660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:56.741660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:56.741660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:56.741660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:56.741660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:56.741660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:56.741660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:56.741660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:56.741660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:56.741660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:56.741660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:56.741660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:56.741660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:56.741660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:56.742571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:42:56.742571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:42:56.742571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:42:56.742571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:42:56.742571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:42:56.742571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:42:56.742571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:42:56.742571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:56.753189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 439/870] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:42:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:56.753189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da211d9-ca8b-4b3f-861e-384826603f86 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:56.754006 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 432/871] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Jul 28 17:42:56 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:42:56.794740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:56.862426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da211d9-ca8b-4b3f-861e-384826603f86 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:56.906317 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c80d9-159f-47c6-b77c-cf8d101559fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:56.906952 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c80d9-159f-47c6-b77c-cf8d101559fc None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:56.907231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c80d9-159f-47c6-b77c-cf8d101559fc None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:56.907508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c80d9-159f-47c6-b77c-cf8d101559fc None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:56.908323 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c80d9-159f-47c6-b77c-cf8d101559fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:56.908624 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c80d9-159f-47c6-b77c-cf8d101559fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:56.910146 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c80d9-159f-47c6-b77c-cf8d101559fc None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:56.922813 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 440/872] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:42:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:56.929165 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48b7c6-ef7e-4518-bfe1-f653c1dac647 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:56.962444 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:57.041514 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48b7c6-ef7e-4518-bfe1-f653c1dac647 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:57.078214 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55138ec-cade-4db8-b66a-653f5e5ebd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:57.078835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55138ec-cade-4db8-b66a-653f5e5ebd39 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:57.079113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55138ec-cade-4db8-b66a-653f5e5ebd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:57.079445 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55138ec-cade-4db8-b66a-653f5e5ebd39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:57.080244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55138ec-cade-4db8-b66a-653f5e5ebd39 None admin] RBAC: Adding query filter params (role.id=f8cbbf969cfc442595755799825094f6, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=a1936a2649c349d481f56304b3ee55b3) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:57.080553 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55138ec-cade-4db8-b66a-653f5e5ebd39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:57.082121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55138ec-cade-4db8-b66a-653f5e5ebd39 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:57.088864 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 433/873] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:42:56 2022] GET /identity/v3/role_assignments?user.id=a1936a2649c349d481f56304b3ee55b3&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=f8cbbf969cfc442595755799825094f6 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:57.902615 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a743986-23ee-4827-b3bc-e5ed9cbe5d5f None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:57.903141 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a743986-23ee-4827-b3bc-e5ed9cbe5d5f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:57.903141 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a743986-23ee-4827-b3bc-e5ed9cbe5d5f None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:57.904764 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 441/874] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:57.912483 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942414f-123b-4e12-8737-3384d603d8ce None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:57.912770 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942414f-123b-4e12-8737-3384d603d8ce None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:57.913049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942414f-123b-4e12-8737-3384d603d8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:57.931795 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-2942414f-123b-4e12-8737-3384d603d8ce None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:57.933962 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-2942414f-123b-4e12-8737-3384d603d8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:58.006370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 434/875] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:57 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:42:58.028739 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a743986-23ee-4827-b3bc-e5ed9cbe5d5f None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:58.055625 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf28e7-acc8-4ad5-881e-1ff3c84ebb6f None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:58.055952 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf28e7-acc8-4ad5-881e-1ff3c84ebb6f None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:58.056183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf28e7-acc8-4ad5-881e-1ff3c84ebb6f None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:58.057816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 435/876] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:58.062582 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a6017-64a0-4a45-a106-3d5fae0a7c5f None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:58.062861 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a6017-64a0-4a45-a106-3d5fae0a7c5f None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:58.063143 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a6017-64a0-4a45-a106-3d5fae0a7c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:58.081385 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-348a6017-64a0-4a45-a106-3d5fae0a7c5f None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:58.082563 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-348a6017-64a0-4a45-a106-3d5fae0a7c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:58.100684 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:58.132108 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:58.138875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a743986-23ee-4827-b3bc-e5ed9cbe5d5f None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:58.165271 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 436/877] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:58 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:42:58.182110 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb80363-abd6-442a-9db4-bdf1d6cc66d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:58.182901 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb80363-abd6-442a-9db4-bdf1d6cc66d7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:58.183252 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb80363-abd6-442a-9db4-bdf1d6cc66d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:58.183591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb80363-abd6-442a-9db4-bdf1d6cc66d7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:58.184292 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb80363-abd6-442a-9db4-bdf1d6cc66d7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:58.186705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a6017-64a0-4a45-a106-3d5fae0a7c5f None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:58.188981 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb80363-abd6-442a-9db4-bdf1d6cc66d7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:58.198716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-ffb80363-abd6-442a-9db4-bdf1d6cc66d7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:42:58.198716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:58.198716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:42:58.198716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:42:58.198716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:42:58.198716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:42:58.198716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:42:58.198716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:42:58.198716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:42:58.198716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:58.198716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:42:58.198716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:58.198716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:58.198716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:58.198716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:58.198716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:58.198716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:58.199846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:58.199846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:58.199846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:58.199846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:58.199846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:58.199846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:58.199846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:42:58.199846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:42:58.199846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:42:58.199846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:42:58.199846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:58.199846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:58.199846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:58.199846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:58.199846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:58.199846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:58.200924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:58.200924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:58.200924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:58.200924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:58.200924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:58.200924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:58.200924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:58.200924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:58.200924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:58.200924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:58.200924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:42:58.200924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:42:58.200924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:42:58.200924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:58.200924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 442/878] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Jul 28 17:42:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:58.206037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb80363-abd6-442a-9db4-bdf1d6cc66d7 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:58.308451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a6017-64a0-4a45-a106-3d5fae0a7c5f None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:58.328232 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb80363-abd6-442a-9db4-bdf1d6cc66d7 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:58.355033 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a6bcc-4078-476b-bbac-af3a99a9c512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:58.356145 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a6bcc-4078-476b-bbac-af3a99a9c512 None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:58.356575 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a6bcc-4078-476b-bbac-af3a99a9c512 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:58.357363 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a6bcc-4078-476b-bbac-af3a99a9c512 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:58.358492 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a6bcc-4078-476b-bbac-af3a99a9c512 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:58.360896 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a6bcc-4078-476b-bbac-af3a99a9c512 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:58.367723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310c126-2a9f-466f-810b-ade88f0c5206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:58.368402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310c126-2a9f-466f-810b-ade88f0c5206 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:58.368717 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310c126-2a9f-466f-810b-ade88f0c5206 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:58.369010 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310c126-2a9f-466f-810b-ade88f0c5206 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:58.369809 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310c126-2a9f-466f-810b-ade88f0c5206 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:58.370129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310c126-2a9f-466f-810b-ade88f0c5206 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:58.371595 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310c126-2a9f-466f-810b-ade88f0c5206 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:58.377308 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 443/879] 10.222.0.96 () {56 vars in 1122 bytes} [Thu Jul 28 17:42:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:58.381496 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 437/880] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Jul 28 17:42:58 2022] POST /identity/v3/services => generated 269 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:42:58.386237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310c126-2a9f-466f-810b-ade88f0c5206 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:58.422041 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:58.508448 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310c126-2a9f-466f-810b-ade88f0c5206 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:58.556338 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38046d3d-52ee-402e-8554-dae4413d79f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:58.556975 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38046d3d-52ee-402e-8554-dae4413d79f3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:58.557286 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38046d3d-52ee-402e-8554-dae4413d79f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:58.557559 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38046d3d-52ee-402e-8554-dae4413d79f3 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:58.558239 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38046d3d-52ee-402e-8554-dae4413d79f3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:58.558540 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38046d3d-52ee-402e-8554-dae4413d79f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:58.559923 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38046d3d-52ee-402e-8554-dae4413d79f3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:58.565272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 444/881] 10.222.0.96 () {56 vars in 1122 bytes} [Thu Jul 28 17:42:58 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:58.917673 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bfaa3-923c-4f94-9960-2cb9673da720 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:58.917954 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bfaa3-923c-4f94-9960-2cb9673da720 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:58.918491 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bfaa3-923c-4f94-9960-2cb9673da720 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:58.920306 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 438/882] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:58.925793 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0329d-37c9-419a-afb8-1141a7290922 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:58.926702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0329d-37c9-419a-afb8-1141a7290922 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:58.927175 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0329d-37c9-419a-afb8-1141a7290922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:58.945799 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-cff0329d-37c9-419a-afb8-1141a7290922 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:58.947294 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-cff0329d-37c9-419a-afb8-1141a7290922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:59.021817 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 445/883] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:42:59.050283 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bfaa3-923c-4f94-9960-2cb9673da720 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:59.067101 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:59.159339 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bfaa3-923c-4f94-9960-2cb9673da720 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:59.196900 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39640b14-3020-4843-9a66-72150f61ddff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:59.197507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39640b14-3020-4843-9a66-72150f61ddff None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:59.197785 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39640b14-3020-4843-9a66-72150f61ddff None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:59.198063 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39640b14-3020-4843-9a66-72150f61ddff None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:59.198699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39640b14-3020-4843-9a66-72150f61ddff None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:59.200086 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39640b14-3020-4843-9a66-72150f61ddff None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:59.209970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-39640b14-3020-4843-9a66-72150f61ddff None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:42:59.209970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:59.209970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:42:59.209970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:42:59.209970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:42:59.209970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:42:59.209970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:42:59.209970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:42:59.209970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:42:59.209970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:59.209970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:42:59.209970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:59.209970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:59.209970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:59.209970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:59.209970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:59.209970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:59.210972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:59.210972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:59.210972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:59.210972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:59.210972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:59.210972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:59.210972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:42:59.210972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:42:59.210972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:42:59.210972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:42:59.210972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:59.210972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:59.210972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:59.210972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:59.210972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:59.210972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:59.212236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:59.212236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:59.212236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:59.212236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:59.212236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:59.212236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:59.212236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:59.212236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:59.212236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:59.212236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:59.212236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:42:59.212236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:42:59.212236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:42:59.212236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:42:59.212236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 439/884] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:42:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:59.217509 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0329d-37c9-419a-afb8-1141a7290922 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:59.231888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:59.258605 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050252ae-2f4c-4320-ae2d-b1c8594c322d None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:59.259255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050252ae-2f4c-4320-ae2d-b1c8594c322d None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:59.259732 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050252ae-2f4c-4320-ae2d-b1c8594c322d None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:59.262061 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 440/885] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:42:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:42:59.267133 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6c97a-43ee-4834-924c-8cb127be907a None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:59.267415 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6c97a-43ee-4834-924c-8cb127be907a None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:59.267692 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6c97a-43ee-4834-924c-8cb127be907a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:59.286113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-10c6c97a-43ee-4834-924c-8cb127be907a None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:42:59.287824 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-10c6c97a-43ee-4834-924c-8cb127be907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:42:59.323204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0329d-37c9-419a-afb8-1141a7290922 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:59.365085 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 441/886] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:42:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:42:59.365279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc9aba-f4a2-4a96-92f6-2b21bc252405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:59.365755 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc9aba-f4a2-4a96-92f6-2b21bc252405 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:59.366038 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc9aba-f4a2-4a96-92f6-2b21bc252405 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:59.366314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc9aba-f4a2-4a96-92f6-2b21bc252405 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:59.367002 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc9aba-f4a2-4a96-92f6-2b21bc252405 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:59.367306 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc9aba-f4a2-4a96-92f6-2b21bc252405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:59.368758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc9aba-f4a2-4a96-92f6-2b21bc252405 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:59.374194 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 446/887] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:42:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:59.379807 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6c97a-43ee-4834-924c-8cb127be907a None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:59.388374 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc9aba-f4a2-4a96-92f6-2b21bc252405 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:59.391201 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:59.486948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:59.502840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6c97a-43ee-4834-924c-8cb127be907a None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:59.511665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc9aba-f4a2-4a96-92f6-2b21bc252405 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:59.539967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd62897-11c3-4ea8-9f6e-0bdef7d51be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:59.540871 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd62897-11c3-4ea8-9f6e-0bdef7d51be7 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:59.541487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd62897-11c3-4ea8-9f6e-0bdef7d51be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:59.541960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd62897-11c3-4ea8-9f6e-0bdef7d51be7 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:59.542977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd62897-11c3-4ea8-9f6e-0bdef7d51be7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:59.543596 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd62897-11c3-4ea8-9f6e-0bdef7d51be7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:59.545291 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd62897-11c3-4ea8-9f6e-0bdef7d51be7 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:59.549311 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a27dd8-8576-48cb-9ded-1ffb8e7d5353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:59.550145 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a27dd8-8576-48cb-9ded-1ffb8e7d5353 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:59.550573 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a27dd8-8576-48cb-9ded-1ffb8e7d5353 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:59.551016 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a27dd8-8576-48cb-9ded-1ffb8e7d5353 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:59.555918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 442/888] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:42:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:59.556915 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd62897-11c3-4ea8-9f6e-0bdef7d51be7 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:59.572111 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a27dd8-8576-48cb-9ded-1ffb8e7d5353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:42:59.578619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-50a27dd8-8576-48cb-9ded-1ffb8e7d5353 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:42:59.578619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:59.578619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:59.578619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:59.578619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:59.578619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:59.578619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:59.578619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:59.578619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:59.578619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:59.578619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:59.578619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:59.578619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:42:59.578619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:42:59.578619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:42:59.578619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:42:59.579698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:42:59.579698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:42:59.579698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:42:59.579698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:42:59.579698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:59.579698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:59.579698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:59.579698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:59.579698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:59.579698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:59.579698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:59.579698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:59.579698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:59.579698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:59.579698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:59.579698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:59.580524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:59.580524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:59.580524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:59.580524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:59.580524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:42:59.580524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:42:59.580524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:42:59.580524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:42:59.580524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:42:59.580524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:42:59.580524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:42:59.580524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:59.585230 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 447/889] 10.222.0.96 () {56 vars in 1120 bytes} [Thu Jul 28 17:42:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:59.586101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a27dd8-8576-48cb-9ded-1ffb8e7d5353 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:59.653022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:59.686356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd62897-11c3-4ea8-9f6e-0bdef7d51be7 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:59.704286 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a27dd8-8576-48cb-9ded-1ffb8e7d5353 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:59.726782 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0eb2d-1c93-42d5-9754-3490689dffc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:59.727448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0eb2d-1c93-42d5-9754-3490689dffc2 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:59.727716 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0eb2d-1c93-42d5-9754-3490689dffc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:59.727989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0eb2d-1c93-42d5-9754-3490689dffc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:59.728752 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0eb2d-1c93-42d5-9754-3490689dffc2 None admin] RBAC: Adding query filter params (interface=public, service_id=7545c110e57f411c8d23fec33dd80643, region_id=RegionOne) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:59.729078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0eb2d-1c93-42d5-9754-3490689dffc2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:59.730592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0eb2d-1c93-42d5-9754-3490689dffc2 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:59.740991 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 443/890] 10.222.0.96 () {56 vars in 1251 bytes} [Thu Jul 28 17:42:59 2022] GET /identity/v3/endpoints?service_id=7545c110e57f411c8d23fec33dd80643&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:42:59.741950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0eb2d-1c93-42d5-9754-3490689dffc2 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:59.751737 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801a0c0-3cf3-4a9d-a9ef-8bddff48d9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:59.752363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801a0c0-3cf3-4a9d-a9ef-8bddff48d9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:59.752640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801a0c0-3cf3-4a9d-a9ef-8bddff48d9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:59.752912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801a0c0-3cf3-4a9d-a9ef-8bddff48d9a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:59.754190 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801a0c0-3cf3-4a9d-a9ef-8bddff48d9a4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:42:59.754549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801a0c0-3cf3-4a9d-a9ef-8bddff48d9a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:59.755985 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801a0c0-3cf3-4a9d-a9ef-8bddff48d9a4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:59.759435 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:59.773138 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 448/891] 10.222.0.96 () {56 vars in 1115 bytes} [Thu Jul 28 17:42:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:42:59.775045 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801a0c0-3cf3-4a9d-a9ef-8bddff48d9a4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:42:59.873629 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0eb2d-1c93-42d5-9754-3490689dffc2 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:59.903599 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801a0c0-3cf3-4a9d-a9ef-8bddff48d9a4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:42:59.911112 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66fd8f-e992-4a54-87ee-5ccf8c66f97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:59.912001 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66fd8f-e992-4a54-87ee-5ccf8c66f97a None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:59.912497 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66fd8f-e992-4a54-87ee-5ccf8c66f97a None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:59.912988 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66fd8f-e992-4a54-87ee-5ccf8c66f97a None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:59.913862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66fd8f-e992-4a54-87ee-5ccf8c66f97a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:59.915422 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66fd8f-e992-4a54-87ee-5ccf8c66f97a None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:59.917509 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:42:59.923085 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 444/892] 10.222.0.96 () {56 vars in 1087 bytes} [Thu Jul 28 17:42:59 2022] GET /identity/v3/services => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:42:59.948194 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa7e76-4c4f-4b38-ab3b-35908680afed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:42:59.949679 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa7e76-4c4f-4b38-ab3b-35908680afed None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:42:59.950280 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa7e76-4c4f-4b38-ab3b-35908680afed None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:42:59.950766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa7e76-4c4f-4b38-ab3b-35908680afed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:42:59.964261 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa7e76-4c4f-4b38-ab3b-35908680afed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:42:59.966279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa7e76-4c4f-4b38-ab3b-35908680afed None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:42:59.982969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-36aa7e76-4c4f-4b38-ab3b-35908680afed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:59.982969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:42:59.982969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:42:59.982969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:42:59.982969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:42:59.982969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:42:59.982969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:42:59.982969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:42:59.982969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:42:59.982969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:42:59.982969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:42:59.982969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:42:59.982969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:42:59.982969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:42:59.982969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:42:59.983917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:42:59.983917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:42:59.983917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:42:59.983917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:42:59.983917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:42:59.983917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:42:59.983917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:42:59.983917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:42:59.983917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:42:59.983917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:42:59.983917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:42:59.983917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:42:59.983917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:42:59.983917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:42:59.983917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:42:59.983917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:42:59.983917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:42:59.984801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:42:59.984801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:42:59.984801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:42:59.984801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:42:59.987311 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 449/893] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:42:59.993708 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66fd8f-e992-4a54-87ee-5ccf8c66f97a None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:00.105436 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66fd8f-e992-4a54-87ee-5ccf8c66f97a None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:00.144992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db6628-f2f7-4e1f-b8ed-6fb7a87687b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:00.146124 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db6628-f2f7-4e1f-b8ed-6fb7a87687b2 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:00.146606 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db6628-f2f7-4e1f-b8ed-6fb7a87687b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:00.147108 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db6628-f2f7-4e1f-b8ed-6fb7a87687b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:00.148020 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db6628-f2f7-4e1f-b8ed-6fb7a87687b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:00.148524 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db6628-f2f7-4e1f-b8ed-6fb7a87687b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:00.150149 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db6628-f2f7-4e1f-b8ed-6fb7a87687b2 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:00.162894 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 445/894] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:00.168261 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa7e76-4c4f-4b38-ab3b-35908680afed None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:00.224218 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:00.277195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa7e76-4c4f-4b38-ab3b-35908680afed None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:00.312157 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f03fb-1b00-45c4-9895-2460f8e5374f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:00.312800 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f03fb-1b00-45c4-9895-2460f8e5374f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:00.313101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f03fb-1b00-45c4-9895-2460f8e5374f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:00.313383 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f03fb-1b00-45c4-9895-2460f8e5374f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:00.321989 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f03fb-1b00-45c4-9895-2460f8e5374f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:00.323443 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f03fb-1b00-45c4-9895-2460f8e5374f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:00.335305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-962f03fb-1b00-45c4-9895-2460f8e5374f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:43:00.335305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:00.335305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:00.335305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:00.335305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:00.335305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:00.335305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:00.335305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:00.335305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:00.335305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:00.335305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:00.335305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:00.335305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:43:00.335305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:43:00.335305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:43:00.335305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:43:00.336268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:00.336268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:00.336268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:43:00.336268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:43:00.336268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:43:00.336268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:43:00.336268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:00.336268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:00.336268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:00.336268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:00.336268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:00.336268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:00.336268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:00.336268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:00.336268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:00.336268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:00.336268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:00.336268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:00.337273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:00.337273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:00.337273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:43:00.337273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:43:00.337273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:43:00.337273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:43:00.337273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:43:00.337273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:43:00.337273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:43:00.337273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:00.337273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 450/895] 10.222.0.96 () {56 vars in 1117 bytes} [Thu Jul 28 17:43:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:43:00.346147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db6628-f2f7-4e1f-b8ed-6fb7a87687b2 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:00.409251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:00.453443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db6628-f2f7-4e1f-b8ed-6fb7a87687b2 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:00.489457 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2905f-e273-4462-a4f3-2b63ec1b61a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:00.490139 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2905f-e273-4462-a4f3-2b63ec1b61a3 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:00.490422 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2905f-e273-4462-a4f3-2b63ec1b61a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:00.490697 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2905f-e273-4462-a4f3-2b63ec1b61a3 None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:00.491496 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2905f-e273-4462-a4f3-2b63ec1b61a3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:00.491801 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2905f-e273-4462-a4f3-2b63ec1b61a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:00.493259 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2905f-e273-4462-a4f3-2b63ec1b61a3 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:00.514276 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 446/896] 10.222.0.96 () {56 vars in 1149 bytes} [Thu Jul 28 17:43:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:00.520346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f03fb-1b00-45c4-9895-2460f8e5374f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:00.544208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d67748-f9ff-498f-8991-6cb3c1689a70 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:00.544498 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d67748-f9ff-498f-8991-6cb3c1689a70 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:00.544682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d67748-f9ff-498f-8991-6cb3c1689a70 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:00.546581 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 447/897] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:00.552158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf4055-4fa6-4b28-b010-07eb3bdb6ebc None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:00.552600 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf4055-4fa6-4b28-b010-07eb3bdb6ebc None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:00.552881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf4055-4fa6-4b28-b010-07eb3bdb6ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:00.573271 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-a8bf4055-4fa6-4b28-b010-07eb3bdb6ebc None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:00.575044 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-a8bf4055-4fa6-4b28-b010-07eb3bdb6ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:00.627358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f03fb-1b00-45c4-9895-2460f8e5374f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:00.639081 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:00.650460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 448/898] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:43:00.652874 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2deaa0-03c8-47cc-ba7a-b80780ec3eb7 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:00.653397 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2deaa0-03c8-47cc-ba7a-b80780ec3eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:00.654148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2deaa0-03c8-47cc-ba7a-b80780ec3eb7 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:00.656580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 449/899] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:00.661886 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810458d-bbc6-46da-a445-e3e90daba5f3 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:00.662021 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810458d-bbc6-46da-a445-e3e90daba5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:00.662411 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810458d-bbc6-46da-a445-e3e90daba5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:00.667062 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced779a-b682-4d57-9509-4d272349f2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:00.667892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced779a-b682-4d57-9509-4d272349f2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:00.668345 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced779a-b682-4d57-9509-4d272349f2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:00.668831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced779a-b682-4d57-9509-4d272349f2f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:00.681536 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-f810458d-bbc6-46da-a445-e3e90daba5f3 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:00.682719 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f810458d-bbc6-46da-a445-e3e90daba5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:00.731955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:00.749895 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced779a-b682-4d57-9509-4d272349f2f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:00.751495 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced779a-b682-4d57-9509-4d272349f2f7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:00.765147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 450/900] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:43:00.765147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810458d-bbc6-46da-a445-e3e90daba5f3 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:00.859308 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 451/901] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:43:00 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:43:00.860132 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced779a-b682-4d57-9509-4d272349f2f7 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:00.872490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810458d-bbc6-46da-a445-e3e90daba5f3 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:00.873330 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:00.908974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafdac4-cc8b-405f-8da8-040e89b3e0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:00.909783 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafdac4-cc8b-405f-8da8-040e89b3e0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:00.910408 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafdac4-cc8b-405f-8da8-040e89b3e0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:00.910731 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafdac4-cc8b-405f-8da8-040e89b3e0b8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:00.911539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafdac4-cc8b-405f-8da8-040e89b3e0b8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:00.912906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafdac4-cc8b-405f-8da8-040e89b3e0b8 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:00.922058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-6fafdac4-cc8b-405f-8da8-040e89b3e0b8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:43:00.922058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:00.922058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:43:00.922058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:43:00.922058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:43:00.922058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:43:00.922058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:43:00.922058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:00.922058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:43:00.922058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:00.922058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:43:00.922058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:00.922058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:00.922058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:00.922058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:00.922058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:00.923009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:00.923009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:00.923009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:00.923009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:00.923009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:00.923009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:00.923009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:00.923009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:43:00.923009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:43:00.923009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:43:00.923009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:43:00.923009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:00.923009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:00.923009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:00.923009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:00.923009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:00.923835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:00.923835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:00.923835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:00.923835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:00.923835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:00.923835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:00.923835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:00.923835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:00.923835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:00.923835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:00.923835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:00.923835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:43:00.923835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:00.923835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:43:00.923835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:00.923835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 451/902] 10.222.0.96 () {56 vars in 1132 bytes} [Thu Jul 28 17:43:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:00.924664 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafdac4-cc8b-405f-8da8-040e89b3e0b8 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:00.969628 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:00.972844 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced779a-b682-4d57-9509-4d272349f2f7 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:01.007731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894056c3-d4cf-43a6-a435-0edabc8ae6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:01.008357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894056c3-d4cf-43a6-a435-0edabc8ae6e3 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:01.008811 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894056c3-d4cf-43a6-a435-0edabc8ae6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:01.008931 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894056c3-d4cf-43a6-a435-0edabc8ae6e3 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:01.009609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894056c3-d4cf-43a6-a435-0edabc8ae6e3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:01.010983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894056c3-d4cf-43a6-a435-0edabc8ae6e3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:01.032558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 452/903] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Jul 28 17:43:00 2022] POST /identity/v3/services => generated 241 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:43:01.038089 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafdac4-cc8b-405f-8da8-040e89b3e0b8 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:01.042272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894056c3-d4cf-43a6-a435-0edabc8ae6e3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:01.095745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c5e66-0b65-4ec5-8dc0-53cae8499ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:01.096862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c5e66-0b65-4ec5-8dc0-53cae8499ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:01.097389 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c5e66-0b65-4ec5-8dc0-53cae8499ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:01.097855 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c5e66-0b65-4ec5-8dc0-53cae8499ce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:01.111864 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c5e66-0b65-4ec5-8dc0-53cae8499ce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:01.114441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c5e66-0b65-4ec5-8dc0-53cae8499ce3 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:01.132022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-369c5e66-0b65-4ec5-8dc0-53cae8499ce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:01.132022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:01.132022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:01.132022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:01.132022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:01.132022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:01.132022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:01.132022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:01.132022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:01.132022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:01.132022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:01.132022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:01.132022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:43:01.132022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:43:01.132022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:43:01.133028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:43:01.133028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:01.133028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:01.133028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:01.133028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:01.133028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:01.133028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:01.133028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:01.133028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:01.133028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:01.133028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:01.133028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:01.133028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:01.133028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:01.133028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:01.133028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:01.133028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:01.133936 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:43:01.133936 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:43:01.133936 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:01.133936 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:01.136404 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 452/904] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:01.145123 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c5e66-0b65-4ec5-8dc0-53cae8499ce3 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:01.146751 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:01.176761 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894056c3-d4cf-43a6-a435-0edabc8ae6e3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:01.225932 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b708ef7-35f0-4f0b-9c9a-251011222b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:01.226587 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b708ef7-35f0-4f0b-9c9a-251011222b6a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:01.226861 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b708ef7-35f0-4f0b-9c9a-251011222b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:01.227107 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b708ef7-35f0-4f0b-9c9a-251011222b6a None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:01.227778 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b708ef7-35f0-4f0b-9c9a-251011222b6a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:01.228076 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b708ef7-35f0-4f0b-9c9a-251011222b6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:01.229596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b708ef7-35f0-4f0b-9c9a-251011222b6a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:01.236379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 453/905] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Jul 28 17:43:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:01.243490 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b708ef7-35f0-4f0b-9c9a-251011222b6a None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:01.262853 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:01.276730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c5e66-0b65-4ec5-8dc0-53cae8499ce3 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:01.325851 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8206a2-03c1-491d-a7d0-a2ac10f33a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:01.327573 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8206a2-03c1-491d-a7d0-a2ac10f33a14 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:01.328004 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8206a2-03c1-491d-a7d0-a2ac10f33a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:01.328458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8206a2-03c1-491d-a7d0-a2ac10f33a14 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:01.329393 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8206a2-03c1-491d-a7d0-a2ac10f33a14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:01.329885 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8206a2-03c1-491d-a7d0-a2ac10f33a14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:01.331405 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8206a2-03c1-491d-a7d0-a2ac10f33a14 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:01.349235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 453/906] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:01.355292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8206a2-03c1-491d-a7d0-a2ac10f33a14 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:01.363706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b708ef7-35f0-4f0b-9c9a-251011222b6a None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:01.399139 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8a7f6-70c3-41c0-8b74-cd20bdf111c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:01.399918 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8a7f6-70c3-41c0-8b74-cd20bdf111c7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:01.400333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8a7f6-70c3-41c0-8b74-cd20bdf111c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:01.400705 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8a7f6-70c3-41c0-8b74-cd20bdf111c7 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:01.401586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8a7f6-70c3-41c0-8b74-cd20bdf111c7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:01.401986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8a7f6-70c3-41c0-8b74-cd20bdf111c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:01.403456 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8a7f6-70c3-41c0-8b74-cd20bdf111c7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:01.405076 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:01.410933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 454/907] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Jul 28 17:43:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:01.416361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8a7f6-70c3-41c0-8b74-cd20bdf111c7 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:01.476015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8206a2-03c1-491d-a7d0-a2ac10f33a14 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:01.521586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1d898-3ca3-48e7-8fe4-a3cb0ffc9eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:01.522248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1d898-3ca3-48e7-8fe4-a3cb0ffc9eee None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:01.522608 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1d898-3ca3-48e7-8fe4-a3cb0ffc9eee None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:01.522911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1d898-3ca3-48e7-8fe4-a3cb0ffc9eee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:01.530591 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1d898-3ca3-48e7-8fe4-a3cb0ffc9eee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:01.532098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1d898-3ca3-48e7-8fe4-a3cb0ffc9eee None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:01.560921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-e1c1d898-3ca3-48e7-8fe4-a3cb0ffc9eee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:43:01.560921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:01.560921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:01.560921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:01.560921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:01.560921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:01.560921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:01.560921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:01.560921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:01.560921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:01.560921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:01.560921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:01.560921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:43:01.560921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:43:01.560921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:43:01.562295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:43:01.562295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:01.562295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:01.562295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:01.562295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:01.562295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:01.562295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:01.562295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:01.562295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:01.562295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:01.562295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:01.562295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:01.562295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:01.562295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:01.562295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:01.562295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:01.562295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:01.564152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:43:01.564152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:43:01.564152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:43:01.564152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:43:01.564152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:43:01.564152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:43:01.564152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:43:01.564152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:01.566159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8a7f6-70c3-41c0-8b74-cd20bdf111c7 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:01.567559 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 454/908] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:43:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:43:01.568533 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1d898-3ca3-48e7-8fe4-a3cb0ffc9eee None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:01.581954 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:01.616270 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c578e-6e40-4aac-beb2-894b77d9c44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:01.617786 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c578e-6e40-4aac-beb2-894b77d9c44b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:01.618425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c578e-6e40-4aac-beb2-894b77d9c44b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:01.618888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c578e-6e40-4aac-beb2-894b77d9c44b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:01.620100 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c578e-6e40-4aac-beb2-894b77d9c44b None admin] RBAC: Adding query filter params (interface=public, service_id=56b6c8a6a1994ddebdeca0867a15074a, region_id=RegionOne) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:01.621117 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c578e-6e40-4aac-beb2-894b77d9c44b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:01.622966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c578e-6e40-4aac-beb2-894b77d9c44b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:01.630831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 455/909] 10.222.0.96 () {56 vars in 1251 bytes} [Thu Jul 28 17:43:01 2022] GET /identity/v3/endpoints?service_id=56b6c8a6a1994ddebdeca0867a15074a&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:01.635828 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c578e-6e40-4aac-beb2-894b77d9c44b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:01.685810 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1d898-3ca3-48e7-8fe4-a3cb0ffc9eee None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:01.728415 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d24af-3421-45f0-8ede-1778fd5de92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:01.729088 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d24af-3421-45f0-8ede-1778fd5de92f None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:01.729335 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d24af-3421-45f0-8ede-1778fd5de92f None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:01.729607 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d24af-3421-45f0-8ede-1778fd5de92f None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:01.730347 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d24af-3421-45f0-8ede-1778fd5de92f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:01.730705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d24af-3421-45f0-8ede-1778fd5de92f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:01.732123 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d24af-3421-45f0-8ede-1778fd5de92f None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:01.733575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:01.745741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 455/910] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:43:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:01.751623 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d24af-3421-45f0-8ede-1778fd5de92f None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:01.789933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c578e-6e40-4aac-beb2-894b77d9c44b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:01.824140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:01.841457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694174b-be3c-49c6-bf5a-fd2302f47bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:01.842648 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694174b-be3c-49c6-bf5a-fd2302f47bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:01.843570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694174b-be3c-49c6-bf5a-fd2302f47bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:01.844044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694174b-be3c-49c6-bf5a-fd2302f47bf6 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:01.844871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694174b-be3c-49c6-bf5a-fd2302f47bf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:01.847056 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694174b-be3c-49c6-bf5a-fd2302f47bf6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:01.857291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 456/911] 10.222.0.96 () {56 vars in 1087 bytes} [Thu Jul 28 17:43:01 2022] GET /identity/v3/services => generated 1497 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:43:01.861696 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d24af-3421-45f0-8ede-1778fd5de92f None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:01.904129 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c5bc9-7bb8-453f-bee9-20af2ec36303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:01.905159 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c5bc9-7bb8-453f-bee9-20af2ec36303 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:01.905639 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c5bc9-7bb8-453f-bee9-20af2ec36303 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:01.906136 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c5bc9-7bb8-453f-bee9-20af2ec36303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:01.907152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c5bc9-7bb8-453f-bee9-20af2ec36303 None admin] RBAC: Adding query filter params (role.id=94a64ce81e2f4aea95f03b65b3903c8f, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=a1936a2649c349d481f56304b3ee55b3) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:01.907759 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c5bc9-7bb8-453f-bee9-20af2ec36303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:01.909460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c5bc9-7bb8-453f-bee9-20af2ec36303 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:01.917730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 456/912] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:43:01 2022] GET /identity/v3/role_assignments?user.id=a1936a2649c349d481f56304b3ee55b3&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=94a64ce81e2f4aea95f03b65b3903c8f => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:01.978247 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77332377-07c7-490d-adfa-0417f6a6420a None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:01.978857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77332377-07c7-490d-adfa-0417f6a6420a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:01.978857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77332377-07c7-490d-adfa-0417f6a6420a None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:01.980627 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 457/913] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:01.986742 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdca954-6b7d-4ddd-a87b-f526fa2ec8cd None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:01.987063 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdca954-6b7d-4ddd-a87b-f526fa2ec8cd None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:01.987302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdca954-6b7d-4ddd-a87b-f526fa2ec8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:02.008012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-6bdca954-6b7d-4ddd-a87b-f526fa2ec8cd None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:02.009325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6bdca954-6b7d-4ddd-a87b-f526fa2ec8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:02.090728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 457/914] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:02.113476 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77332377-07c7-490d-adfa-0417f6a6420a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:02.221343 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77332377-07c7-490d-adfa-0417f6a6420a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:02.250336 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:02.261231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f783aa5-6b37-4b0a-a4f6-b8ccfbff1f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:02.262158 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f783aa5-6b37-4b0a-a4f6-b8ccfbff1f35 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:02.262896 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f783aa5-6b37-4b0a-a4f6-b8ccfbff1f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:02.263266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f783aa5-6b37-4b0a-a4f6-b8ccfbff1f35 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:02.264006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f783aa5-6b37-4b0a-a4f6-b8ccfbff1f35 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:02.265613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f783aa5-6b37-4b0a-a4f6-b8ccfbff1f35 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:02.276250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-4f783aa5-6b37-4b0a-a4f6-b8ccfbff1f35 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:43:02.276250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:02.276250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:43:02.276250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:43:02.276250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:43:02.276250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:43:02.276250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:43:02.276250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:02.276250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:43:02.276250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:02.276250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:43:02.276250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:02.276250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:02.276250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:02.276250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:02.276250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:02.276250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:02.277622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:02.277622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:02.277622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:02.277622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:02.277622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:02.277622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:02.277622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:43:02.277622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:43:02.277622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:43:02.277622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:43:02.277622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:02.277622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:02.277622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:02.277622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:02.277622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:02.277622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:02.278672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:02.278672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:02.278672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:02.278672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:02.278672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:02.278672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:02.278672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:02.278672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:02.278672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:02.278672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:02.278672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:43:02.278672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:02.278672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:43:02.278672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:02.280754 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 458/915] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:43:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:02.286897 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdca954-6b7d-4ddd-a87b-f526fa2ec8cd None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:02.354989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:02.397898 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdca954-6b7d-4ddd-a87b-f526fa2ec8cd None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:02.434329 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5b0d8-eae2-44e9-a79a-a220b389a6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:02.434962 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5b0d8-eae2-44e9-a79a-a220b389a6ed None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:02.435240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5b0d8-eae2-44e9-a79a-a220b389a6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:02.435512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5b0d8-eae2-44e9-a79a-a220b389a6ed None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:02.436219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5b0d8-eae2-44e9-a79a-a220b389a6ed None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:02.436521 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5b0d8-eae2-44e9-a79a-a220b389a6ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:02.437958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5b0d8-eae2-44e9-a79a-a220b389a6ed None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:02.443922 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 458/916] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:43:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:02.449735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f783aa5-6b37-4b0a-a4f6-b8ccfbff1f35 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:02.555886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f783aa5-6b37-4b0a-a4f6-b8ccfbff1f35 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:02.591175 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3d1b1-875f-46c3-9ab8-e530ba3cad73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:02.591798 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3d1b1-875f-46c3-9ab8-e530ba3cad73 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:02.592072 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3d1b1-875f-46c3-9ab8-e530ba3cad73 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:02.592386 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3d1b1-875f-46c3-9ab8-e530ba3cad73 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:02.593083 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3d1b1-875f-46c3-9ab8-e530ba3cad73 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:02.593400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3d1b1-875f-46c3-9ab8-e530ba3cad73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:02.594760 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3d1b1-875f-46c3-9ab8-e530ba3cad73 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:02.600745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 459/917] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Jul 28 17:43:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:02.610189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5b0d8-eae2-44e9-a79a-a220b389a6ed None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:02.714870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5b0d8-eae2-44e9-a79a-a220b389a6ed None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:02.741840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:02.749793 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160dbec-a07c-4c40-bcc5-7184f2a5f73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:02.750420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160dbec-a07c-4c40-bcc5-7184f2a5f73c None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:02.750698 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160dbec-a07c-4c40-bcc5-7184f2a5f73c None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:02.750972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160dbec-a07c-4c40-bcc5-7184f2a5f73c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:02.751679 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160dbec-a07c-4c40-bcc5-7184f2a5f73c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:02.753050 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160dbec-a07c-4c40-bcc5-7184f2a5f73c None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:02.775860 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 459/918] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:43:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:43:03.210124 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1051d8-349c-42a0-89b2-5424644ba94c None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:03.210673 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1051d8-349c-42a0-89b2-5424644ba94c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:03.210673 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1051d8-349c-42a0-89b2-5424644ba94c None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:03.212557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 460/919] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:03.218132 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd44dc-b6d5-40ea-82ad-18322ff08784 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:03.218421 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd44dc-b6d5-40ea-82ad-18322ff08784 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:03.218696 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd44dc-b6d5-40ea-82ad-18322ff08784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:03.237467 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-7ffd44dc-b6d5-40ea-82ad-18322ff08784 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:03.238676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-7ffd44dc-b6d5-40ea-82ad-18322ff08784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:03.312627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 460/920] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:03.334557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1051d8-349c-42a0-89b2-5424644ba94c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:03.392261 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:03.438307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1051d8-349c-42a0-89b2-5424644ba94c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:03.473489 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b73af3-c221-47a8-adde-22800f4ee4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:03.474148 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b73af3-c221-47a8-adde-22800f4ee4ae None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:03.474426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b73af3-c221-47a8-adde-22800f4ee4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:03.474697 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b73af3-c221-47a8-adde-22800f4ee4ae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:03.475320 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b73af3-c221-47a8-adde-22800f4ee4ae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:03.476687 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b73af3-c221-47a8-adde-22800f4ee4ae None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:03.485741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-82b73af3-c221-47a8-adde-22800f4ee4ae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:43:03.485741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:03.485741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:43:03.485741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:43:03.485741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:43:03.485741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:43:03.485741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:43:03.485741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:03.485741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:43:03.485741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:03.485741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:43:03.485741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:03.485741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:03.485741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:03.485741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:03.485741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:03.485741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:03.486735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:03.486735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:03.486735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:03.486735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:03.486735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:03.486735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:03.486735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:43:03.486735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:43:03.486735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:43:03.486735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:43:03.486735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:03.486735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:03.486735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:03.486735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:03.486735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:03.486735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:03.487558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:03.487558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:03.487558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:03.487558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:03.487558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:03.487558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:03.487558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:03.487558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:03.487558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:03.487558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:03.487558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:43:03.487558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:03.487558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:43:03.487558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:03.492014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 461/921] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Jul 28 17:43:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:03.494181 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd44dc-b6d5-40ea-82ad-18322ff08784 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:03.598834 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd44dc-b6d5-40ea-82ad-18322ff08784 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:03.609995 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:03.634994 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81158eed-43cb-4b3f-a47f-81f0badf872f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:03.635615 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81158eed-43cb-4b3f-a47f-81f0badf872f None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:03.635894 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81158eed-43cb-4b3f-a47f-81f0badf872f None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:03.636167 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81158eed-43cb-4b3f-a47f-81f0badf872f None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:03.636858 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81158eed-43cb-4b3f-a47f-81f0badf872f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:03.637505 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81158eed-43cb-4b3f-a47f-81f0badf872f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:03.638900 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81158eed-43cb-4b3f-a47f-81f0badf872f None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:03.651479 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 461/922] 10.222.0.96 () {56 vars in 1122 bytes} [Thu Jul 28 17:43:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:03.660317 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b73af3-c221-47a8-adde-22800f4ee4ae None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:03.769925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b73af3-c221-47a8-adde-22800f4ee4ae None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:03.787556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:03.804615 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139ed2f-e952-4e3f-a728-de7dd8f54bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:03.805266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139ed2f-e952-4e3f-a728-de7dd8f54bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:03.805543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139ed2f-e952-4e3f-a728-de7dd8f54bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:03.805812 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139ed2f-e952-4e3f-a728-de7dd8f54bb2 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:03.806481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139ed2f-e952-4e3f-a728-de7dd8f54bb2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:03.806778 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139ed2f-e952-4e3f-a728-de7dd8f54bb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:03.808139 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139ed2f-e952-4e3f-a728-de7dd8f54bb2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:03.817170 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 462/923] 10.222.0.96 () {56 vars in 1122 bytes} [Thu Jul 28 17:43:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:03.819667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81158eed-43cb-4b3f-a47f-81f0badf872f None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:03.920543 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81158eed-43cb-4b3f-a47f-81f0badf872f None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:03.955900 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49fb97-7018-4fb5-9eb1-6025996bf52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:03.956902 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49fb97-7018-4fb5-9eb1-6025996bf52f None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:03.957433 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49fb97-7018-4fb5-9eb1-6025996bf52f None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:03.958025 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49fb97-7018-4fb5-9eb1-6025996bf52f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:03.959046 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49fb97-7018-4fb5-9eb1-6025996bf52f None admin] RBAC: Adding query filter params (interface=public, service_id=7e5c6f92cb9449aab749d637164037d8, region_id=RegionOne) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:03.959654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49fb97-7018-4fb5-9eb1-6025996bf52f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:03.961259 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49fb97-7018-4fb5-9eb1-6025996bf52f None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:03.967790 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 462/924] 10.222.0.96 () {56 vars in 1251 bytes} [Thu Jul 28 17:43:03 2022] GET /identity/v3/endpoints?service_id=7e5c6f92cb9449aab749d637164037d8&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:03.974694 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139ed2f-e952-4e3f-a728-de7dd8f54bb2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:03.994096 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb3f03-2628-4c69-8529-e9e6a558457f None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:03.994434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb3f03-2628-4c69-8529-e9e6a558457f None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:03.994635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb3f03-2628-4c69-8529-e9e6a558457f None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:03.996221 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 463/925] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:43:04.000994 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85da17-97ba-44b2-a86d-ceb4c9455e3c None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:04.001315 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85da17-97ba-44b2-a86d-ceb4c9455e3c None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:04.001589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85da17-97ba-44b2-a86d-ceb4c9455e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:04.032012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-7c85da17-97ba-44b2-a86d-ceb4c9455e3c None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:04.033379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-7c85da17-97ba-44b2-a86d-ceb4c9455e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:04.065810 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:04.078957 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139ed2f-e952-4e3f-a728-de7dd8f54bb2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:04.117157 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 464/926] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:43:04.117157 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0af72e-be8f-4bb4-b003-eeb9d7624a4e None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:04.117157 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0af72e-be8f-4bb4-b003-eeb9d7624a4e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:04.117157 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0af72e-be8f-4bb4-b003-eeb9d7624a4e None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:04.117157 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 465/927] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:04.117874 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cf54b-e0e6-4da9-b584-a1aaf6ccd89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:04.118497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cf54b-e0e6-4da9-b584-a1aaf6ccd89f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:04.118777 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cf54b-e0e6-4da9-b584-a1aaf6ccd89f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:04.119045 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cf54b-e0e6-4da9-b584-a1aaf6ccd89f None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:04.119696 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cf54b-e0e6-4da9-b584-a1aaf6ccd89f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:04.121747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55461216-7ad4-40fa-b726-0d63898729bd None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:04.122023 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55461216-7ad4-40fa-b726-0d63898729bd None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:04.122290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55461216-7ad4-40fa-b726-0d63898729bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:04.125155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cf54b-e0e6-4da9-b584-a1aaf6ccd89f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:04.141124 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 463/928] 10.222.0.96 () {56 vars in 1087 bytes} [Thu Jul 28 17:43:03 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:43:04.141124 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cf54b-e0e6-4da9-b584-a1aaf6ccd89f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:04.143151 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-55461216-7ad4-40fa-b726-0d63898729bd None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:04.145309 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-55461216-7ad4-40fa-b726-0d63898729bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:04.186385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:04.237708 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 466/929] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:43:04.251427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cf54b-e0e6-4da9-b584-a1aaf6ccd89f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:04.261009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55461216-7ad4-40fa-b726-0d63898729bd None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:04.301292 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef0fbe-c17e-46de-82ce-9dcffe1e9ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:04.302466 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef0fbe-c17e-46de-82ce-9dcffe1e9ecb None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:04.302746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef0fbe-c17e-46de-82ce-9dcffe1e9ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:04.303044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef0fbe-c17e-46de-82ce-9dcffe1e9ecb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:04.314688 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef0fbe-c17e-46de-82ce-9dcffe1e9ecb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:43:04.320066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-ddef0fbe-c17e-46de-82ce-9dcffe1e9ecb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:43:04.320066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:04.320066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:04.320066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:04.320066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:04.320066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:04.320066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:04.320066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:04.320066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:04.320066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:04.320066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:04.320066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:04.320066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:43:04.320066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:43:04.320066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:43:04.320066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:43:04.320990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:43:04.320990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:43:04.320990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:43:04.320990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:43:04.320990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:04.320990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:04.320990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:04.320990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:04.320990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:04.320990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:04.320990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:04.320990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:04.320990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:04.320990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:04.320990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:04.320990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:04.321859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:04.321859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:04.321859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:04.321859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:04.321859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:43:04.321859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:43:04.321859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:43:04.321859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:43:04.321859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:43:04.321859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:43:04.321859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:43:04.321859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:04.321859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 464/930] 10.222.0.96 () {56 vars in 1120 bytes} [Thu Jul 28 17:43:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:04.328656 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef0fbe-c17e-46de-82ce-9dcffe1e9ecb None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:04.379012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:04.385207 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55461216-7ad4-40fa-b726-0d63898729bd None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:04.428531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ae462-ee7c-4cb6-ae3f-e94c27f8ad01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:04.429737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ae462-ee7c-4cb6-ae3f-e94c27f8ad01 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:04.430021 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ae462-ee7c-4cb6-ae3f-e94c27f8ad01 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:04.430298 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ae462-ee7c-4cb6-ae3f-e94c27f8ad01 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:04.430934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ae462-ee7c-4cb6-ae3f-e94c27f8ad01 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:04.432347 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ae462-ee7c-4cb6-ae3f-e94c27f8ad01 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:04.446065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-168ae462-ee7c-4cb6-ae3f-e94c27f8ad01 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:43:04.446065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:04.446065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:43:04.446065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:43:04.446065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:43:04.446065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:43:04.446065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:43:04.446065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:04.446065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:43:04.446065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:04.446065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:43:04.446065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:04.446065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:04.446065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:04.446065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:04.446065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:04.447077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:04.447077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:04.447077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:04.447077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:04.447077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:04.447077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:04.447077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:04.447077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:43:04.447077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:43:04.447077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:43:04.447077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:43:04.447077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:04.447077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:04.447077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:04.447077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:04.447077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:04.447906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:04.447906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:04.447906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:04.447906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:04.447906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:04.447906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:04.447906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:04.447906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:04.447906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:04.447906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:04.447906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:04.447906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:43:04.447906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:04.447906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:43:04.447906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:04.450050 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 467/931] 10.222.0.96 () {56 vars in 1132 bytes} [Thu Jul 28 17:43:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:43:04.454976 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ae462-ee7c-4cb6-ae3f-e94c27f8ad01 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:04.459641 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef0fbe-c17e-46de-82ce-9dcffe1e9ecb None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:04.467178 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:04.498186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e29a2-aab2-4e21-9092-5dfac7259d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:04.499190 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e29a2-aab2-4e21-9092-5dfac7259d8a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:04.499757 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e29a2-aab2-4e21-9092-5dfac7259d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:04.500229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e29a2-aab2-4e21-9092-5dfac7259d8a None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:04.501279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e29a2-aab2-4e21-9092-5dfac7259d8a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:04.501851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e29a2-aab2-4e21-9092-5dfac7259d8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:04.503480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e29a2-aab2-4e21-9092-5dfac7259d8a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:04.513224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 465/932] 10.222.0.96 () {56 vars in 1115 bytes} [Thu Jul 28 17:43:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:04.518398 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e29a2-aab2-4e21-9092-5dfac7259d8a None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:04.574759 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ae462-ee7c-4cb6-ae3f-e94c27f8ad01 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:04.611739 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03100a54-36ce-4ba7-a6f4-52260790b157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:04.612367 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03100a54-36ce-4ba7-a6f4-52260790b157 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:04.612644 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03100a54-36ce-4ba7-a6f4-52260790b157 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:04.612919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03100a54-36ce-4ba7-a6f4-52260790b157 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:04.613628 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03100a54-36ce-4ba7-a6f4-52260790b157 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:04.614526 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03100a54-36ce-4ba7-a6f4-52260790b157 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:04.616210 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03100a54-36ce-4ba7-a6f4-52260790b157 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:04.623254 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 468/933] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Jul 28 17:43:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:04.628652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03100a54-36ce-4ba7-a6f4-52260790b157 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:04.633085 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e29a2-aab2-4e21-9092-5dfac7259d8a None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:04.673302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1125358-98f5-4431-9039-4f21a58f0f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:04.674056 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1125358-98f5-4431-9039-4f21a58f0f1b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:04.674338 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1125358-98f5-4431-9039-4f21a58f0f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:04.674704 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1125358-98f5-4431-9039-4f21a58f0f1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:04.676374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:04.688406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1125358-98f5-4431-9039-4f21a58f0f1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:04.690279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1125358-98f5-4431-9039-4f21a58f0f1b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:04.706406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-b1125358-98f5-4431-9039-4f21a58f0f1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:04.706406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:04.706406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:04.706406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:04.706406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:04.706406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:04.706406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:04.706406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:04.706406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:04.706406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:04.706406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:04.706406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:04.706406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:43:04.706406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:43:04.706406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:43:04.707548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:43:04.707548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:04.707548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:04.707548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:04.707548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:04.707548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:04.707548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:04.707548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:04.707548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:04.707548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:04.707548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:04.707548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:04.707548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:04.707548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:04.707548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:04.707548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:04.707548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:04.708460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:43:04.708460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:43:04.708460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:04.708460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:04.710784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 466/934] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:04.716457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1125358-98f5-4431-9039-4f21a58f0f1b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:04.741370 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:04.762623 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03100a54-36ce-4ba7-a6f4-52260790b157 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:04.799772 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684157eb-7148-40f9-967d-4462108e412f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:04.800764 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684157eb-7148-40f9-967d-4462108e412f None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:04.801341 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684157eb-7148-40f9-967d-4462108e412f None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:04.801887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684157eb-7148-40f9-967d-4462108e412f None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:04.802900 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684157eb-7148-40f9-967d-4462108e412f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:04.803397 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684157eb-7148-40f9-967d-4462108e412f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:04.805244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684157eb-7148-40f9-967d-4462108e412f None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:04.811231 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 469/935] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Jul 28 17:43:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:04.816474 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684157eb-7148-40f9-967d-4462108e412f None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:04.820534 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1125358-98f5-4431-9039-4f21a58f0f1b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:04.856490 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5150369-89ab-41fc-b49e-c49045c5e15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:04.857134 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5150369-89ab-41fc-b49e-c49045c5e15e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:04.857449 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5150369-89ab-41fc-b49e-c49045c5e15e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:04.857729 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5150369-89ab-41fc-b49e-c49045c5e15e None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:04.858514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5150369-89ab-41fc-b49e-c49045c5e15e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:04.858822 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5150369-89ab-41fc-b49e-c49045c5e15e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:04.860337 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5150369-89ab-41fc-b49e-c49045c5e15e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:04.878401 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 467/936] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:04.879331 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5150369-89ab-41fc-b49e-c49045c5e15e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:04.930015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:04.940972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684157eb-7148-40f9-967d-4462108e412f None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:04.963413 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:04.977362 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b7d7a-81f7-4ebd-9c25-c55618ffaa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:04.977991 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b7d7a-81f7-4ebd-9c25-c55618ffaa52 None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:04.978486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b7d7a-81f7-4ebd-9c25-c55618ffaa52 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:04.978613 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b7d7a-81f7-4ebd-9c25-c55618ffaa52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:04.979219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b7d7a-81f7-4ebd-9c25-c55618ffaa52 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:04.980589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b7d7a-81f7-4ebd-9c25-c55618ffaa52 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:04.984111 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5150369-89ab-41fc-b49e-c49045c5e15e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:05.009482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 470/937] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:43:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:43:05.011015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861406c-7ee1-4a9f-9ec3-5f1c08bf33b9 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:05.011299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861406c-7ee1-4a9f-9ec3-5f1c08bf33b9 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:05.011575 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861406c-7ee1-4a9f-9ec3-5f1c08bf33b9 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:05.017230 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 471/938] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:05.020429 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae01b65-5e6a-4239-8d95-69af396f801d None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:05.021482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae01b65-5e6a-4239-8d95-69af396f801d None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:05.021766 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae01b65-5e6a-4239-8d95-69af396f801d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:05.042346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbda755-4b5d-4611-b1d0-f19a73178845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:05.043420 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbda755-4b5d-4611-b1d0-f19a73178845 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:05.043858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbda755-4b5d-4611-b1d0-f19a73178845 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:05.044275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbda755-4b5d-4611-b1d0-f19a73178845 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:05.048680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-1ae01b65-5e6a-4239-8d95-69af396f801d None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:05.049983 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1ae01b65-5e6a-4239-8d95-69af396f801d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:05.053365 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbda755-4b5d-4611-b1d0-f19a73178845 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:05.055077 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbda755-4b5d-4611-b1d0-f19a73178845 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:05.069380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-4bbda755-4b5d-4611-b1d0-f19a73178845 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:43:05.069380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:05.069380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:05.069380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:05.069380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:05.069380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:05.069380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:05.069380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:05.069380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:05.069380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:05.069380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:05.069380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:05.069380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:43:05.069380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:43:05.069380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:43:05.069380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:43:05.070591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:05.070591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:05.070591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:43:05.070591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:43:05.070591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:43:05.070591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:43:05.070591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:05.070591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:05.070591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:05.070591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:05.070591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:05.070591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:05.070591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:05.070591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:05.070591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:05.070591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:05.070591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:05.070591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:05.071743 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:05.071743 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:05.071743 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:43:05.071743 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:43:05.071743 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:43:05.071743 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:43:05.071743 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:43:05.071743 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:43:05.071743 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:43:05.071743 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:05.074327 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 468/939] 10.222.0.96 () {56 vars in 1117 bytes} [Thu Jul 28 17:43:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:05.080268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbda755-4b5d-4611-b1d0-f19a73178845 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:05.133591 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 472/940] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:43:05.157875 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae01b65-5e6a-4239-8d95-69af396f801d None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:05.218735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbda755-4b5d-4611-b1d0-f19a73178845 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:05.255484 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:05.269872 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aa6b0-8dad-4e55-bd6c-a846321ac191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:05.271249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa6b0-8dad-4e55-bd6c-a846321ac191 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:05.271249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa6b0-8dad-4e55-bd6c-a846321ac191 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:05.271249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa6b0-8dad-4e55-bd6c-a846321ac191 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:05.271999 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aa6b0-8dad-4e55-bd6c-a846321ac191 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:05.272307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aa6b0-8dad-4e55-bd6c-a846321ac191 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:05.273796 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aa6b0-8dad-4e55-bd6c-a846321ac191 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:05.277366 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:05.287719 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae01b65-5e6a-4239-8d95-69af396f801d None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:05.293962 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 469/941] 10.222.0.96 () {56 vars in 1149 bytes} [Thu Jul 28 17:43:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:05.302572 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aa6b0-8dad-4e55-bd6c-a846321ac191 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:05.331510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473ea8f-34b0-4130-b3b1-a2cca69c21f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:05.332190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473ea8f-34b0-4130-b3b1-a2cca69c21f5 None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:05.332655 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473ea8f-34b0-4130-b3b1-a2cca69c21f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:05.333052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473ea8f-34b0-4130-b3b1-a2cca69c21f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:05.333796 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473ea8f-34b0-4130-b3b1-a2cca69c21f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:05.335256 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473ea8f-34b0-4130-b3b1-a2cca69c21f5 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:05.338272 dv-cinder-813229-13-smb devstack@keystone.service[80309]: WARNING keystone.server.flask.common [None req-3473ea8f-34b0-4130-b3b1-a2cca69c21f5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 17:43:05.358777 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.sql.core [None req-3473ea8f-34b0-4130-b3b1-a2cca69c21f5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 17:43:05.358777 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 17:43:05.358777 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [parameters: {'id': 'd5fa8d3eb5374056bb2cf11d8073b13c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 17:43:05.358777 dv-cinder-813229-13-smb devstack@keystone.service[80309]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80309) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 17:43:05.376332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-3473ea8f-34b0-4130-b3b1-a2cca69c21f5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d5fa8d3eb5374056bb2cf11d8073b13c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d5fa8d3eb5374056bb2cf11d8073b13c. Jul 28 17:43:05.376332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:05.376332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 17:43:05.376332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 17:43:05.376332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 17:43:05.376332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 17:43:05.376332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 17:43:05.376332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 17:43:05.376332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 17:43:05.376332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application conn.query(q) Jul 28 17:43:05.376332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 17:43:05.376332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 17:43:05.376332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 17:43:05.377490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application result.read() Jul 28 17:43:05.377490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 17:43:05.377490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 17:43:05.377490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 17:43:05.377490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 17:43:05.377490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 17:43:05.377490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 17:43:05.377490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 17:43:05.377490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 17:43:05.377490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 17:43:05.377490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:05.377490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 17:43:05.377490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:05.377490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:05.377490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 17:43:05.377490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 17:43:05.377490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 28 17:43:05.377490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 28 17:43:05.378831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 17:43:05.378831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application next(self.gen) Jul 28 17:43:05.378831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 17:43:05.378831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application yield resource Jul 28 17:43:05.378831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 17:43:05.378831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application next(self.gen) Jul 28 17:43:05.378831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 17:43:05.378831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 17:43:05.378831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 17:43:05.378831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 17:43:05.378831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 17:43:05.378831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise self.value Jul 28 17:43:05.378831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 17:43:05.378831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 17:43:05.378831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 17:43:05.378831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application session.commit() Jul 28 17:43:05.378831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 17:43:05.380368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 17:43:05.380368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 17:43:05.380368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 17:43:05.380368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 17:43:05.380368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self.session.flush() Jul 28 17:43:05.380368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 17:43:05.380368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 17:43:05.380368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 17:43:05.380368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 17:43:05.380368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 17:43:05.380368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application compat.raise_( Jul 28 17:43:05.380368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 17:43:05.380368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception Jul 28 17:43:05.380368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 17:43:05.380368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 17:43:05.380368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 17:43:05.380368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 17:43:05.381919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 17:43:05.381919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 17:43:05.381919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 17:43:05.381919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 17:43:05.381919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 17:43:05.381919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 17:43:05.381919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 17:43:05.381919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 17:43:05.381919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 17:43:05.381919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 17:43:05.381919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 17:43:05.381919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 17:43:05.381919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 17:43:05.381919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 17:43:05.381919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 17:43:05.383816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 17:43:05.383816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 17:43:05.383816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception Jul 28 17:43:05.383816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 17:43:05.383816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 17:43:05.383816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 17:43:05.383816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 17:43:05.383816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 17:43:05.383816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 17:43:05.383816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 17:43:05.383816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application conn.query(q) Jul 28 17:43:05.383816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 17:43:05.383816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 17:43:05.383816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 17:43:05.383816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application result.read() Jul 28 17:43:05.383816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 17:43:05.383816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 17:43:05.386106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 17:43:05.386106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 17:43:05.386106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 17:43:05.386106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 17:43:05.386106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 17:43:05.386106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 17:43:05.386106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 17:43:05.386106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 17:43:05.386106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [parameters: {'id': 'd5fa8d3eb5374056bb2cf11d8073b13c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 17:43:05.386106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 17:43:05.386106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:05.386106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:43:05.386106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:05.386106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:05.386106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 28 17:43:05.388356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 28 17:43:05.388356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 17:43:05.388356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 17:43:05.388356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 28 17:43:05.388356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:05.388356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:43:05.388356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:05.388356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:05.388356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:05.388356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:05.388356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:05.388356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:05.388356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:05.388356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:05.388356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:05.388356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:05.388356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:05.390728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:05.390728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 28 17:43:05.390728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 28 17:43:05.390728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:05.390728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:05.390728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 28 17:43:05.390728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 28 17:43:05.390728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d5fa8d3eb5374056bb2cf11d8073b13c. Jul 28 17:43:05.390728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:05.390728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 473/942] 10.222.0.96 () {60 vars in 1140 bytes} [Thu Jul 28 17:43:05 2022] POST /identity/v3/projects => generated 262 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:43:05.390728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473ea8f-34b0-4130-b3b1-a2cca69c21f5 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:05.445936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aa6b0-8dad-4e55-bd6c-a846321ac191 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:05.490225 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832f4c9-1e89-42be-bc8e-14c9368a2b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:05.491339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832f4c9-1e89-42be-bc8e-14c9368a2b22 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:05.492149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832f4c9-1e89-42be-bc8e-14c9368a2b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:05.492620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832f4c9-1e89-42be-bc8e-14c9368a2b22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:05.501041 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473ea8f-34b0-4130-b3b1-a2cca69c21f5 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:05.506072 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832f4c9-1e89-42be-bc8e-14c9368a2b22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:05.507778 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832f4c9-1e89-42be-bc8e-14c9368a2b22 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:05.531447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-8832f4c9-1e89-42be-bc8e-14c9368a2b22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:05.531447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:05.531447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:05.531447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:05.531447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:05.531447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:05.531447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:05.531447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:05.531447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:05.531447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:05.531447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:05.531447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:05.531447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:43:05.531447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:43:05.531447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:43:05.532393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:43:05.532393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:05.532393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:05.532393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:05.532393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:05.532393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:05.532393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:05.532393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:05.532393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:05.532393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:05.532393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:05.532393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:05.532393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:05.532393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:05.532393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:05.532393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:05.532393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:05.533317 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:43:05.533317 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:43:05.533317 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:05.533317 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:05.539612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 470/943] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:05.540648 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:05.541048 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832f4c9-1e89-42be-bc8e-14c9368a2b22 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:05.548122 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483306d-89f4-4236-be23-ebee1eb138c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:05.548783 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483306d-89f4-4236-be23-ebee1eb138c9 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:05.549145 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483306d-89f4-4236-be23-ebee1eb138c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:05.550199 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483306d-89f4-4236-be23-ebee1eb138c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:05.558063 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483306d-89f4-4236-be23-ebee1eb138c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:05.559783 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483306d-89f4-4236-be23-ebee1eb138c9 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:05.572224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-8483306d-89f4-4236-be23-ebee1eb138c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:43:05.572224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:05.572224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:05.572224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:05.572224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:05.572224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:05.572224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:05.572224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:05.572224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:05.572224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:05.572224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:05.572224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:05.572224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:43:05.572224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:43:05.572224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:43:05.573197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:43:05.573197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:05.573197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:05.573197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:05.573197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:05.573197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:05.573197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:05.573197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:05.573197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:05.573197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:05.573197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:05.573197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:05.573197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:05.573197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:05.573197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:05.573197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:05.573197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:05.574121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:43:05.574121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:43:05.574121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:43:05.574121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:43:05.574121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:43:05.574121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:43:05.574121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:43:05.574121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:05.574121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 474/944] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:43:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:43:05.580382 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483306d-89f4-4236-be23-ebee1eb138c9 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:05.601718 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:05.664774 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832f4c9-1e89-42be-bc8e-14c9368a2b22 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:05.695943 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483306d-89f4-4236-be23-ebee1eb138c9 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:05.708143 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dec126-247f-4f3c-b2d0-a47b95302882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:05.709398 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dec126-247f-4f3c-b2d0-a47b95302882 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:05.709784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dec126-247f-4f3c-b2d0-a47b95302882 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:05.710420 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dec126-247f-4f3c-b2d0-a47b95302882 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:05.711209 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dec126-247f-4f3c-b2d0-a47b95302882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:05.711612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dec126-247f-4f3c-b2d0-a47b95302882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:05.713650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dec126-247f-4f3c-b2d0-a47b95302882 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:05.730711 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 471/945] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:05.735888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dec126-247f-4f3c-b2d0-a47b95302882 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:05.742164 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89592503-7ebf-41ac-ab9d-5889ccfee008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:05.743062 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89592503-7ebf-41ac-ab9d-5889ccfee008 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:05.743531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89592503-7ebf-41ac-ab9d-5889ccfee008 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:05.743996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89592503-7ebf-41ac-ab9d-5889ccfee008 None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:05.744919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89592503-7ebf-41ac-ab9d-5889ccfee008 None admin] RBAC: Adding query filter params (name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:05.745453 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89592503-7ebf-41ac-ab9d-5889ccfee008 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:05.747612 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89592503-7ebf-41ac-ab9d-5889ccfee008 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:05.786089 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 475/946] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Jul 28 17:43:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:05.855467 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dec126-247f-4f3c-b2d0-a47b95302882 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:05.864512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:05.907651 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1c560-cf88-46bf-8791-d5d245c8122e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:05.908604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1c560-cf88-46bf-8791-d5d245c8122e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:05.909032 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1c560-cf88-46bf-8791-d5d245c8122e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:05.909470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1c560-cf88-46bf-8791-d5d245c8122e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:05.918035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1c560-cf88-46bf-8791-d5d245c8122e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:05.919750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1c560-cf88-46bf-8791-d5d245c8122e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:05.932990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-d4e1c560-cf88-46bf-8791-d5d245c8122e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:43:05.932990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:05.932990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:05.932990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:05.932990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:05.932990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:05.932990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:05.932990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:05.932990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:05.932990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:05.932990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:05.932990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:05.932990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:43:05.932990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:43:05.932990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:43:05.934250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:43:05.934250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:05.934250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:05.934250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:05.934250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:05.934250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:05.934250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:05.934250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:05.934250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:05.934250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:05.934250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:05.934250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:05.934250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:05.934250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:05.934250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:05.934250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:05.934250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:05.935426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:43:05.935426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:43:05.935426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:43:05.935426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:43:05.935426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:43:05.935426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:43:05.935426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:43:05.935426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:05.937609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 472/947] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:43:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:05.946611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89592503-7ebf-41ac-ab9d-5889ccfee008 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:06.030299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:06.089874 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89592503-7ebf-41ac-ab9d-5889ccfee008 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:06.130713 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cea3d1-df22-4c6b-b7a2-9e5f266d4f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:06.131340 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cea3d1-df22-4c6b-b7a2-9e5f266d4f6a None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:06.131616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cea3d1-df22-4c6b-b7a2-9e5f266d4f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:06.131886 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cea3d1-df22-4c6b-b7a2-9e5f266d4f6a None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:06.132642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cea3d1-df22-4c6b-b7a2-9e5f266d4f6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:06.132949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cea3d1-df22-4c6b-b7a2-9e5f266d4f6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:06.134606 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cea3d1-df22-4c6b-b7a2-9e5f266d4f6a None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:06.149287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 476/948] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:43:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:06.155945 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1c560-cf88-46bf-8791-d5d245c8122e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:06.277572 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1c560-cf88-46bf-8791-d5d245c8122e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:06.318102 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf51120-5bab-4b9b-8c15-71dc47bf6f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:06.319102 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf51120-5bab-4b9b-8c15-71dc47bf6f7a None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:06.319567 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf51120-5bab-4b9b-8c15-71dc47bf6f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:06.320015 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf51120-5bab-4b9b-8c15-71dc47bf6f7a None admin] PATH_INFO: `/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/a1936a2649c349d481f56304b3ee55b3/roles/94a64ce81e2f4aea95f03b65b3903c8f` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:06.322467 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf51120-5bab-4b9b-8c15-71dc47bf6f7a None admin] RBAC: Authorizing `identity:create_grant(project_id=db5ce5e789e949d09c183dbe04e53f19, user_id=a1936a2649c349d481f56304b3ee55b3, role_id=94a64ce81e2f4aea95f03b65b3903c8f)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:06.324114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf51120-5bab-4b9b-8c15-71dc47bf6f7a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:06.341577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 473/949] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:43:06 2022] PUT /identity/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/a1936a2649c349d481f56304b3ee55b3/roles/94a64ce81e2f4aea95f03b65b3903c8f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:43:06.404497 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd2f8f-e633-4392-982f-b0af199f40ac None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:06.405077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd2f8f-e633-4392-982f-b0af199f40ac None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:06.405479 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd2f8f-e633-4392-982f-b0af199f40ac None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:06.407282 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 477/950] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:06.413702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe67654-212c-460b-9058-0cba275bcf4c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:06.414565 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe67654-212c-460b-9058-0cba275bcf4c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:06.414990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe67654-212c-460b-9058-0cba275bcf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:06.439026 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-afe67654-212c-460b-9058-0cba275bcf4c None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:06.440655 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-afe67654-212c-460b-9058-0cba275bcf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:06.467155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:06.532657 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 474/951] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:06.560435 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd2f8f-e633-4392-982f-b0af199f40ac None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:06.689822 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd2f8f-e633-4392-982f-b0af199f40ac None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:06.704896 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:06.729318 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b3514-279c-4f0f-aeb8-0b4db4299f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:06.730289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b3514-279c-4f0f-aeb8-0b4db4299f97 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:06.730572 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b3514-279c-4f0f-aeb8-0b4db4299f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:06.730848 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b3514-279c-4f0f-aeb8-0b4db4299f97 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:06.731494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b3514-279c-4f0f-aeb8-0b4db4299f97 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:06.732900 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b3514-279c-4f0f-aeb8-0b4db4299f97 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:06.748473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-eb2b3514-279c-4f0f-aeb8-0b4db4299f97 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:43:06.748473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:06.748473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:43:06.748473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:43:06.748473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:43:06.748473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:43:06.748473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:43:06.748473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:06.748473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:43:06.748473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:06.748473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:43:06.748473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:06.748473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:06.748473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:06.748473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:06.748473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:06.748473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:06.749736 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:06.749736 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:06.749736 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:06.749736 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:06.749736 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:06.749736 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:06.749736 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:43:06.749736 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:43:06.749736 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:43:06.749736 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:43:06.749736 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:06.749736 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:06.749736 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:06.749736 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:06.749736 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:06.749736 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:06.750683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:06.750683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:06.750683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:06.750683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:06.750683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:06.750683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:06.750683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:06.750683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:06.750683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:06.750683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:06.750683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:43:06.750683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:06.750683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:43:06.750683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:06.750683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 478/952] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Jul 28 17:43:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:06.758472 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe67654-212c-460b-9058-0cba275bcf4c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:06.873545 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe67654-212c-460b-9058-0cba275bcf4c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:06.914064 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bb3d6-6a1d-452f-a9dd-25ca680eec8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:06.914708 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bb3d6-6a1d-452f-a9dd-25ca680eec8d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:06.914987 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bb3d6-6a1d-452f-a9dd-25ca680eec8d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:06.915266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bb3d6-6a1d-452f-a9dd-25ca680eec8d None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:06.915956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bb3d6-6a1d-452f-a9dd-25ca680eec8d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:06.916260 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bb3d6-6a1d-452f-a9dd-25ca680eec8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:06.917853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bb3d6-6a1d-452f-a9dd-25ca680eec8d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:06.929235 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 475/953] 10.222.0.96 () {56 vars in 1122 bytes} [Thu Jul 28 17:43:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:06.931786 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b3514-279c-4f0f-aeb8-0b4db4299f97 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:07.049820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b3514-279c-4f0f-aeb8-0b4db4299f97 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:07.084666 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cda7b-c2a2-4ab8-8c01-df3b502701ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:07.085314 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cda7b-c2a2-4ab8-8c01-df3b502701ad None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:07.085597 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cda7b-c2a2-4ab8-8c01-df3b502701ad None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:07.085870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cda7b-c2a2-4ab8-8c01-df3b502701ad None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:07.086547 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cda7b-c2a2-4ab8-8c01-df3b502701ad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:07.086849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cda7b-c2a2-4ab8-8c01-df3b502701ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:07.088281 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cda7b-c2a2-4ab8-8c01-df3b502701ad None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:07.098578 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 479/954] 10.222.0.96 () {56 vars in 1122 bytes} [Thu Jul 28 17:43:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:07.099970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bb3d6-6a1d-452f-a9dd-25ca680eec8d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:07.125568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:07.209200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bb3d6-6a1d-452f-a9dd-25ca680eec8d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:07.244473 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb244f46-3365-4975-aeb1-c3b59c5bc32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:07.245482 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb244f46-3365-4975-aeb1-c3b59c5bc32e None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:07.245941 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb244f46-3365-4975-aeb1-c3b59c5bc32e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:07.246422 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb244f46-3365-4975-aeb1-c3b59c5bc32e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:07.247320 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb244f46-3365-4975-aeb1-c3b59c5bc32e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:07.248898 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb244f46-3365-4975-aeb1-c3b59c5bc32e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:07.273027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 476/955] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:43:07 2022] POST /identity/v3/endpoints => generated 349 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:43:07.301231 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e599b-3e5e-4604-bade-1195d1a3002b None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:07.301666 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e599b-3e5e-4604-bade-1195d1a3002b None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:07.302020 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e599b-3e5e-4604-bade-1195d1a3002b None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:07.303834 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 480/956] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:07.311223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a284a8-ba9a-4196-aadc-09dfcbd911e2 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:07.312192 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a284a8-ba9a-4196-aadc-09dfcbd911e2 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:07.312647 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a284a8-ba9a-4196-aadc-09dfcbd911e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:07.333201 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-87a284a8-ba9a-4196-aadc-09dfcbd911e2 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:07.334866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-87a284a8-ba9a-4196-aadc-09dfcbd911e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:07.416930 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 477/957] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:07.440018 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e599b-3e5e-4604-bade-1195d1a3002b None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:07.493341 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:07.555950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e599b-3e5e-4604-bade-1195d1a3002b None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:07.591929 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa230415-8518-4d2f-bb10-32f295b447aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:07.592577 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa230415-8518-4d2f-bb10-32f295b447aa None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:07.592856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa230415-8518-4d2f-bb10-32f295b447aa None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:07.593156 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa230415-8518-4d2f-bb10-32f295b447aa None admin] PATH_INFO: `/v3/services/compute` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:07.593793 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa230415-8518-4d2f-bb10-32f295b447aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:07.595173 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa230415-8518-4d2f-bb10-32f295b447aa None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:07.604856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-fa230415-8518-4d2f-bb10-32f295b447aa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:43:07.604856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:07.604856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:43:07.604856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:43:07.604856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:43:07.604856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:43:07.604856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:43:07.604856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:07.604856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:43:07.604856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:07.604856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:43:07.604856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:07.604856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:07.604856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:07.604856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:07.604856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:07.604856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:07.606010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:07.606010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:07.606010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:07.606010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:07.606010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:07.606010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:07.606010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:43:07.606010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:43:07.606010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:43:07.606010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:43:07.606010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:07.606010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:07.606010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:07.606010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:07.606010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:07.606010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:07.606884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:07.606884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:07.606884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:07.606884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:07.606884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:07.606884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:07.606884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:07.606884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:07.606884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:07.606884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:07.606884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:43:07.606884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:07.606884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:43:07.606884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:07.611110 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 481/958] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:43:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:07.612584 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a284a8-ba9a-4196-aadc-09dfcbd911e2 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:07.615018 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:07.724199 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a284a8-ba9a-4196-aadc-09dfcbd911e2 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:07.759080 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d415076-767e-4cb0-8125-f6d6094e7411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:07.759706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d415076-767e-4cb0-8125-f6d6094e7411 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:07.759983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d415076-767e-4cb0-8125-f6d6094e7411 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:07.760252 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d415076-767e-4cb0-8125-f6d6094e7411 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:07.760939 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d415076-767e-4cb0-8125-f6d6094e7411 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:07.761271 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d415076-767e-4cb0-8125-f6d6094e7411 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:07.763007 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d415076-767e-4cb0-8125-f6d6094e7411 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:07.768338 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 478/959] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Jul 28 17:43:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:07.774674 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa230415-8518-4d2f-bb10-32f295b447aa None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:07.881439 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa230415-8518-4d2f-bb10-32f295b447aa None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:07.883970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:07.917867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638d044-8a8a-4994-b4bb-8ac7d1061341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:07.918490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638d044-8a8a-4994-b4bb-8ac7d1061341 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:07.918765 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638d044-8a8a-4994-b4bb-8ac7d1061341 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:07.919034 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638d044-8a8a-4994-b4bb-8ac7d1061341 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:07.919709 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638d044-8a8a-4994-b4bb-8ac7d1061341 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:07.920006 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638d044-8a8a-4994-b4bb-8ac7d1061341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:07.921451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638d044-8a8a-4994-b4bb-8ac7d1061341 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:07.926520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 482/960] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Jul 28 17:43:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:08.069124 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0581d-5fa7-438f-9b7d-f941ce8d7297 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:08.069522 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0581d-5fa7-438f-9b7d-f941ce8d7297 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:08.069716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0581d-5fa7-438f-9b7d-f941ce8d7297 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:08.071375 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 479/961] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:08.078607 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a452a-69c8-42c7-8876-3c848f571a60 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:08.078607 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a452a-69c8-42c7-8876-3c848f571a60 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:08.078607 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a452a-69c8-42c7-8876-3c848f571a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:08.100354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-8d1a452a-69c8-42c7-8876-3c848f571a60 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:08.101907 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-8d1a452a-69c8-42c7-8876-3c848f571a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:08.175085 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 483/962] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:08.200726 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0581d-5fa7-438f-9b7d-f941ce8d7297 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:08.270418 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:08.307052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0581d-5fa7-438f-9b7d-f941ce8d7297 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:08.342303 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050e432-3dd8-4696-80c9-15285ec6bc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:08.342977 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050e432-3dd8-4696-80c9-15285ec6bc31 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:08.343218 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050e432-3dd8-4696-80c9-15285ec6bc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:08.343457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050e432-3dd8-4696-80c9-15285ec6bc31 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:08.344140 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050e432-3dd8-4696-80c9-15285ec6bc31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:08.345613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050e432-3dd8-4696-80c9-15285ec6bc31 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:08.348520 dv-cinder-813229-13-smb devstack@keystone.service[80310]: WARNING keystone.server.flask.common [None req-f050e432-3dd8-4696-80c9-15285ec6bc31 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 17:43:08.362376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.sql.core [None req-f050e432-3dd8-4696-80c9-15285ec6bc31 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 17:43:08.362376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 17:43:08.362376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [parameters: {'user_id': '1a19668cf73349d4af10bb9d03363f40', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 17:43:08.362376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80310) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 17:43:08.369550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-f050e432-3dd8-4696-80c9-15285ec6bc31 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 17:43:08.369550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:08.369550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 17:43:08.369550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 17:43:08.369550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 17:43:08.369550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 17:43:08.369550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 17:43:08.369550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 17:43:08.369550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 17:43:08.369550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application conn.query(q) Jul 28 17:43:08.369550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 17:43:08.369550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 17:43:08.369550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 17:43:08.369550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application result.read() Jul 28 17:43:08.369550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 17:43:08.370438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 17:43:08.370438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 17:43:08.370438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 17:43:08.370438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 17:43:08.370438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 17:43:08.370438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 17:43:08.370438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 17:43:08.370438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 17:43:08.370438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:08.370438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 17:43:08.370438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:08.370438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:08.370438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 17:43:08.370438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 17:43:08.370438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 28 17:43:08.370438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 28 17:43:08.370438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 17:43:08.370438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application next(self.gen) Jul 28 17:43:08.371856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 17:43:08.371856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application yield resource Jul 28 17:43:08.371856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 17:43:08.371856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application next(self.gen) Jul 28 17:43:08.371856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 17:43:08.371856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 17:43:08.371856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 17:43:08.371856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 17:43:08.371856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 17:43:08.371856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise self.value Jul 28 17:43:08.371856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 17:43:08.371856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 17:43:08.371856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 17:43:08.371856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application session.commit() Jul 28 17:43:08.371856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 17:43:08.371856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 17:43:08.371856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 17:43:08.373079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 17:43:08.373079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 17:43:08.373079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.session.flush() Jul 28 17:43:08.373079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 17:43:08.373079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 17:43:08.373079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 17:43:08.373079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 17:43:08.373079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 17:43:08.373079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application compat.raise_( Jul 28 17:43:08.373079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 17:43:08.373079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception Jul 28 17:43:08.373079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 17:43:08.373079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 17:43:08.373079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 17:43:08.373079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 17:43:08.373079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 17:43:08.373079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 17:43:08.374804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 17:43:08.374804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 17:43:08.374804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 17:43:08.374804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 28 17:43:08.374804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 17:43:08.374804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 17:43:08.374804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 17:43:08.374804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 17:43:08.374804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 17:43:08.374804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 17:43:08.374804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 17:43:08.374804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 17:43:08.374804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 17:43:08.374804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 17:43:08.374804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 17:43:08.374804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception Jul 28 17:43:08.378289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 17:43:08.378289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 17:43:08.378289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 17:43:08.378289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 17:43:08.378289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 17:43:08.378289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 17:43:08.378289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 17:43:08.378289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application conn.query(q) Jul 28 17:43:08.378289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 17:43:08.378289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 17:43:08.378289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 17:43:08.378289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application result.read() Jul 28 17:43:08.378289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 17:43:08.378289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 17:43:08.378289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 17:43:08.378289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 17:43:08.380358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 17:43:08.380358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 17:43:08.380358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 17:43:08.380358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 17:43:08.380358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 17:43:08.380358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 17:43:08.380358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [parameters: {'user_id': '1a19668cf73349d4af10bb9d03363f40', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 17:43:08.380358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 17:43:08.380358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:08.380358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:43:08.380358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:08.380358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:08.380358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:08.380358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:08.380358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:08.382381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:08.382381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:08.382381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:08.382381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:08.382381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:08.382381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:08.382381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:08.382381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 28 17:43:08.382381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 28 17:43:08.382381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:08.382381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:08.382381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:43:08.382381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:43:08.382381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:43:08.382381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:43:08.382381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 28 17:43:08.382381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 28 17:43:08.384468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 28 17:43:08.384468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 28 17:43:08.384468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 17:43:08.384468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 17:43:08.384468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 17:43:08.384468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:08.384468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 480/963] 10.222.0.96 () {60 vars in 1131 bytes} [Thu Jul 28 17:43:08 2022] POST /identity/v3/users => generated 160 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:08.385420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a452a-69c8-42c7-8876-3c848f571a60 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:08.487565 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:08.492146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a452a-69c8-42c7-8876-3c848f571a60 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:08.528420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483c192-e728-4c59-97c1-a263e0bc784d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:08.529050 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483c192-e728-4c59-97c1-a263e0bc784d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:08.529357 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483c192-e728-4c59-97c1-a263e0bc784d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:08.529625 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483c192-e728-4c59-97c1-a263e0bc784d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:08.538439 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483c192-e728-4c59-97c1-a263e0bc784d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:08.539942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483c192-e728-4c59-97c1-a263e0bc784d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:08.553592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-0483c192-e728-4c59-97c1-a263e0bc784d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:43:08.553592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:08.553592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:08.553592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:08.553592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:08.553592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:08.553592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:08.553592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:08.553592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:08.553592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:08.553592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:08.553592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:08.553592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:43:08.553592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:43:08.553592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:43:08.553592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:43:08.555919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:08.555919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:08.555919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:43:08.555919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:43:08.555919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:43:08.555919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:43:08.555919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:08.555919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:08.555919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:08.555919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:08.555919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:08.555919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:08.555919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:08.555919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:08.555919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:08.555919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:08.555919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:08.555919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:08.558232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:08.558232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:08.558232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:43:08.558232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:43:08.558232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:43:08.558232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:43:08.558232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:43:08.558232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:43:08.558232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:43:08.558232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:08.558232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 484/964] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:43:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:08.562039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483c192-e728-4c59-97c1-a263e0bc784d None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:08.562307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551bd35-4680-4ad7-bbd8-c215c8d34082 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:08.562601 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551bd35-4680-4ad7-bbd8-c215c8d34082 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:08.562873 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551bd35-4680-4ad7-bbd8-c215c8d34082 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:08.572328 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 481/965] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:08.574388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93884e-d7ae-4b46-bc68-0152867d891e None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:08.574668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93884e-d7ae-4b46-bc68-0152867d891e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:08.574940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93884e-d7ae-4b46-bc68-0152867d891e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:08.599021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-3c93884e-d7ae-4b46-bc68-0152867d891e None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:08.601544 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3c93884e-d7ae-4b46-bc68-0152867d891e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:08.672315 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483c192-e728-4c59-97c1-a263e0bc784d None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:08.689503 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 482/966] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:08.707968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93884e-d7ae-4b46-bc68-0152867d891e None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:08.712450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c154fa3-3409-42fb-b73a-f063bc307d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:08.713118 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c154fa3-3409-42fb-b73a-f063bc307d0a None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:08.713434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c154fa3-3409-42fb-b73a-f063bc307d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:08.713658 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c154fa3-3409-42fb-b73a-f063bc307d0a None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:08.714424 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c154fa3-3409-42fb-b73a-f063bc307d0a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:08.714729 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c154fa3-3409-42fb-b73a-f063bc307d0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:08.716220 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c154fa3-3409-42fb-b73a-f063bc307d0a None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:08.769090 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 485/967] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Jul 28 17:43:08 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:08.776603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:08.824953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93884e-d7ae-4b46-bc68-0152867d891e None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:08.865422 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add51eaa-0f29-4775-9bca-b60f1e9173ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:08.866100 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add51eaa-0f29-4775-9bca-b60f1e9173ed None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:08.866381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add51eaa-0f29-4775-9bca-b60f1e9173ed None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:08.866655 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add51eaa-0f29-4775-9bca-b60f1e9173ed None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:08.879158 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add51eaa-0f29-4775-9bca-b60f1e9173ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:43:08.885189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-add51eaa-0f29-4775-9bca-b60f1e9173ed None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:43:08.885189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:08.885189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:08.885189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:08.885189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:08.885189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:08.885189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:08.885189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:08.885189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:08.885189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:08.885189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:08.885189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:08.885189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:43:08.885189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:43:08.885189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:43:08.885189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:43:08.886188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:43:08.886188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:43:08.886188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:43:08.886188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:43:08.886188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:08.886188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:08.886188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:08.886188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:08.886188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:08.886188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:08.886188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:08.886188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:08.886188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:08.886188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:08.886188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:08.886188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:08.887028 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:08.887028 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:08.887028 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:08.887028 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:08.887028 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:43:08.887028 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:43:08.887028 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:43:08.887028 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:43:08.887028 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:43:08.887028 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:43:08.887028 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:43:08.887028 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:08.887028 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 483/968] 10.222.0.96 () {56 vars in 1120 bytes} [Thu Jul 28 17:43:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:08.896058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c154fa3-3409-42fb-b73a-f063bc307d0a None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:08.917227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:09.004432 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c154fa3-3409-42fb-b73a-f063bc307d0a None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:09.041118 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1377557-20a4-4897-b0d4-c5d09acce9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:09.042208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1377557-20a4-4897-b0d4-c5d09acce9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:09.042679 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1377557-20a4-4897-b0d4-c5d09acce9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:09.043150 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1377557-20a4-4897-b0d4-c5d09acce9b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:09.044067 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1377557-20a4-4897-b0d4-c5d09acce9b7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:09.044591 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1377557-20a4-4897-b0d4-c5d09acce9b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:09.046260 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1377557-20a4-4897-b0d4-c5d09acce9b7 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:09.056091 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 486/969] 10.222.0.96 () {56 vars in 1115 bytes} [Thu Jul 28 17:43:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:09.061527 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add51eaa-0f29-4775-9bca-b60f1e9173ed None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:09.173663 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add51eaa-0f29-4775-9bca-b60f1e9173ed None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:09.191051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:09.210594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2efb2-6ffc-42ef-a4f8-dd8887a0acf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:09.211242 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2efb2-6ffc-42ef-a4f8-dd8887a0acf2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:09.211525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2efb2-6ffc-42ef-a4f8-dd8887a0acf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:09.211801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2efb2-6ffc-42ef-a4f8-dd8887a0acf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:09.222705 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2efb2-6ffc-42ef-a4f8-dd8887a0acf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:09.224569 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2efb2-6ffc-42ef-a4f8-dd8887a0acf2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:09.239652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-67d2efb2-6ffc-42ef-a4f8-dd8887a0acf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:09.239652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:09.239652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:09.239652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:09.239652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:09.239652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:09.239652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:09.239652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:09.239652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:09.239652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:09.239652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:09.239652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:09.239652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:43:09.239652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:43:09.239652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:43:09.240571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:43:09.240571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:09.240571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:09.240571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:09.240571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:09.240571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:09.240571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:09.240571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:09.240571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:09.240571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:09.240571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:09.240571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:09.240571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:09.240571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:09.240571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:09.240571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:09.240571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:09.241906 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:43:09.241906 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:43:09.241906 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:09.241906 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:09.242442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 484/970] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:09.246741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1377557-20a4-4897-b0d4-c5d09acce9b7 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:09.341985 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:09.366036 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1377557-20a4-4897-b0d4-c5d09acce9b7 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:09.400547 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab20a8c-b47f-4443-9627-9247ec991d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:09.401260 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab20a8c-b47f-4443-9627-9247ec991d38 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:09.401559 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab20a8c-b47f-4443-9627-9247ec991d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:09.401832 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab20a8c-b47f-4443-9627-9247ec991d38 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:09.402520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab20a8c-b47f-4443-9627-9247ec991d38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:09.402823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab20a8c-b47f-4443-9627-9247ec991d38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:09.404211 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab20a8c-b47f-4443-9627-9247ec991d38 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:09.416523 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 487/971] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:09.422254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2efb2-6ffc-42ef-a4f8-dd8887a0acf2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:09.447922 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ede76-8bd0-459d-87b4-ef4b77101d57 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:09.448096 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ede76-8bd0-459d-87b4-ef4b77101d57 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:09.448366 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ede76-8bd0-459d-87b4-ef4b77101d57 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:09.449855 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 488/972] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:43:09.454443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7420d2b-cd99-4d22-bcb3-b99fd34da461 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:09.454698 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7420d2b-cd99-4d22-bcb3-b99fd34da461 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:09.454974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7420d2b-cd99-4d22-bcb3-b99fd34da461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:09.474692 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-d7420d2b-cd99-4d22-bcb3-b99fd34da461 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:09.475909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-d7420d2b-cd99-4d22-bcb3-b99fd34da461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:09.538020 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2efb2-6ffc-42ef-a4f8-dd8887a0acf2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:09.552149 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 489/973] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:43:09.575673 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7420d2b-cd99-4d22-bcb3-b99fd34da461 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:09.581674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a405bb-699d-412b-9a61-420171856446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:09.582615 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a405bb-699d-412b-9a61-420171856446 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:09.583078 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a405bb-699d-412b-9a61-420171856446 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:09.583529 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a405bb-699d-412b-9a61-420171856446 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:09.593155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a405bb-699d-412b-9a61-420171856446 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:09.594626 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a405bb-699d-412b-9a61-420171856446 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:09.607592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-b0a405bb-699d-412b-9a61-420171856446 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:43:09.607592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:09.607592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:09.607592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:09.607592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:09.607592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:09.607592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:09.607592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:09.607592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:09.607592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:09.607592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:09.607592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:09.607592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:43:09.607592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:43:09.607592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:43:09.607592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:43:09.608602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:09.608602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:09.608602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:43:09.608602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:43:09.608602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:43:09.608602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:43:09.608602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:09.608602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:09.608602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:09.608602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:09.608602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:09.608602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:09.608602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:09.608602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:09.608602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:09.608602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:09.608602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:09.608602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:09.609635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:09.609635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:09.609635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:43:09.609635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:43:09.609635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:43:09.609635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:43:09.609635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:43:09.609635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:43:09.609635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:43:09.609635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:09.609635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 485/974] 10.222.0.96 () {56 vars in 1117 bytes} [Thu Jul 28 17:43:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:09.615046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a405bb-699d-412b-9a61-420171856446 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:09.647574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:09.649147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:09.686540 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7420d2b-cd99-4d22-bcb3-b99fd34da461 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:09.722236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729f3c7-6063-4d8b-b8f6-8ff83a01f513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:09.722797 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729f3c7-6063-4d8b-b8f6-8ff83a01f513 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:09.723235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729f3c7-6063-4d8b-b8f6-8ff83a01f513 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:09.723696 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729f3c7-6063-4d8b-b8f6-8ff83a01f513 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:09.723880 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a405bb-699d-412b-9a61-420171856446 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:09.724807 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729f3c7-6063-4d8b-b8f6-8ff83a01f513 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:09.726820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729f3c7-6063-4d8b-b8f6-8ff83a01f513 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:09.737107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-7729f3c7-6063-4d8b-b8f6-8ff83a01f513 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:43:09.737107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:09.737107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:43:09.737107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:43:09.737107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:43:09.737107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:43:09.737107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:43:09.737107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:09.737107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:43:09.737107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:09.737107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:43:09.737107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:09.737107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:09.737107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:09.737107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:09.737107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:09.737107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:09.738148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:09.738148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:09.738148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:09.738148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:09.738148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:09.738148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:09.738148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:43:09.738148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:43:09.738148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:43:09.738148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:43:09.738148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:09.738148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:09.738148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:09.738148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:09.738148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:09.738148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:09.739507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:09.739507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:09.739507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:09.739507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:09.739507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:09.739507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:09.739507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:09.739507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:09.739507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:09.739507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:09.739507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:43:09.739507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:09.739507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:43:09.739507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:09.739507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 490/975] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Jul 28 17:43:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:09.744559 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729f3c7-6063-4d8b-b8f6-8ff83a01f513 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:09.764675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f60d8-1e0a-443d-8686-38e3c9770e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:09.765332 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f60d8-1e0a-443d-8686-38e3c9770e42 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:09.765608 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f60d8-1e0a-443d-8686-38e3c9770e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:09.765881 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f60d8-1e0a-443d-8686-38e3c9770e42 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:09.766670 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f60d8-1e0a-443d-8686-38e3c9770e42 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:09.766975 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f60d8-1e0a-443d-8686-38e3c9770e42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:09.768416 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f60d8-1e0a-443d-8686-38e3c9770e42 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:09.787771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 486/976] 10.222.0.96 () {56 vars in 1149 bytes} [Thu Jul 28 17:43:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:09.793250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f60d8-1e0a-443d-8686-38e3c9770e42 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:09.849872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729f3c7-6063-4d8b-b8f6-8ff83a01f513 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:09.880779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:09.887317 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:09.887519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754c151-fc7e-45b1-a8a1-5b408eb200e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:09.888142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754c151-fc7e-45b1-a8a1-5b408eb200e6 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:09.888430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754c151-fc7e-45b1-a8a1-5b408eb200e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:09.888849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754c151-fc7e-45b1-a8a1-5b408eb200e6 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:09.889778 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754c151-fc7e-45b1-a8a1-5b408eb200e6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:09.890181 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754c151-fc7e-45b1-a8a1-5b408eb200e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:09.891786 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754c151-fc7e-45b1-a8a1-5b408eb200e6 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:09.897237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 491/977] 10.222.0.96 () {56 vars in 1122 bytes} [Thu Jul 28 17:43:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:09.902504 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f60d8-1e0a-443d-8686-38e3c9770e42 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:09.902842 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754c151-fc7e-45b1-a8a1-5b408eb200e6 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:09.938027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf6940-864a-4f0c-af64-27de55a238bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:09.938846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf6940-864a-4f0c-af64-27de55a238bf None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:09.939127 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf6940-864a-4f0c-af64-27de55a238bf None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:09.939403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf6940-864a-4f0c-af64-27de55a238bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:10.008983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf6940-864a-4f0c-af64-27de55a238bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:10.010414 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf6940-864a-4f0c-af64-27de55a238bf None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:10.025745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754c151-fc7e-45b1-a8a1-5b408eb200e6 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:10.061022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5d958-f32f-479e-af77-8aa82145e2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:10.061665 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5d958-f32f-479e-af77-8aa82145e2bb None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:10.061949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5d958-f32f-479e-af77-8aa82145e2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:10.062342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5d958-f32f-479e-af77-8aa82145e2bb None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:10.063022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5d958-f32f-479e-af77-8aa82145e2bb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:10.063324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5d958-f32f-479e-af77-8aa82145e2bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:10.064699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5d958-f32f-479e-af77-8aa82145e2bb None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:10.069821 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 492/978] 10.222.0.96 () {56 vars in 1122 bytes} [Thu Jul 28 17:43:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:10.076058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa18312-5c26-4c94-be62-c6086fa73c90 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:10.076315 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa18312-5c26-4c94-be62-c6086fa73c90 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:10.076585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa18312-5c26-4c94-be62-c6086fa73c90 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:10.077842 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 493/979] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:10.078526 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa18312-5c26-4c94-be62-c6086fa73c90 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:10.104204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:10.119082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 487/980] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:43:09 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 17:43:10.123746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4038f10-8985-4996-92d3-85eb59a3675f None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:10.123746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4038f10-8985-4996-92d3-85eb59a3675f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:10.123746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4038f10-8985-4996-92d3-85eb59a3675f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:10.139447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a4038f10-8985-4996-92d3-85eb59a3675f None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:10.140619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a4038f10-8985-4996-92d3-85eb59a3675f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:10.143700 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:10.186441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa18312-5c26-4c94-be62-c6086fa73c90 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:10.213161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 488/981] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:10.214011 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4038f10-8985-4996-92d3-85eb59a3675f None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:10.218291 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7238b-132e-4af5-9ace-833625be3170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:10.218903 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7238b-132e-4af5-9ace-833625be3170 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:10.219181 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7238b-132e-4af5-9ace-833625be3170 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:10.219452 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7238b-132e-4af5-9ace-833625be3170 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:10.220266 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7238b-132e-4af5-9ace-833625be3170 None admin] RBAC: Adding query filter params (interface=admin, service_id=7e5c6f92cb9449aab749d637164037d8, region_id=RegionOne) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:10.220579 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7238b-132e-4af5-9ace-833625be3170 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:10.221966 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7238b-132e-4af5-9ace-833625be3170 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:10.231586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 494/982] 10.222.0.96 () {56 vars in 1249 bytes} [Thu Jul 28 17:43:10 2022] GET /identity/v3/endpoints?service_id=7e5c6f92cb9449aab749d637164037d8&interface=admin®ion_id=RegionOne => generated 193 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:10.232966 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7238b-132e-4af5-9ace-833625be3170 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:10.318871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4038f10-8985-4996-92d3-85eb59a3675f None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:10.335037 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7238b-132e-4af5-9ace-833625be3170 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:10.335870 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:10.353047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40419c-5c9e-403b-b6cf-c6baa549d1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:10.353715 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40419c-5c9e-403b-b6cf-c6baa549d1fe None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:10.353999 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40419c-5c9e-403b-b6cf-c6baa549d1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:10.354276 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40419c-5c9e-403b-b6cf-c6baa549d1fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:10.357919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:10.364436 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40419c-5c9e-403b-b6cf-c6baa549d1fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:10.365964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40419c-5c9e-403b-b6cf-c6baa549d1fe None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:10.370075 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318485f-dbad-435d-b55f-8d2775cd3a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:10.370695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318485f-dbad-435d-b55f-8d2775cd3a2c None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:10.370971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318485f-dbad-435d-b55f-8d2775cd3a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:10.371245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318485f-dbad-435d-b55f-8d2775cd3a2c None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:10.371905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1318485f-dbad-435d-b55f-8d2775cd3a2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:10.373321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1318485f-dbad-435d-b55f-8d2775cd3a2c None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:10.379287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 495/983] 10.222.0.96 () {56 vars in 1087 bytes} [Thu Jul 28 17:43:10 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:43:10.380067 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318485f-dbad-435d-b55f-8d2775cd3a2c None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:10.381236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-5b40419c-5c9e-403b-b6cf-c6baa549d1fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:10.381236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:10.381236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:10.381236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:10.381236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:10.381236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:10.381236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:10.381236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:10.381236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:10.381236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:10.381236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:10.381236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:10.381236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:43:10.381236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:43:10.381236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:43:10.382195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:43:10.382195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:10.382195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:10.382195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:10.382195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:10.382195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:10.382195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:10.382195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:10.382195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:10.382195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:10.382195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:10.382195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:10.382195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:10.382195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:10.382195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:10.382195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:10.382195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:10.383098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:43:10.383098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:43:10.383098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:10.383098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:10.383098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 489/984] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:10.389106 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40419c-5c9e-403b-b6cf-c6baa549d1fe None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:10.498629 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318485f-dbad-435d-b55f-8d2775cd3a2c None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:10.510935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40419c-5c9e-403b-b6cf-c6baa549d1fe None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:10.535880 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607194c-41a4-44c8-bbb9-69dc1e3c5a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:10.536518 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607194c-41a4-44c8-bbb9-69dc1e3c5a56 None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:10.536787 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607194c-41a4-44c8-bbb9-69dc1e3c5a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:10.537101 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607194c-41a4-44c8-bbb9-69dc1e3c5a56 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:10.538101 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607194c-41a4-44c8-bbb9-69dc1e3c5a56 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:10.539152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607194c-41a4-44c8-bbb9-69dc1e3c5a56 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:10.549907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae307c-ff92-4b6e-b108-b09688efac8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:10.549907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae307c-ff92-4b6e-b108-b09688efac8b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:10.550186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae307c-ff92-4b6e-b108-b09688efac8b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:10.550546 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae307c-ff92-4b6e-b108-b09688efac8b None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:10.551430 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae307c-ff92-4b6e-b108-b09688efac8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:10.552484 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae307c-ff92-4b6e-b108-b09688efac8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:10.553862 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae307c-ff92-4b6e-b108-b09688efac8b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:10.559110 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 496/985] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Jul 28 17:43:10 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:43:10.568427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 490/986] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:10.574444 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607194c-41a4-44c8-bbb9-69dc1e3c5a56 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:10.633006 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:10.700078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607194c-41a4-44c8-bbb9-69dc1e3c5a56 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:10.739193 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7f568-3e8f-428b-8033-fcf4fab53ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:10.739923 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7f568-3e8f-428b-8033-fcf4fab53ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:10.740212 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7f568-3e8f-428b-8033-fcf4fab53ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:10.740448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7f568-3e8f-428b-8033-fcf4fab53ac9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:10.747630 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7f568-3e8f-428b-8033-fcf4fab53ac9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:10.749116 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7f568-3e8f-428b-8033-fcf4fab53ac9 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:10.760918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-01e7f568-3e8f-428b-8033-fcf4fab53ac9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:43:10.760918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:10.760918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:10.760918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:10.760918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:10.760918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:10.760918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:10.760918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:10.760918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:10.760918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:10.760918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:10.760918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:10.760918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:43:10.760918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:43:10.760918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:43:10.761881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:43:10.761881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:10.761881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:10.761881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:10.761881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:10.761881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:10.761881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:10.761881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:10.761881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:10.761881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:10.761881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:10.761881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:10.761881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:10.761881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:10.761881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:10.761881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:10.761881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:10.763106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:43:10.763106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:43:10.763106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:43:10.763106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:43:10.763106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:43:10.763106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:43:10.763106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:43:10.763106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:10.763106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 497/987] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:43:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:10.769576 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae307c-ff92-4b6e-b108-b09688efac8b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:10.800970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:10.879902 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae307c-ff92-4b6e-b108-b09688efac8b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:10.916712 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e191a3-70ee-4223-b3b1-33fe8667613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:10.917398 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e191a3-70ee-4223-b3b1-33fe8667613d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:10.917677 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e191a3-70ee-4223-b3b1-33fe8667613d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:10.917947 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e191a3-70ee-4223-b3b1-33fe8667613d None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:10.918685 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e191a3-70ee-4223-b3b1-33fe8667613d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:10.918985 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e191a3-70ee-4223-b3b1-33fe8667613d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:10.920436 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e191a3-70ee-4223-b3b1-33fe8667613d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:10.933120 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 491/988] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:43:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:10.939109 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7f568-3e8f-428b-8033-fcf4fab53ac9 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:11.054202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7f568-3e8f-428b-8033-fcf4fab53ac9 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:11.056293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:11.089623 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cab19-fb46-4a6b-8909-6b27324688f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:11.090342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cab19-fb46-4a6b-8909-6b27324688f9 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:11.090690 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cab19-fb46-4a6b-8909-6b27324688f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:11.091032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cab19-fb46-4a6b-8909-6b27324688f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:11.091895 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cab19-fb46-4a6b-8909-6b27324688f9 None admin] RBAC: Adding query filter params (role.id=94a64ce81e2f4aea95f03b65b3903c8f, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=a1936a2649c349d481f56304b3ee55b3) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:11.092278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cab19-fb46-4a6b-8909-6b27324688f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:11.094157 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cab19-fb46-4a6b-8909-6b27324688f9 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:11.109088 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 498/989] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:43:10 2022] GET /identity/v3/role_assignments?user.id=a1936a2649c349d481f56304b3ee55b3&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=94a64ce81e2f4aea95f03b65b3903c8f => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:12.418399 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021ab29-89e0-48dc-ba57-6f596b4a632c None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:12.418966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021ab29-89e0-48dc-ba57-6f596b4a632c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:12.418966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021ab29-89e0-48dc-ba57-6f596b4a632c None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:12.420546 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 492/990] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:12.425945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af581e3-6b2d-482e-9649-ae8b86d29af5 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:12.426520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af581e3-6b2d-482e-9649-ae8b86d29af5 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:12.426520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af581e3-6b2d-482e-9649-ae8b86d29af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:12.445003 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-7af581e3-6b2d-482e-9649-ae8b86d29af5 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:12.446241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-7af581e3-6b2d-482e-9649-ae8b86d29af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:12.517678 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 499/991] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:12.540795 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021ab29-89e0-48dc-ba57-6f596b4a632c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:12.624157 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b601c-a101-44c5-be75-159b02c6bbea None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:12.624504 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b601c-a101-44c5-be75-159b02c6bbea None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:12.624700 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b601c-a101-44c5-be75-159b02c6bbea None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:12.626308 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 500/992] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:43:12.632203 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa62f4-c51c-4885-bfab-9aa51f42b518 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:12.632880 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa62f4-c51c-4885-bfab-9aa51f42b518 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:12.633720 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa62f4-c51c-4885-bfab-9aa51f42b518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:12.640569 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:12.653669 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021ab29-89e0-48dc-ba57-6f596b4a632c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:12.659731 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-0dfa62f4-c51c-4885-bfab-9aa51f42b518 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:12.661935 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-0dfa62f4-c51c-4885-bfab-9aa51f42b518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:12.692853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5048d50-a57e-482a-b981-e4b369260997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:12.693458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5048d50-a57e-482a-b981-e4b369260997 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:12.693741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5048d50-a57e-482a-b981-e4b369260997 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:12.694032 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5048d50-a57e-482a-b981-e4b369260997 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:12.694723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5048d50-a57e-482a-b981-e4b369260997 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:12.696109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5048d50-a57e-482a-b981-e4b369260997 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:12.705450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-f5048d50-a57e-482a-b981-e4b369260997 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:43:12.705450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:12.705450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:43:12.705450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:43:12.705450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:43:12.705450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:43:12.705450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:43:12.705450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:12.705450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:43:12.705450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:12.705450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:43:12.705450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:12.705450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:12.705450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:12.705450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:12.705450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:12.705450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:12.706478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:12.706478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:12.706478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:12.706478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:12.706478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:12.706478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:12.706478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:43:12.706478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:43:12.706478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:43:12.706478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:43:12.706478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:12.706478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:12.706478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:12.706478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:12.706478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:12.706478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:12.710339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:12.710339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:12.710339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:12.710339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:12.710339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:12.710339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:12.710339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:12.710339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:12.710339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:12.710339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:12.710339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:43:12.710339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:12.710339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:43:12.710339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:12.710339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 493/993] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Jul 28 17:43:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:12.712769 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5048d50-a57e-482a-b981-e4b369260997 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:12.741240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 501/994] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:43:12.762433 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa62f4-c51c-4885-bfab-9aa51f42b518 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:12.791659 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:12.830157 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5048d50-a57e-482a-b981-e4b369260997 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:12.867660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc565001-f177-45e7-8e2d-9eaefc0171ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:12.868386 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc565001-f177-45e7-8e2d-9eaefc0171ac None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:12.868677 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc565001-f177-45e7-8e2d-9eaefc0171ac None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:12.868947 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc565001-f177-45e7-8e2d-9eaefc0171ac None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:12.869659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc565001-f177-45e7-8e2d-9eaefc0171ac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:12.869967 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc565001-f177-45e7-8e2d-9eaefc0171ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:12.870209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa62f4-c51c-4885-bfab-9aa51f42b518 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:12.871431 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc565001-f177-45e7-8e2d-9eaefc0171ac None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:12.882233 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 494/995] 10.222.0.96 () {56 vars in 1122 bytes} [Thu Jul 28 17:43:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:12.883336 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc565001-f177-45e7-8e2d-9eaefc0171ac None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:12.905697 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:12.912570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb4560-13e1-4590-8770-26a89deccfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:12.913262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb4560-13e1-4590-8770-26a89deccfa6 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:12.913542 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb4560-13e1-4590-8770-26a89deccfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:12.913846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb4560-13e1-4590-8770-26a89deccfa6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:12.914465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb4560-13e1-4590-8770-26a89deccfa6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:12.915853 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb4560-13e1-4590-8770-26a89deccfa6 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:12.924870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-75bb4560-13e1-4590-8770-26a89deccfa6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:43:12.924870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:12.924870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:43:12.924870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:43:12.924870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:43:12.924870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:43:12.924870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:43:12.924870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:12.924870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:43:12.924870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:12.924870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:43:12.924870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:12.924870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:12.924870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:12.924870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:12.924870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:12.924870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:12.926098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:12.926098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:12.926098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:12.926098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:12.926098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:12.926098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:12.926098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:43:12.926098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:43:12.926098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:43:12.926098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:43:12.926098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:12.926098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:12.926098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:12.926098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:12.926098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:12.926098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:12.927043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:12.927043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:12.927043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:12.927043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:12.927043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:12.927043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:12.927043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:12.927043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:12.927043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:12.927043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:12.927043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:43:12.927043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:12.927043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:43:12.927043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:12.927043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 502/996] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:43:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:43:12.932096 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb4560-13e1-4590-8770-26a89deccfa6 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:12.999262 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc565001-f177-45e7-8e2d-9eaefc0171ac None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:13.029571 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:13.042947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb4560-13e1-4590-8770-26a89deccfa6 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:13.050594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51c170-e5b8-43a2-b779-4b58ec11bf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:13.051528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51c170-e5b8-43a2-b779-4b58ec11bf3b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:13.051998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51c170-e5b8-43a2-b779-4b58ec11bf3b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:13.052441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51c170-e5b8-43a2-b779-4b58ec11bf3b None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:13.053715 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51c170-e5b8-43a2-b779-4b58ec11bf3b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:13.054478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51c170-e5b8-43a2-b779-4b58ec11bf3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:13.056297 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51c170-e5b8-43a2-b779-4b58ec11bf3b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:13.066826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 495/997] 10.222.0.96 () {56 vars in 1122 bytes} [Thu Jul 28 17:43:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:13.068027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51c170-e5b8-43a2-b779-4b58ec11bf3b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:13.083041 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3f656-46fa-4b4a-81e7-e59b6652ebf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:13.083665 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3f656-46fa-4b4a-81e7-e59b6652ebf9 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:13.083948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3f656-46fa-4b4a-81e7-e59b6652ebf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:13.084222 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3f656-46fa-4b4a-81e7-e59b6652ebf9 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:13.084923 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3f656-46fa-4b4a-81e7-e59b6652ebf9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:13.085242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3f656-46fa-4b4a-81e7-e59b6652ebf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:13.086649 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3f656-46fa-4b4a-81e7-e59b6652ebf9 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:13.091699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 503/998] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Jul 28 17:43:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:13.097478 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3f656-46fa-4b4a-81e7-e59b6652ebf9 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:13.153224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:13.179161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51c170-e5b8-43a2-b779-4b58ec11bf3b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:13.196290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3f656-46fa-4b4a-81e7-e59b6652ebf9 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:13.217433 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c4981-c9a0-4f7d-b897-5674db76cf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:13.218057 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c4981-c9a0-4f7d-b897-5674db76cf02 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:13.218333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c4981-c9a0-4f7d-b897-5674db76cf02 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:13.218603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c4981-c9a0-4f7d-b897-5674db76cf02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:13.219296 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c4981-c9a0-4f7d-b897-5674db76cf02 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:13.220680 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c4981-c9a0-4f7d-b897-5674db76cf02 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:13.233899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed789e-ee19-40d6-aa0a-568e5198919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:13.234724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed789e-ee19-40d6-aa0a-568e5198919e None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:13.235005 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed789e-ee19-40d6-aa0a-568e5198919e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:13.235279 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed789e-ee19-40d6-aa0a-568e5198919e None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:13.235971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed789e-ee19-40d6-aa0a-568e5198919e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:13.236253 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed789e-ee19-40d6-aa0a-568e5198919e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:13.237655 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed789e-ee19-40d6-aa0a-568e5198919e None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:13.238393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 496/999] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:43:13 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:43:13.239755 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dc48b-27a0-44f4-b68e-a03abcfb34e8 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:13.240035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dc48b-27a0-44f4-b68e-a03abcfb34e8 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:13.240304 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dc48b-27a0-44f4-b68e-a03abcfb34e8 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:13.241626 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 497/1000] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:13.247393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041ec94-37b4-4649-a2d8-28d84ca51101 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:13.247678 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041ec94-37b4-4649-a2d8-28d84ca51101 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:13.247950 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041ec94-37b4-4649-a2d8-28d84ca51101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:13.250838 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 504/1001] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Jul 28 17:43:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:13.257128 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed789e-ee19-40d6-aa0a-568e5198919e None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:13.268793 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f041ec94-37b4-4649-a2d8-28d84ca51101 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:13.270207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f041ec94-37b4-4649-a2d8-28d84ca51101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:13.282507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:13.362151 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 498/1002] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:13 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:13.388196 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed789e-ee19-40d6-aa0a-568e5198919e None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:13.390034 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041ec94-37b4-4649-a2d8-28d84ca51101 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:13.425747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d3a8e-c95a-492a-8daf-896c949e46e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:13.426671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d3a8e-c95a-492a-8daf-896c949e46e6 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:13.427352 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d3a8e-c95a-492a-8daf-896c949e46e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:13.427352 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d3a8e-c95a-492a-8daf-896c949e46e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:13.428088 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d3a8e-c95a-492a-8daf-896c949e46e6 None admin] RBAC: Adding query filter params (interface=public, service_id=6ee261514d72411f9e8b3f777814a1dc, region_id=RegionOne) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:13.428396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d3a8e-c95a-492a-8daf-896c949e46e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:13.429802 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d3a8e-c95a-492a-8daf-896c949e46e6 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:13.436571 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 505/1003] 10.222.0.96 () {56 vars in 1251 bytes} [Thu Jul 28 17:43:13 2022] GET /identity/v3/endpoints?service_id=6ee261514d72411f9e8b3f777814a1dc&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:13.441887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d3a8e-c95a-492a-8daf-896c949e46e6 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:13.466171 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:13.504554 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041ec94-37b4-4649-a2d8-28d84ca51101 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:13.532742 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:13.541575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39b297-bcdb-4c8f-a90a-71b22ec05e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:13.542367 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39b297-bcdb-4c8f-a90a-71b22ec05e17 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:13.542656 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39b297-bcdb-4c8f-a90a-71b22ec05e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:13.542934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39b297-bcdb-4c8f-a90a-71b22ec05e17 None admin] PATH_INFO: `/v3/services/image` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:13.543562 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39b297-bcdb-4c8f-a90a-71b22ec05e17 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:13.544977 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39b297-bcdb-4c8f-a90a-71b22ec05e17 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:13.552169 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d3a8e-c95a-492a-8daf-896c949e46e6 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:13.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-2f39b297-bcdb-4c8f-a90a-71b22ec05e17 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:43:13.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:13.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:43:13.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:43:13.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:43:13.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:43:13.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:43:13.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:13.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:43:13.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:13.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:43:13.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:13.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:13.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:13.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:13.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:13.555052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:13.556051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:13.556051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:13.556051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:13.556051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:13.556051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:13.556051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:13.556051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:43:13.556051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:43:13.556051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:43:13.556051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:43:13.556051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:13.556051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:13.556051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:13.556051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:13.556051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:13.556051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:13.556909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:13.556909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:13.556909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:13.556909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:13.556909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:13.556909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:13.556909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:13.556909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:13.556909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:13.556909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:13.556909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:43:13.556909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:13.556909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:43:13.556909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:13.556909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 499/1004] 10.222.0.96 () {56 vars in 1105 bytes} [Thu Jul 28 17:43:13 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:43:13.562057 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39b297-bcdb-4c8f-a90a-71b22ec05e17 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:13.588857 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd65a17-a599-4705-92a1-b8044a9e00ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:13.589511 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd65a17-a599-4705-92a1-b8044a9e00ea None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:13.589795 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd65a17-a599-4705-92a1-b8044a9e00ea None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:13.590068 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd65a17-a599-4705-92a1-b8044a9e00ea None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:13.590732 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd65a17-a599-4705-92a1-b8044a9e00ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:13.592112 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd65a17-a599-4705-92a1-b8044a9e00ea None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:13.609103 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 506/1005] 10.222.0.96 () {56 vars in 1087 bytes} [Thu Jul 28 17:43:13 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:43:13.677720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39b297-bcdb-4c8f-a90a-71b22ec05e17 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:13.710106 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:13.715088 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ce6bf-785a-47a9-a943-87c8823b090e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:13.715725 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ce6bf-785a-47a9-a943-87c8823b090e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:13.716346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ce6bf-785a-47a9-a943-87c8823b090e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:13.716936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ce6bf-785a-47a9-a943-87c8823b090e None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:13.717670 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ce6bf-785a-47a9-a943-87c8823b090e None admin] RBAC: Adding query filter params (name=image) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:13.718338 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ce6bf-785a-47a9-a943-87c8823b090e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:13.719735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ce6bf-785a-47a9-a943-87c8823b090e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:13.725360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 500/1006] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:13.731465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd65a17-a599-4705-92a1-b8044a9e00ea None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:13.838669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd65a17-a599-4705-92a1-b8044a9e00ea None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:13.872481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba49ed8-4144-43da-a7c0-bec3fa61a845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:13.873134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba49ed8-4144-43da-a7c0-bec3fa61a845 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:13.873418 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba49ed8-4144-43da-a7c0-bec3fa61a845 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:13.873689 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba49ed8-4144-43da-a7c0-bec3fa61a845 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:13.874362 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba49ed8-4144-43da-a7c0-bec3fa61a845 None admin] RBAC: Adding query filter params (type=image) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:13.874663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba49ed8-4144-43da-a7c0-bec3fa61a845 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:13.876062 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba49ed8-4144-43da-a7c0-bec3fa61a845 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:13.880746 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 507/1007] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:13 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:15.277415 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f4620-b1bf-497e-9b3a-514a2c36b3df None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:15.277938 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f4620-b1bf-497e-9b3a-514a2c36b3df None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:15.277938 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f4620-b1bf-497e-9b3a-514a2c36b3df None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:15.281102 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 501/1008] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:15.284575 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87824d-c46c-438c-822b-94863137b2ac None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:15.285019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87824d-c46c-438c-822b-94863137b2ac None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:15.285239 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87824d-c46c-438c-822b-94863137b2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:15.304057 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-8c87824d-c46c-438c-822b-94863137b2ac None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:15.305312 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-8c87824d-c46c-438c-822b-94863137b2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:15.313589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:15.378056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 508/1009] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:15 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:15.410195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f4620-b1bf-497e-9b3a-514a2c36b3df None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:15.523157 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f4620-b1bf-497e-9b3a-514a2c36b3df None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:15.561183 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc666b8-242c-47a1-9f9e-abc7866cbc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:15.561719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc666b8-242c-47a1-9f9e-abc7866cbc55 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:15.561998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc666b8-242c-47a1-9f9e-abc7866cbc55 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:15.562226 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc666b8-242c-47a1-9f9e-abc7866cbc55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:15.563385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc666b8-242c-47a1-9f9e-abc7866cbc55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:15.564957 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc666b8-242c-47a1-9f9e-abc7866cbc55 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:15.566874 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 502/1010] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:15.572793 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87824d-c46c-438c-822b-94863137b2ac None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:15.617344 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1b55c-e384-4705-95ca-0c0c9d0ff73b None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:15.620299 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1b55c-e384-4705-95ca-0c0c9d0ff73b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:15.620299 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1b55c-e384-4705-95ca-0c0c9d0ff73b None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:15.620963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 503/1011] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:43:15.627015 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efaee9-758c-4557-ac43-988029d2b7d5 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:15.627586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efaee9-758c-4557-ac43-988029d2b7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:15.627885 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efaee9-758c-4557-ac43-988029d2b7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:15.647182 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a3efaee9-758c-4557-ac43-988029d2b7d5 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:15.648434 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a3efaee9-758c-4557-ac43-988029d2b7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:15.692202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87824d-c46c-438c-822b-94863137b2ac None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:15.718714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:15.728449 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 504/1012] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:15 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:43:15.728934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bffb0-d654-41c9-aee8-ed5e3e5a56f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:15.729638 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bffb0-d654-41c9-aee8-ed5e3e5a56f8 None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:15.729920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bffb0-d654-41c9-aee8-ed5e3e5a56f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:15.730194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bffb0-d654-41c9-aee8-ed5e3e5a56f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:15.730894 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bffb0-d654-41c9-aee8-ed5e3e5a56f8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:15.732328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bffb0-d654-41c9-aee8-ed5e3e5a56f8 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:15.748069 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:15.752615 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efaee9-758c-4557-ac43-988029d2b7d5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:15.765436 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 509/1013] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Jul 28 17:43:15 2022] POST /identity/v3/projects => generated 311 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:43:15.863969 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcbc34-9a70-4e68-990a-e02761b0a2aa None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:15.864541 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcbc34-9a70-4e68-990a-e02761b0a2aa None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:15.864906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcbc34-9a70-4e68-990a-e02761b0a2aa None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:15.866970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 510/1014] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:43:15.874721 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca033dd-0c98-468f-a2bb-89c5e198cdd1 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:15.875063 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca033dd-0c98-468f-a2bb-89c5e198cdd1 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:15.875279 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca033dd-0c98-468f-a2bb-89c5e198cdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:15.882863 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efaee9-758c-4557-ac43-988029d2b7d5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:15.897102 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-bca033dd-0c98-468f-a2bb-89c5e198cdd1 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:15.898379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-bca033dd-0c98-468f-a2bb-89c5e198cdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:15.924249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f6b98-4282-484d-9b36-b2ce0b0789fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:15.925025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f6b98-4282-484d-9b36-b2ce0b0789fb None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:15.925333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f6b98-4282-484d-9b36-b2ce0b0789fb None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:15.925609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f6b98-4282-484d-9b36-b2ce0b0789fb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:15.926432 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f6b98-4282-484d-9b36-b2ce0b0789fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:15.927837 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f6b98-4282-484d-9b36-b2ce0b0789fb None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:15.937675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-bb2f6b98-4282-484d-9b36-b2ce0b0789fb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:43:15.937675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:15.937675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:43:15.937675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:43:15.937675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:43:15.937675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:43:15.937675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:43:15.937675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:15.937675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:43:15.937675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:15.937675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:43:15.937675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:15.937675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:15.937675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:15.937675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:15.937675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:15.937675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:15.938935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:15.938935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:15.938935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:15.938935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:15.938935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:15.938935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:15.938935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:43:15.938935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:43:15.938935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:43:15.938935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:43:15.938935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:15.938935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:15.938935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:15.938935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:15.938935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:15.938935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:15.939943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:15.939943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:15.939943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:15.939943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:15.939943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:15.939943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:15.939943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:15.939943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:15.939943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:15.939943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:15.939943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:43:15.939943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:15.939943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:43:15.939943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:15.939943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 505/1015] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:43:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:43:15.945865 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f6b98-4282-484d-9b36-b2ce0b0789fb None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:15.980928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 511/1016] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:15 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:16.006142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca033dd-0c98-468f-a2bb-89c5e198cdd1 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:16.008736 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:16.065138 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f6b98-4282-484d-9b36-b2ce0b0789fb None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:16.101286 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f6042-0fa4-441b-91bc-faaa0ed3712d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:16.102277 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f6042-0fa4-441b-91bc-faaa0ed3712d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:16.102758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f6042-0fa4-441b-91bc-faaa0ed3712d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:16.103215 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f6042-0fa4-441b-91bc-faaa0ed3712d None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:16.104062 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f6042-0fa4-441b-91bc-faaa0ed3712d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:16.104585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f6042-0fa4-441b-91bc-faaa0ed3712d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:16.106119 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f6042-0fa4-441b-91bc-faaa0ed3712d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:16.111474 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 506/1017] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Jul 28 17:43:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:16.117219 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f6042-0fa4-441b-91bc-faaa0ed3712d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:16.118039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca033dd-0c98-468f-a2bb-89c5e198cdd1 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:16.143093 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:16.156201 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a50725-df9a-4b8a-8a81-19902d2b27f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:16.156835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a50725-df9a-4b8a-8a81-19902d2b27f9 None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:16.157196 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a50725-df9a-4b8a-8a81-19902d2b27f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:16.157468 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a50725-df9a-4b8a-8a81-19902d2b27f9 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:16.158156 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a50725-df9a-4b8a-8a81-19902d2b27f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:16.159526 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a50725-df9a-4b8a-8a81-19902d2b27f9 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:16.178610 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 512/1018] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Jul 28 17:43:16 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:43:16.241755 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f6042-0fa4-441b-91bc-faaa0ed3712d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:16.269048 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:16.290422 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd38f78-b677-4e89-a364-970978c2a471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:16.291122 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd38f78-b677-4e89-a364-970978c2a471 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:16.291349 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd38f78-b677-4e89-a364-970978c2a471 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:16.291584 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd38f78-b677-4e89-a364-970978c2a471 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:16.292265 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd38f78-b677-4e89-a364-970978c2a471 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:16.292564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd38f78-b677-4e89-a364-970978c2a471 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:16.293997 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd38f78-b677-4e89-a364-970978c2a471 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:16.299865 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 507/1019] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Jul 28 17:43:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:16.306003 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a50725-df9a-4b8a-8a81-19902d2b27f9 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:16.413866 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a50725-df9a-4b8a-8a81-19902d2b27f9 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:16.446880 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c5643-6c5f-4396-b0b2-2c7708728449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:16.447502 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c5643-6c5f-4396-b0b2-2c7708728449 None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:16.447779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c5643-6c5f-4396-b0b2-2c7708728449 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:16.448047 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c5643-6c5f-4396-b0b2-2c7708728449 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:16.448749 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c5643-6c5f-4396-b0b2-2c7708728449 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:16.450148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c5643-6c5f-4396-b0b2-2c7708728449 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:16.473598 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 513/1020] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:43:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:43:17.858147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f027b85-993b-4740-a6ca-2a471bdd2589 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:17.858710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f027b85-993b-4740-a6ca-2a471bdd2589 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:17.858710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f027b85-993b-4740-a6ca-2a471bdd2589 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:17.860232 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 508/1021] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:17.865718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e6e0b-4d25-4bed-81be-664a94912561 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:17.866157 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e6e0b-4d25-4bed-81be-664a94912561 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:17.866241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e6e0b-4d25-4bed-81be-664a94912561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:17.889001 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-b09e6e0b-4d25-4bed-81be-664a94912561 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:17.890238 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b09e6e0b-4d25-4bed-81be-664a94912561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:17.928164 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:17.969104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 514/1022] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:17.993344 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f027b85-993b-4740-a6ca-2a471bdd2589 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:18.108933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f027b85-993b-4740-a6ca-2a471bdd2589 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:18.145030 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e05998-adf2-49c6-9902-467f27007825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:18.145698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e05998-adf2-49c6-9902-467f27007825 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:18.145993 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e05998-adf2-49c6-9902-467f27007825 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:18.146252 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e05998-adf2-49c6-9902-467f27007825 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:18.147413 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e05998-adf2-49c6-9902-467f27007825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:18.148883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e05998-adf2-49c6-9902-467f27007825 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:18.150809 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 509/1023] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:18.156607 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e6e0b-4d25-4bed-81be-664a94912561 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:18.199456 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8068f-a124-4bb8-a793-c71d6bd89d46 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:18.199802 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8068f-a124-4bb8-a793-c71d6bd89d46 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:18.200002 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8068f-a124-4bb8-a793-c71d6bd89d46 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:18.201522 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 510/1024] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:43:18.207886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928a0ec-e526-44b9-9b73-fd78ff45961e None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:18.208334 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928a0ec-e526-44b9-9b73-fd78ff45961e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:18.208677 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928a0ec-e526-44b9-9b73-fd78ff45961e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:18.228051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-0928a0ec-e526-44b9-9b73-fd78ff45961e None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:18.229316 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0928a0ec-e526-44b9-9b73-fd78ff45961e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:18.269666 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e6e0b-4d25-4bed-81be-664a94912561 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:18.280761 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:18.304889 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 511/1025] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:18.305226 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db8502-cc07-49b6-9570-962ab96e2e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:18.305793 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db8502-cc07-49b6-9570-962ab96e2e86 None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:18.306063 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db8502-cc07-49b6-9570-962ab96e2e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:18.306335 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db8502-cc07-49b6-9570-962ab96e2e86 None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:18.307015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db8502-cc07-49b6-9570-962ab96e2e86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:18.308435 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db8502-cc07-49b6-9570-962ab96e2e86 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:18.328364 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928a0ec-e526-44b9-9b73-fd78ff45961e None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:18.341090 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 515/1026] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Jul 28 17:43:18 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:43:18.449653 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928a0ec-e526-44b9-9b73-fd78ff45961e None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:18.485935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd71071-11ae-4bee-b112-0bd62402b179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:18.487065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd71071-11ae-4bee-b112-0bd62402b179 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:18.487065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd71071-11ae-4bee-b112-0bd62402b179 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:18.487241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd71071-11ae-4bee-b112-0bd62402b179 None admin] PATH_INFO: `/v3/services/image` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:18.488494 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd71071-11ae-4bee-b112-0bd62402b179 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:18.489209 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd71071-11ae-4bee-b112-0bd62402b179 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:18.499047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-7bd71071-11ae-4bee-b112-0bd62402b179 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:43:18.499047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:18.499047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:43:18.499047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:43:18.499047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:43:18.499047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:43:18.499047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:43:18.499047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:18.499047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:43:18.499047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:18.499047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:43:18.499047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:18.499047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:18.499047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:18.499047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:18.499047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:18.499047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:18.500068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:18.500068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:18.500068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:18.500068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:18.500068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:18.500068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:18.500068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:43:18.500068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:43:18.500068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:43:18.500068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:43:18.500068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:18.500068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:18.500068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:18.500068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:18.500068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:18.500068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:18.500917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:18.500917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:18.500917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:18.500917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:18.500917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:18.500917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:18.500917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:18.500917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:18.500917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:18.500917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:18.500917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:43:18.500917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:18.500917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:43:18.500917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:18.500917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 512/1027] 10.222.0.96 () {56 vars in 1105 bytes} [Thu Jul 28 17:43:18 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:18.506681 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db8502-cc07-49b6-9570-962ab96e2e86 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:18.536314 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:18.609788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2ada6-80a9-4153-9d03-5de72bc3ac49 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:18.610123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2ada6-80a9-4153-9d03-5de72bc3ac49 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:18.610394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2ada6-80a9-4153-9d03-5de72bc3ac49 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:18.611830 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 513/1028] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:43:18.617141 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3503fe-715b-4164-abc4-59c1b1a26a3a None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:18.617436 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3503fe-715b-4164-abc4-59c1b1a26a3a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:18.617709 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3503fe-715b-4164-abc4-59c1b1a26a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:18.620218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db8502-cc07-49b6-9570-962ab96e2e86 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:18.638261 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-5a3503fe-715b-4164-abc4-59c1b1a26a3a None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:18.639462 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5a3503fe-715b-4164-abc4-59c1b1a26a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:18.658547 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb908e88-9561-4128-b1da-6e3fdcc0bd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:18.659169 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb908e88-9561-4128-b1da-6e3fdcc0bd53 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:18.659445 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb908e88-9561-4128-b1da-6e3fdcc0bd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:18.659714 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb908e88-9561-4128-b1da-6e3fdcc0bd53 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:18.660434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb908e88-9561-4128-b1da-6e3fdcc0bd53 None admin] RBAC: Adding query filter params (name=image) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:18.660836 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb908e88-9561-4128-b1da-6e3fdcc0bd53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:18.662251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb908e88-9561-4128-b1da-6e3fdcc0bd53 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:18.667313 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 516/1029] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:18.672995 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb908e88-9561-4128-b1da-6e3fdcc0bd53 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:18.685125 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:18.722395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 514/1030] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:43:18.746185 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3503fe-715b-4164-abc4-59c1b1a26a3a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:18.770489 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:18.787632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb908e88-9561-4128-b1da-6e3fdcc0bd53 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:18.823539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3372de3-55fb-42b5-8043-6a39fa8d67e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:18.824161 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3372de3-55fb-42b5-8043-6a39fa8d67e7 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:18.824438 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3372de3-55fb-42b5-8043-6a39fa8d67e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:18.824709 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3372de3-55fb-42b5-8043-6a39fa8d67e7 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:18.825412 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3372de3-55fb-42b5-8043-6a39fa8d67e7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:18.825715 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3372de3-55fb-42b5-8043-6a39fa8d67e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:18.827192 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3372de3-55fb-42b5-8043-6a39fa8d67e7 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:18.832699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 517/1031] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:18.838222 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3372de3-55fb-42b5-8043-6a39fa8d67e7 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:18.853981 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3503fe-715b-4164-abc4-59c1b1a26a3a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:18.891295 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda97b8e-b97e-4464-802d-cfaa339c8433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:18.894045 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda97b8e-b97e-4464-802d-cfaa339c8433 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:18.894329 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda97b8e-b97e-4464-802d-cfaa339c8433 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:18.894692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda97b8e-b97e-4464-802d-cfaa339c8433 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:18.910392 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda97b8e-b97e-4464-802d-cfaa339c8433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:43:18.915664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-eda97b8e-b97e-4464-802d-cfaa339c8433 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:43:18.915664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:18.915664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:18.915664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:18.915664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:18.915664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:18.915664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:18.915664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:18.915664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:18.915664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:18.915664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:18.915664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:18.915664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:43:18.915664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:43:18.915664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:43:18.915664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:43:18.916625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:43:18.916625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:43:18.916625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:43:18.916625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:43:18.916625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:18.916625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:18.916625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:18.916625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:18.916625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:18.916625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:18.916625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:18.916625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:18.916625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:18.916625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:18.916625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:18.916625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:18.922447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:18.922447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:18.922447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:18.922447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:18.922447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:43:18.922447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:43:18.922447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:43:18.922447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:43:18.922447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:43:18.922447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:43:18.922447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:43:18.922447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:18.922447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 515/1032] 10.222.0.96 () {56 vars in 1120 bytes} [Thu Jul 28 17:43:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:18.925021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda97b8e-b97e-4464-802d-cfaa339c8433 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:18.948286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3372de3-55fb-42b5-8043-6a39fa8d67e7 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:18.963883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:18.987643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9c18e-49c7-4ea4-ba79-4b99b802a606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:18.988651 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9c18e-49c7-4ea4-ba79-4b99b802a606 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:18.989122 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9c18e-49c7-4ea4-ba79-4b99b802a606 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:18.989401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9c18e-49c7-4ea4-ba79-4b99b802a606 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:18.990164 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9c18e-49c7-4ea4-ba79-4b99b802a606 None admin] RBAC: Adding query filter params (interface=public, service_id=3cc98dd4a6324c43b0ca88e34e4ec074, region_id=RegionOne) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:18.990477 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9c18e-49c7-4ea4-ba79-4b99b802a606 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:18.991926 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9c18e-49c7-4ea4-ba79-4b99b802a606 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:19.001997 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 518/1033] 10.222.0.96 () {56 vars in 1251 bytes} [Thu Jul 28 17:43:18 2022] GET /identity/v3/endpoints?service_id=3cc98dd4a6324c43b0ca88e34e4ec074&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:19.003058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9c18e-49c7-4ea4-ba79-4b99b802a606 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:19.027400 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:19.046048 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda97b8e-b97e-4464-802d-cfaa339c8433 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:19.081698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff93a20-027e-4709-b5ac-338e7c36d974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:19.082565 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff93a20-027e-4709-b5ac-338e7c36d974 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:19.083077 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff93a20-027e-4709-b5ac-338e7c36d974 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:19.083385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff93a20-027e-4709-b5ac-338e7c36d974 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:19.084121 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff93a20-027e-4709-b5ac-338e7c36d974 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:19.084428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff93a20-027e-4709-b5ac-338e7c36d974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:19.085872 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff93a20-027e-4709-b5ac-338e7c36d974 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:19.099550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 516/1034] 10.222.0.96 () {56 vars in 1115 bytes} [Thu Jul 28 17:43:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:19.100738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff93a20-027e-4709-b5ac-338e7c36d974 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:19.125851 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9c18e-49c7-4ea4-ba79-4b99b802a606 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:19.159895 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc25a50-0135-4374-bea2-ecfe52456068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:19.160790 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc25a50-0135-4374-bea2-ecfe52456068 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:19.161087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc25a50-0135-4374-bea2-ecfe52456068 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:19.161546 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc25a50-0135-4374-bea2-ecfe52456068 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:19.162208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc25a50-0135-4374-bea2-ecfe52456068 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:19.163634 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc25a50-0135-4374-bea2-ecfe52456068 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:19.181103 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 519/1035] 10.222.0.96 () {56 vars in 1087 bytes} [Thu Jul 28 17:43:19 2022] GET /identity/v3/services => generated 1957 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:43:19.212492 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:19.220731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff93a20-027e-4709-b5ac-338e7c36d974 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:19.261471 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ceb432-74fa-4f7c-bb26-effd07df9c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:19.262375 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ceb432-74fa-4f7c-bb26-effd07df9c35 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:19.262657 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ceb432-74fa-4f7c-bb26-effd07df9c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:19.262927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ceb432-74fa-4f7c-bb26-effd07df9c35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:19.275942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ceb432-74fa-4f7c-bb26-effd07df9c35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:19.277504 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ceb432-74fa-4f7c-bb26-effd07df9c35 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:19.302888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-a0ceb432-74fa-4f7c-bb26-effd07df9c35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:19.302888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:19.302888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:19.302888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:19.302888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:19.302888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:19.302888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:19.302888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:19.302888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:19.302888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:19.302888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:19.302888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:19.302888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:43:19.302888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:43:19.302888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:43:19.303976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:43:19.303976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:19.303976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:19.303976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:19.303976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:19.303976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:19.303976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:19.303976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:19.303976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:19.303976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:19.303976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:19.303976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:19.303976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:19.303976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:19.303976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:19.303976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:19.303976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:19.304913 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:43:19.304913 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:43:19.304913 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:19.304913 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:19.304913 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 517/1036] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:19.310306 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc25a50-0135-4374-bea2-ecfe52456068 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:19.394345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:19.416863 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc25a50-0135-4374-bea2-ecfe52456068 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:19.450948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5accbe-08f5-45a7-8d10-dacaa48dd477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:19.451580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5accbe-08f5-45a7-8d10-dacaa48dd477 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:19.451856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5accbe-08f5-45a7-8d10-dacaa48dd477 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:19.452127 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5accbe-08f5-45a7-8d10-dacaa48dd477 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:19.452822 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5accbe-08f5-45a7-8d10-dacaa48dd477 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:19.453165 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5accbe-08f5-45a7-8d10-dacaa48dd477 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:19.454537 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5accbe-08f5-45a7-8d10-dacaa48dd477 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:19.466922 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 520/1037] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:19.472427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ceb432-74fa-4f7c-bb26-effd07df9c35 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:19.582263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ceb432-74fa-4f7c-bb26-effd07df9c35 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:19.618726 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6371ea-fef9-416d-bbd2-a62f0a289fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:19.619377 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6371ea-fef9-416d-bbd2-a62f0a289fda None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:19.619656 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6371ea-fef9-416d-bbd2-a62f0a289fda None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:19.619933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6371ea-fef9-416d-bbd2-a62f0a289fda None admin] PATH_INFO: `/v3/users/nova` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:19.627934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6371ea-fef9-416d-bbd2-a62f0a289fda None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:19.629458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6371ea-fef9-416d-bbd2-a62f0a289fda None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:19.641403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-ab6371ea-fef9-416d-bbd2-a62f0a289fda None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:43:19.641403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:19.641403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:19.641403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:19.641403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:19.641403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:19.641403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:19.641403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:19.641403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:19.641403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:19.641403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:19.641403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:19.641403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:43:19.641403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:43:19.641403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:43:19.641403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:43:19.642380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:19.642380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:19.642380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:43:19.642380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:43:19.642380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:43:19.642380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:43:19.642380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:19.642380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:19.642380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:19.642380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:19.642380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:19.642380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:19.642380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:19.642380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:19.642380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:19.642380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:19.642380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:19.642380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:19.643333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:19.643333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:19.643333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:43:19.643333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:43:19.643333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:43:19.643333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:43:19.643333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:43:19.643333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:43:19.643333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:43:19.643333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:19.643333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 518/1038] 10.222.0.96 () {56 vars in 1093 bytes} [Thu Jul 28 17:43:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:19.652074 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5accbe-08f5-45a7-8d10-dacaa48dd477 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:19.751124 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5accbe-08f5-45a7-8d10-dacaa48dd477 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:19.785548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97531d-8442-4ac3-9f1b-716dd14bd76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:19.786372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97531d-8442-4ac3-9f1b-716dd14bd76e None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:19.786654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97531d-8442-4ac3-9f1b-716dd14bd76e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:19.786931 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97531d-8442-4ac3-9f1b-716dd14bd76e None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:19.787728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97531d-8442-4ac3-9f1b-716dd14bd76e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:19.788040 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97531d-8442-4ac3-9f1b-716dd14bd76e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:19.789693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97531d-8442-4ac3-9f1b-716dd14bd76e None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:19.797975 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:19.808846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 521/1039] 10.222.0.96 () {56 vars in 1133 bytes} [Thu Jul 28 17:43:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:19.814356 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6371ea-fef9-416d-bbd2-a62f0a289fda None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:19.826562 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:19.923845 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6371ea-fef9-416d-bbd2-a62f0a289fda None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:19.957597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe110a0-87f8-4a10-bf67-f163d857ff0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:19.958343 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe110a0-87f8-4a10-bf67-f163d857ff0d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:19.958626 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe110a0-87f8-4a10-bf67-f163d857ff0d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:19.958907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe110a0-87f8-4a10-bf67-f163d857ff0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:20.032603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe110a0-87f8-4a10-bf67-f163d857ff0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:20.034407 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe110a0-87f8-4a10-bf67-f163d857ff0d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:20.044874 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:20.141134 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 519/1040] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:43:19 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:43:20.142829 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97531d-8442-4ac3-9f1b-716dd14bd76e None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:20.249081 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97531d-8442-4ac3-9f1b-716dd14bd76e None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:20.284089 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccf1ce-92a7-45b0-bd72-8ffee5bdb9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:20.284785 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccf1ce-92a7-45b0-bd72-8ffee5bdb9bb None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:20.285084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccf1ce-92a7-45b0-bd72-8ffee5bdb9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:20.285609 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccf1ce-92a7-45b0-bd72-8ffee5bdb9bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:20.295964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccf1ce-92a7-45b0-bd72-8ffee5bdb9bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:20.297445 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccf1ce-92a7-45b0-bd72-8ffee5bdb9bb None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:20.314354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-2fccf1ce-92a7-45b0-bd72-8ffee5bdb9bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:20.314354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:20.314354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:20.314354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:20.314354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:20.314354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:20.314354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:20.314354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:20.314354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:20.314354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:20.314354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:20.314354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:20.314354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:43:20.314354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:43:20.314354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:43:20.315386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:43:20.315386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:20.315386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:20.315386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:20.315386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:20.315386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:20.315386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:20.315386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:20.315386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:20.315386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:20.315386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:20.315386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:20.315386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:20.315386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:20.315386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:20.315386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:20.315386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:20.316290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:43:20.316290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:43:20.316290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:20.316290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:20.316980 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 522/1041] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:43:20.324508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe110a0-87f8-4a10-bf67-f163d857ff0d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:20.433906 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe110a0-87f8-4a10-bf67-f163d857ff0d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:20.444725 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:20.448440 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaead8-872c-43d0-8997-b507e980a800 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:20.448800 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaead8-872c-43d0-8997-b507e980a800 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:20.449189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaead8-872c-43d0-8997-b507e980a800 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:20.450889 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 523/1042] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:20.455554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac5e76-1722-4ce9-9f63-967881f5aeba None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:20.455833 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac5e76-1722-4ce9-9f63-967881f5aeba None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:20.456104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac5e76-1722-4ce9-9f63-967881f5aeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:20.473872 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47040003-ef46-4f06-b8ac-23fe69173553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:20.474523 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47040003-ef46-4f06-b8ac-23fe69173553 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:20.474800 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47040003-ef46-4f06-b8ac-23fe69173553 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:20.475079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47040003-ef46-4f06-b8ac-23fe69173553 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:20.475625 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-9fac5e76-1722-4ce9-9f63-967881f5aeba None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:20.475789 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47040003-ef46-4f06-b8ac-23fe69173553 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:20.476053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47040003-ef46-4f06-b8ac-23fe69173553 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:20.476886 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9fac5e76-1722-4ce9-9f63-967881f5aeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:20.477536 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47040003-ef46-4f06-b8ac-23fe69173553 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:20.491272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 520/1043] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:20.496811 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47040003-ef46-4f06-b8ac-23fe69173553 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:20.526021 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:20.554702 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 524/1044] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:43:20.578197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac5e76-1722-4ce9-9f63-967881f5aeba None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:20.605661 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47040003-ef46-4f06-b8ac-23fe69173553 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:20.641665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee3d24-5258-4f9f-bb66-71baa45e4271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:20.641906 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee3d24-5258-4f9f-bb66-71baa45e4271 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:20.642183 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee3d24-5258-4f9f-bb66-71baa45e4271 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:20.642452 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee3d24-5258-4f9f-bb66-71baa45e4271 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:20.650146 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee3d24-5258-4f9f-bb66-71baa45e4271 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:20.651599 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee3d24-5258-4f9f-bb66-71baa45e4271 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:20.663486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-f9ee3d24-5258-4f9f-bb66-71baa45e4271 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:43:20.663486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:20.663486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:20.663486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:20.663486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:20.663486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:20.663486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:20.663486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:20.663486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:20.663486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:20.663486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:20.663486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:20.663486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:43:20.663486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:43:20.663486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:43:20.664457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:43:20.664457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:20.664457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:20.664457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:20.664457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:20.664457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:20.664457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:20.664457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:20.664457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:20.664457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:20.664457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:20.664457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:20.664457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:20.664457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:20.664457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:20.664457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:20.664457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:20.665389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:43:20.665389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:43:20.665389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:43:20.665389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:43:20.665389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:43:20.665389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:43:20.665389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:43:20.665389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:20.665389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 521/1045] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:43:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:43:20.670418 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee3d24-5258-4f9f-bb66-71baa45e4271 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:20.685262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac5e76-1722-4ce9-9f63-967881f5aeba None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:20.700387 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:20.728685 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226e001-078b-4ec9-89df-4fc8ea36d7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:20.729718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226e001-078b-4ec9-89df-4fc8ea36d7eb None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:20.729998 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226e001-078b-4ec9-89df-4fc8ea36d7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:20.730275 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226e001-078b-4ec9-89df-4fc8ea36d7eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:20.741852 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226e001-078b-4ec9-89df-4fc8ea36d7eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:43:20.746668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-b226e001-078b-4ec9-89df-4fc8ea36d7eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:43:20.746668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:20.746668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:20.746668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:20.746668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:20.746668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:20.746668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:20.746668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:20.746668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:20.746668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:20.746668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:20.746668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:20.746668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:43:20.746668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:43:20.746668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:43:20.746668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:43:20.747624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:43:20.747624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:43:20.747624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:43:20.747624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:43:20.747624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:20.747624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:20.747624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:20.747624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:20.747624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:20.747624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:20.747624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:20.747624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:20.747624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:20.747624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:20.747624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:20.747624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:20.748450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:20.748450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:20.748450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:20.748450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:20.748450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:43:20.748450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:43:20.748450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:43:20.748450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:43:20.748450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:43:20.748450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:43:20.748450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:43:20.748450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:20.748450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 525/1046] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:43:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:43:20.754159 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226e001-078b-4ec9-89df-4fc8ea36d7eb None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:20.779337 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee3d24-5258-4f9f-bb66-71baa45e4271 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:20.798775 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:20.814976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91924d9e-55eb-48d3-a886-46a6e1544a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:20.815604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91924d9e-55eb-48d3-a886-46a6e1544a3c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:20.815884 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91924d9e-55eb-48d3-a886-46a6e1544a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:20.816152 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91924d9e-55eb-48d3-a886-46a6e1544a3c None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:20.816938 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91924d9e-55eb-48d3-a886-46a6e1544a3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:20.817276 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91924d9e-55eb-48d3-a886-46a6e1544a3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:20.818707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91924d9e-55eb-48d3-a886-46a6e1544a3c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:20.832074 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 522/1047] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:43:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:20.838270 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91924d9e-55eb-48d3-a886-46a6e1544a3c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:20.863616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226e001-078b-4ec9-89df-4fc8ea36d7eb None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:20.899412 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17cbd1-82a1-4397-9b73-ba8327501a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:20.900351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17cbd1-82a1-4397-9b73-ba8327501a24 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:20.900625 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17cbd1-82a1-4397-9b73-ba8327501a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:20.900926 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17cbd1-82a1-4397-9b73-ba8327501a24 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:20.901689 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17cbd1-82a1-4397-9b73-ba8327501a24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:20.901990 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17cbd1-82a1-4397-9b73-ba8327501a24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:20.903391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17cbd1-82a1-4397-9b73-ba8327501a24 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:20.911746 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 526/1048] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:43:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:20.917622 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17cbd1-82a1-4397-9b73-ba8327501a24 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:20.938598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:20.952271 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91924d9e-55eb-48d3-a886-46a6e1544a3c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:20.987087 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a5ee7-fa55-4855-834f-332f79a73e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:20.987710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a5ee7-fa55-4855-834f-332f79a73e17 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:20.987990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a5ee7-fa55-4855-834f-332f79a73e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:20.988520 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a5ee7-fa55-4855-834f-332f79a73e17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:20.989400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a5ee7-fa55-4855-834f-332f79a73e17 None admin] RBAC: Adding query filter params (role.id=94a64ce81e2f4aea95f03b65b3903c8f, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=5ac367247aa54671ae5c33d251017470) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:20.989605 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a5ee7-fa55-4855-834f-332f79a73e17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:20.991235 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a5ee7-fa55-4855-834f-332f79a73e17 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:20.996888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 523/1049] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:43:20 2022] GET /identity/v3/role_assignments?user.id=5ac367247aa54671ae5c33d251017470&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=94a64ce81e2f4aea95f03b65b3903c8f => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:21.030638 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:21.033417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17cbd1-82a1-4397-9b73-ba8327501a24 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:21.071712 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86b7df-dc7c-425a-b4e6-3f31556bbc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:21.072404 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86b7df-dc7c-425a-b4e6-3f31556bbc16 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:21.072696 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86b7df-dc7c-425a-b4e6-3f31556bbc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:21.072963 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86b7df-dc7c-425a-b4e6-3f31556bbc16 None admin] PATH_INFO: `/v3/users/b82bb3dcb9b8466b96f1afa8d1f70875` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:21.089155 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86b7df-dc7c-425a-b4e6-3f31556bbc16 None admin] RBAC: Authorizing `identity:get_user(user_id=b82bb3dcb9b8466b96f1afa8d1f70875)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:21.090660 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86b7df-dc7c-425a-b4e6-3f31556bbc16 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:21.092667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 527/1050] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:43:20 2022] GET /identity/v3/users/b82bb3dcb9b8466b96f1afa8d1f70875 => generated 285 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:21.098636 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a5ee7-fa55-4855-834f-332f79a73e17 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:21.216089 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a5ee7-fa55-4855-834f-332f79a73e17 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:21.246624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a332aa-cb19-4162-abae-edf77eff98f3 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:21.247182 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a332aa-cb19-4162-abae-edf77eff98f3 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:21.247288 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a332aa-cb19-4162-abae-edf77eff98f3 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:21.248960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 528/1051] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:43:21.251463 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9304c1b-89e0-45ca-90eb-730ea504ea77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:21.252086 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9304c1b-89e0-45ca-90eb-730ea504ea77 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:21.252361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9304c1b-89e0-45ca-90eb-730ea504ea77 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:21.252629 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9304c1b-89e0-45ca-90eb-730ea504ea77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:21.254349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbaae63-c537-460e-a475-03ef0eb36488 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:21.254834 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbaae63-c537-460e-a475-03ef0eb36488 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:21.255306 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbaae63-c537-460e-a475-03ef0eb36488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:21.277650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:21.279952 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-efbaae63-c537-460e-a475-03ef0eb36488 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:21.281528 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-efbaae63-c537-460e-a475-03ef0eb36488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:21.329501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9304c1b-89e0-45ca-90eb-730ea504ea77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:21.330939 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9304c1b-89e0-45ca-90eb-730ea504ea77 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:21.355747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 529/1052] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:43:21.378622 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbaae63-c537-460e-a475-03ef0eb36488 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:21.445129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 524/1053] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:43:21 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:43:21.447890 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9304c1b-89e0-45ca-90eb-730ea504ea77 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:21.478327 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:21.492053 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbaae63-c537-460e-a475-03ef0eb36488 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:21.506800 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:21.528812 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385229f-026c-4292-8725-14fc15f7c1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:21.529494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385229f-026c-4292-8725-14fc15f7c1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:21.529776 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385229f-026c-4292-8725-14fc15f7c1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:21.530286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385229f-026c-4292-8725-14fc15f7c1e3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:21.530701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385229f-026c-4292-8725-14fc15f7c1e3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:21.532209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385229f-026c-4292-8725-14fc15f7c1e3 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:21.542391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-3385229f-026c-4292-8725-14fc15f7c1e3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:43:21.542391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:21.542391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:43:21.542391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:43:21.542391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:43:21.542391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:43:21.542391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:43:21.542391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:21.542391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:43:21.542391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:21.542391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:43:21.542391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:21.542391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:21.542391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:21.542391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:21.542391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:21.542391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:21.543399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:21.543399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:21.543399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:21.543399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:21.543399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:21.543399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:21.543399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:43:21.543399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:43:21.543399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:43:21.543399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:43:21.543399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:21.543399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:21.543399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:21.543399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:21.543399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:21.543399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:21.544232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:21.544232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:21.544232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:21.544232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:21.544232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:21.544232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:21.544232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:21.544232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:21.544232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:21.544232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:21.544232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:43:21.544232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:43:21.544232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:43:21.544232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:21.544232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 530/1054] 10.222.0.96 () {56 vars in 1105 bytes} [Thu Jul 28 17:43:21 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:43:21.549875 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385229f-026c-4292-8725-14fc15f7c1e3 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:21.558480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9304c1b-89e0-45ca-90eb-730ea504ea77 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:21.599800 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a1da7-53a0-4208-b243-ba9daf411419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:21.600580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a1da7-53a0-4208-b243-ba9daf411419 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:21.600863 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a1da7-53a0-4208-b243-ba9daf411419 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:21.601476 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a1da7-53a0-4208-b243-ba9daf411419 None admin] PATH_INFO: `/v3/projects/0882e47489ee43bd81103e93525ded76` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:21.603672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a1da7-53a0-4208-b243-ba9daf411419 None admin] RBAC: Authorizing `identity:get_project(project_id=0882e47489ee43bd81103e93525ded76)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:21.605844 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a1da7-53a0-4208-b243-ba9daf411419 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:21.612706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 525/1055] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:43:21 2022] GET /identity/v3/projects/0882e47489ee43bd81103e93525ded76 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:21.613846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a1da7-53a0-4208-b243-ba9daf411419 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:21.667950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385229f-026c-4292-8725-14fc15f7c1e3 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:21.703352 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29a107-d2fd-4fc9-91d4-7b16f42ec8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:21.704096 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29a107-d2fd-4fc9-91d4-7b16f42ec8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:21.704375 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29a107-d2fd-4fc9-91d4-7b16f42ec8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:21.704649 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29a107-d2fd-4fc9-91d4-7b16f42ec8a7 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:21.705361 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29a107-d2fd-4fc9-91d4-7b16f42ec8a7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:21.705667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29a107-d2fd-4fc9-91d4-7b16f42ec8a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:21.707068 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29a107-d2fd-4fc9-91d4-7b16f42ec8a7 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:21.717025 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 531/1056] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:21.718557 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29a107-d2fd-4fc9-91d4-7b16f42ec8a7 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:21.728188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a1da7-53a0-4208-b243-ba9daf411419 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:21.737782 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:21.751089 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:21.767502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb097f-1f59-4b7a-b0bf-773128e02614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:21.768383 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb097f-1f59-4b7a-b0bf-773128e02614 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:21.768899 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb097f-1f59-4b7a-b0bf-773128e02614 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:21.769244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb097f-1f59-4b7a-b0bf-773128e02614 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:21.770546 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb097f-1f59-4b7a-b0bf-773128e02614 None admin] RBAC: Adding query filter params (role.id=980cae90acae42189f92fd6dd42867a5, scope.project.id=0882e47489ee43bd81103e93525ded76, user.id=b82bb3dcb9b8466b96f1afa8d1f70875) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:21.770935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb097f-1f59-4b7a-b0bf-773128e02614 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:21.772375 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb097f-1f59-4b7a-b0bf-773128e02614 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:21.788145 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 526/1057] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:43:21 2022] GET /identity/v3/role_assignments?user.id=b82bb3dcb9b8466b96f1afa8d1f70875&scope.project.id=0882e47489ee43bd81103e93525ded76&role.id=980cae90acae42189f92fd6dd42867a5 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:21.831910 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29a107-d2fd-4fc9-91d4-7b16f42ec8a7 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:21.875782 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bbe9f-4986-46da-8fd8-9eb42d53a3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:21.876423 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bbe9f-4986-46da-8fd8-9eb42d53a3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:21.876674 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bbe9f-4986-46da-8fd8-9eb42d53a3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:21.876949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bbe9f-4986-46da-8fd8-9eb42d53a3f2 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:21.877703 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bbe9f-4986-46da-8fd8-9eb42d53a3f2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:21.878010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bbe9f-4986-46da-8fd8-9eb42d53a3f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:21.879619 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bbe9f-4986-46da-8fd8-9eb42d53a3f2 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:21.885975 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 532/1058] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:21.892326 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb097f-1f59-4b7a-b0bf-773128e02614 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:22.005336 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb097f-1f59-4b7a-b0bf-773128e02614 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:22.047443 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0689f1-9652-4c02-a51c-9ec419d4a509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:22.047997 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0689f1-9652-4c02-a51c-9ec419d4a509 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:22.048274 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0689f1-9652-4c02-a51c-9ec419d4a509 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:22.048551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0689f1-9652-4c02-a51c-9ec419d4a509 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:22.049297 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0689f1-9652-4c02-a51c-9ec419d4a509 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:22.050721 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0689f1-9652-4c02-a51c-9ec419d4a509 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:22.079346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 527/1059] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:43:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:43:22.995982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b43478-e873-4261-9f7c-47580743e17d None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:22.996555 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b43478-e873-4261-9f7c-47580743e17d None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:22.996555 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b43478-e873-4261-9f7c-47580743e17d None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:22.998111 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 533/1060] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:23.003365 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d178c-7c97-4190-b5bd-37903a14bda4 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:23.003632 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d178c-7c97-4190-b5bd-37903a14bda4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:23.003988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d178c-7c97-4190-b5bd-37903a14bda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:23.025909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-300d178c-7c97-4190-b5bd-37903a14bda4 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:23.025909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-300d178c-7c97-4190-b5bd-37903a14bda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:23.060317 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:23.100392 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 528/1061] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:23.122691 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b43478-e873-4261-9f7c-47580743e17d None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:23.211513 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:23.233801 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b43478-e873-4261-9f7c-47580743e17d None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:23.271363 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82f38c-046e-4eb7-8a0f-a9852a5fcea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:23.271938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82f38c-046e-4eb7-8a0f-a9852a5fcea9 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:23.272213 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82f38c-046e-4eb7-8a0f-a9852a5fcea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:23.272550 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82f38c-046e-4eb7-8a0f-a9852a5fcea9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:23.283192 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82f38c-046e-4eb7-8a0f-a9852a5fcea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:43:23.288162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-4d82f38c-046e-4eb7-8a0f-a9852a5fcea9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:43:23.288162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:23.288162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:23.288162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:23.288162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:23.288162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:23.288162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:23.288162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:23.288162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:23.288162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:23.288162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:23.288162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:23.288162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:43:23.288162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:43:23.288162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:43:23.288162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:43:23.289371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:43:23.289371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:43:23.289371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:43:23.289371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:43:23.289371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:23.289371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:23.289371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:23.289371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:23.289371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:23.289371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:23.289371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:23.289371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:23.289371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:23.289371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:23.289371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:23.289371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:23.290228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:23.290228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:23.290228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:23.290228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:23.290228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:43:23.290228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:43:23.290228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:43:23.290228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:43:23.290228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:43:23.290228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:43:23.290228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:43:23.290228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:23.290228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 534/1062] 10.222.0.96 () {56 vars in 1120 bytes} [Thu Jul 28 17:43:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:23.295604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d178c-7c97-4190-b5bd-37903a14bda4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:23.406960 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d178c-7c97-4190-b5bd-37903a14bda4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:23.447675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d61419-94dc-4ffb-b612-83aaabd78737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:23.448425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d61419-94dc-4ffb-b612-83aaabd78737 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:23.449025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d61419-94dc-4ffb-b612-83aaabd78737 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:23.449206 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d61419-94dc-4ffb-b612-83aaabd78737 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:23.450746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d61419-94dc-4ffb-b612-83aaabd78737 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:23.450746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d61419-94dc-4ffb-b612-83aaabd78737 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:23.451911 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d61419-94dc-4ffb-b612-83aaabd78737 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:23.467084 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 529/1063] 10.222.0.96 () {56 vars in 1115 bytes} [Thu Jul 28 17:43:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:23.468215 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82f38c-046e-4eb7-8a0f-a9852a5fcea9 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:23.571580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82f38c-046e-4eb7-8a0f-a9852a5fcea9 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:23.604954 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31208b70-31b2-44ce-9916-91bd3af45f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:23.605641 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31208b70-31b2-44ce-9916-91bd3af45f6a None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:23.605920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31208b70-31b2-44ce-9916-91bd3af45f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:23.606192 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31208b70-31b2-44ce-9916-91bd3af45f6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:23.614488 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:23.617379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31208b70-31b2-44ce-9916-91bd3af45f6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:23.618838 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31208b70-31b2-44ce-9916-91bd3af45f6a None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:23.634669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-31208b70-31b2-44ce-9916-91bd3af45f6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:23.634669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:23.634669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:23.634669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:23.634669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:23.634669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:23.634669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:23.634669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:23.634669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:23.634669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:23.634669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:23.634669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:23.634669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:43:23.634669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:43:23.634669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:43:23.635670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:43:23.635670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:23.635670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:23.635670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:23.635670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:23.635670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:23.635670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:23.635670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:23.635670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:23.635670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:23.635670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:23.635670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:23.635670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:23.635670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:23.635670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:23.635670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:23.635670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:23.636586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:43:23.636586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:43:23.636586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:23.636586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:23.636586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 535/1064] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:43:23.642093 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d61419-94dc-4ffb-b612-83aaabd78737 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:23.673587 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:23.756705 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d61419-94dc-4ffb-b612-83aaabd78737 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:23.781333 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ed742-120d-48cf-b201-0ad08f066fec None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:23.781579 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ed742-120d-48cf-b201-0ad08f066fec None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:23.781971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ed742-120d-48cf-b201-0ad08f066fec None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:23.783372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 536/1065] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:43:23.788440 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faafe6-d5bb-4bbd-becf-41c876d70e15 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:23.788725 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faafe6-d5bb-4bbd-becf-41c876d70e15 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:23.789001 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faafe6-d5bb-4bbd-becf-41c876d70e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:23.797771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0d8a7-f0b5-4c26-a52f-1eef7089b155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:23.798392 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0d8a7-f0b5-4c26-a52f-1eef7089b155 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:23.798676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0d8a7-f0b5-4c26-a52f-1eef7089b155 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:23.798948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0d8a7-f0b5-4c26-a52f-1eef7089b155 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:23.799699 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0d8a7-f0b5-4c26-a52f-1eef7089b155 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:23.800110 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0d8a7-f0b5-4c26-a52f-1eef7089b155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:23.802076 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0d8a7-f0b5-4c26-a52f-1eef7089b155 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:23.809425 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-04faafe6-d5bb-4bbd-becf-41c876d70e15 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:23.810614 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-04faafe6-d5bb-4bbd-becf-41c876d70e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:23.821504 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 530/1066] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:23.823141 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0d8a7-f0b5-4c26-a52f-1eef7089b155 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:23.884843 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 537/1067] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:43:23.908704 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faafe6-d5bb-4bbd-becf-41c876d70e15 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:23.922827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:23.935919 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0d8a7-f0b5-4c26-a52f-1eef7089b155 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:23.973140 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c13853-deb8-4521-9622-56d3e6365877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:23.973810 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c13853-deb8-4521-9622-56d3e6365877 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:23.974071 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c13853-deb8-4521-9622-56d3e6365877 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:23.974347 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c13853-deb8-4521-9622-56d3e6365877 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:23.981932 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c13853-deb8-4521-9622-56d3e6365877 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:23.983401 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c13853-deb8-4521-9622-56d3e6365877 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:23.995719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-93c13853-deb8-4521-9622-56d3e6365877 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:43:23.995719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:23.995719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:23.995719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:23.995719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:23.995719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:23.995719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:23.995719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:23.995719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:23.995719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:23.995719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:23.995719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:23.995719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:43:23.995719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:43:23.995719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:43:23.995719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:43:23.996893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:23.996893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:23.996893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:43:23.996893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:43:23.996893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:43:23.996893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:43:23.996893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:23.996893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:23.996893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:23.996893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:23.996893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:23.996893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:23.996893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:23.996893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:23.996893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:23.996893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:23.996893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:23.996893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:24.002101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:24.002101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:24.002101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:43:24.002101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:43:24.002101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:43:24.002101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:43:24.002101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:43:24.002101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:43:24.002101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:43:24.002101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:24.002101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 531/1068] 10.222.0.96 () {56 vars in 1093 bytes} [Thu Jul 28 17:43:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:24.003496 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c13853-deb8-4521-9622-56d3e6365877 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:24.038961 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faafe6-d5bb-4bbd-becf-41c876d70e15 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:24.064522 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:24.077992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946cabc-5ab7-4b80-a730-d1d4acc8f8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:24.078564 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946cabc-5ab7-4b80-a730-d1d4acc8f8ca None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:24.078842 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946cabc-5ab7-4b80-a730-d1d4acc8f8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:24.079119 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946cabc-5ab7-4b80-a730-d1d4acc8f8ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:24.090006 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946cabc-5ab7-4b80-a730-d1d4acc8f8ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:43:24.094940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-2946cabc-5ab7-4b80-a730-d1d4acc8f8ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:43:24.094940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:24.094940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:24.094940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:24.094940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:24.094940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:24.094940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:24.094940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:24.094940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:24.094940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:24.094940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:24.094940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:24.094940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:43:24.094940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:43:24.094940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:43:24.094940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:43:24.095957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:43:24.095957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:43:24.095957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:43:24.095957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:43:24.095957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:24.095957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:24.095957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:24.095957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:24.095957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:24.095957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:24.095957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:24.095957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:24.095957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:24.095957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:24.095957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:24.095957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:24.096849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:24.096849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:24.096849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:24.096849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:24.096849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:43:24.096849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:43:24.096849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:43:24.096849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:43:24.096849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:43:24.096849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:43:24.096849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:43:24.096849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:24.101572 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 538/1069] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:43:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:43:24.102415 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946cabc-5ab7-4b80-a730-d1d4acc8f8ca None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:24.117591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c13853-deb8-4521-9622-56d3e6365877 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:24.155793 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e8dc1-cd9b-4f56-94c3-cb4e7f171269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:24.156829 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e8dc1-cd9b-4f56-94c3-cb4e7f171269 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:24.157373 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e8dc1-cd9b-4f56-94c3-cb4e7f171269 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:24.157872 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e8dc1-cd9b-4f56-94c3-cb4e7f171269 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:24.159386 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e8dc1-cd9b-4f56-94c3-cb4e7f171269 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:24.159723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e8dc1-cd9b-4f56-94c3-cb4e7f171269 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:24.161521 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e8dc1-cd9b-4f56-94c3-cb4e7f171269 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:24.179669 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 532/1070] 10.222.0.96 () {56 vars in 1133 bytes} [Thu Jul 28 17:43:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:24.182333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53abfa-4aaa-4008-8570-33597377467a None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:24.182952 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53abfa-4aaa-4008-8570-33597377467a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:24.183260 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53abfa-4aaa-4008-8570-33597377467a None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:24.184707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 533/1071] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:24.185829 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53abfa-4aaa-4008-8570-33597377467a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:24.194467 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:24.210232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946cabc-5ab7-4b80-a730-d1d4acc8f8ca None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:24.254987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1951e8-9904-4fb5-825c-2f7185691840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:24.255625 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1951e8-9904-4fb5-825c-2f7185691840 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:24.255977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1951e8-9904-4fb5-825c-2f7185691840 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:24.256144 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1951e8-9904-4fb5-825c-2f7185691840 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:24.256873 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1951e8-9904-4fb5-825c-2f7185691840 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:24.257201 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1951e8-9904-4fb5-825c-2f7185691840 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:24.259211 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1951e8-9904-4fb5-825c-2f7185691840 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:24.267819 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 539/1072] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:43:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:24.268990 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c4913-69a7-41e4-8bf4-8fa73dc2e4d1 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:24.269308 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c4913-69a7-41e4-8bf4-8fa73dc2e4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:24.269786 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c4913-69a7-41e4-8bf4-8fa73dc2e4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:24.287961 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-896c4913-69a7-41e4-8bf4-8fa73dc2e4d1 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:24.289182 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-896c4913-69a7-41e4-8bf4-8fa73dc2e4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:24.297211 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53abfa-4aaa-4008-8570-33597377467a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:24.330228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:24.331158 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698b767-a08b-45da-9920-d88534ed5564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:24.331805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698b767-a08b-45da-9920-d88534ed5564 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:24.332215 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698b767-a08b-45da-9920-d88534ed5564 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:24.332781 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698b767-a08b-45da-9920-d88534ed5564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:24.342853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698b767-a08b-45da-9920-d88534ed5564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:24.344310 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698b767-a08b-45da-9920-d88534ed5564 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:24.357634 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 540/1073] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:24.358456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c4913-69a7-41e4-8bf4-8fa73dc2e4d1 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:24.360014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-2698b767-a08b-45da-9920-d88534ed5564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:24.360014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:24.360014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:24.360014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:24.360014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:24.360014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:24.360014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:24.360014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:24.360014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:24.360014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:24.360014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:24.360014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:24.360014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:43:24.360014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:43:24.360014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:43:24.360858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:43:24.360858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:24.360858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:24.360858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:24.360858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:24.360858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:24.360858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:24.360858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:24.360858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:24.360858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:24.360858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:24.360858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:24.360858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:24.360858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:24.360858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:24.360858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:24.360858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:24.361791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:43:24.361791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:43:24.361791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:24.361791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:24.361791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 534/1074] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:24.366927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698b767-a08b-45da-9920-d88534ed5564 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:24.424466 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:24.462695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c4913-69a7-41e4-8bf4-8fa73dc2e4d1 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:24.467903 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698b767-a08b-45da-9920-d88534ed5564 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:24.501456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1174b43-b1c1-4228-9f3c-65059dfbabc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:24.501696 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce98fc8-104a-47f2-85e1-fe77a1c813c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:24.502100 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1174b43-b1c1-4228-9f3c-65059dfbabc1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:24.502283 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce98fc8-104a-47f2-85e1-fe77a1c813c2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:24.502383 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1174b43-b1c1-4228-9f3c-65059dfbabc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:24.502607 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce98fc8-104a-47f2-85e1-fe77a1c813c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:24.502706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1174b43-b1c1-4228-9f3c-65059dfbabc1 None admin] PATH_INFO: `/v3/users/b82bb3dcb9b8466b96f1afa8d1f70875` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:24.502875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce98fc8-104a-47f2-85e1-fe77a1c813c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:24.503562 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce98fc8-104a-47f2-85e1-fe77a1c813c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:24.503904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1174b43-b1c1-4228-9f3c-65059dfbabc1 None admin] RBAC: Authorizing `identity:get_user(user_id=b82bb3dcb9b8466b96f1afa8d1f70875)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:24.504021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce98fc8-104a-47f2-85e1-fe77a1c813c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:24.505314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce98fc8-104a-47f2-85e1-fe77a1c813c2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:24.505404 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1174b43-b1c1-4228-9f3c-65059dfbabc1 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:24.507147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 541/1075] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:43:24 2022] GET /identity/v3/users/b82bb3dcb9b8466b96f1afa8d1f70875 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:24.507922 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1174b43-b1c1-4228-9f3c-65059dfbabc1 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:24.522605 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 535/1076] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:24.523433 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce98fc8-104a-47f2-85e1-fe77a1c813c2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:24.552372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:24.607613 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1174b43-b1c1-4228-9f3c-65059dfbabc1 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:24.621624 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce98fc8-104a-47f2-85e1-fe77a1c813c2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:24.639512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:24.641681 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abd0c5-68ba-4eb2-947a-dddc3beb0d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:24.642384 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abd0c5-68ba-4eb2-947a-dddc3beb0d5a None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:24.642692 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abd0c5-68ba-4eb2-947a-dddc3beb0d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:24.642972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abd0c5-68ba-4eb2-947a-dddc3beb0d5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:24.657600 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101f69f-7308-43b4-ac6a-c65d6904ec1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:24.658241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101f69f-7308-43b4-ac6a-c65d6904ec1c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:24.658515 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101f69f-7308-43b4-ac6a-c65d6904ec1c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:24.658785 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101f69f-7308-43b4-ac6a-c65d6904ec1c None admin] PATH_INFO: `/v3/projects/0882e47489ee43bd81103e93525ded76` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:24.659943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101f69f-7308-43b4-ac6a-c65d6904ec1c None admin] RBAC: Authorizing `identity:get_project(project_id=0882e47489ee43bd81103e93525ded76)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:24.661585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101f69f-7308-43b4-ac6a-c65d6904ec1c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:24.663302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 536/1077] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:43:24 2022] GET /identity/v3/projects/0882e47489ee43bd81103e93525ded76 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:24.664049 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101f69f-7308-43b4-ac6a-c65d6904ec1c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:24.717833 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abd0c5-68ba-4eb2-947a-dddc3beb0d5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:24.719288 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abd0c5-68ba-4eb2-947a-dddc3beb0d5a None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:24.760695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:24.765167 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101f69f-7308-43b4-ac6a-c65d6904ec1c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:24.801632 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d728f1d-de11-49f4-ba41-00bec0662113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:24.802277 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d728f1d-de11-49f4-ba41-00bec0662113 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:24.802585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d728f1d-de11-49f4-ba41-00bec0662113 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:24.802843 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d728f1d-de11-49f4-ba41-00bec0662113 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:24.809690 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d728f1d-de11-49f4-ba41-00bec0662113 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:24.811178 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d728f1d-de11-49f4-ba41-00bec0662113 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:24.818509 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 542/1078] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:43:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:43:24.819323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abd0c5-68ba-4eb2-947a-dddc3beb0d5a None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:24.822968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-7d728f1d-de11-49f4-ba41-00bec0662113 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:43:24.822968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:24.822968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:24.822968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:24.822968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:24.822968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:24.822968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:24.822968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:24.822968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:24.822968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:24.822968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:24.822968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:24.822968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:43:24.822968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:43:24.822968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:43:24.823990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:43:24.823990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:24.823990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:24.823990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:24.823990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:24.823990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:24.823990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:24.823990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:24.823990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:24.823990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:24.823990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:24.823990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:24.823990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:24.823990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:24.823990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:24.823990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:24.823990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:24.824888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:43:24.824888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:43:24.824888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:43:24.824888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:43:24.824888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:43:24.824888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:43:24.824888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:43:24.824888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:24.824888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 537/1079] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:43:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:24.824888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d728f1d-de11-49f4-ba41-00bec0662113 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:24.873478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:24.919364 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abd0c5-68ba-4eb2-947a-dddc3beb0d5a None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:24.925766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d728f1d-de11-49f4-ba41-00bec0662113 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:24.952587 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99f9ba-242b-4687-8d31-348a7c4bb490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:24.953283 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99f9ba-242b-4687-8d31-348a7c4bb490 None admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:24.953552 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99f9ba-242b-4687-8d31-348a7c4bb490 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:24.953857 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99f9ba-242b-4687-8d31-348a7c4bb490 None admin] PATH_INFO: `/v3/projects/0882e47489ee43bd81103e93525ded76/users/b82bb3dcb9b8466b96f1afa8d1f70875/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:24.955770 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99f9ba-242b-4687-8d31-348a7c4bb490 None admin] RBAC: Authorizing `identity:create_grant(project_id=0882e47489ee43bd81103e93525ded76, user_id=b82bb3dcb9b8466b96f1afa8d1f70875, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:24.957413 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99f9ba-242b-4687-8d31-348a7c4bb490 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:24.962799 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970f4f0-0147-4c35-b10a-31b10a99ae14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:24.963536 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970f4f0-0147-4c35-b10a-31b10a99ae14 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:24.963814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970f4f0-0147-4c35-b10a-31b10a99ae14 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:24.964128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970f4f0-0147-4c35-b10a-31b10a99ae14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:24.973813 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 543/1080] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:43:24 2022] PUT /identity/v3/projects/0882e47489ee43bd81103e93525ded76/users/b82bb3dcb9b8466b96f1afa8d1f70875/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:43:24.974013 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99f9ba-242b-4687-8d31-348a7c4bb490 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:24.976304 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970f4f0-0147-4c35-b10a-31b10a99ae14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:24.976672 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:24.977888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970f4f0-0147-4c35-b10a-31b10a99ae14 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:24.998512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-c970f4f0-0147-4c35-b10a-31b10a99ae14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:24.998512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:24.998512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:24.998512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:24.998512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:24.998512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:24.998512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:24.998512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:24.998512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:24.998512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:24.998512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:24.998512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:24.998512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:43:24.998512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:43:24.998512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:43:24.999508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:43:24.999508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:24.999508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:24.999508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:24.999508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:24.999508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:24.999508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:24.999508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:24.999508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:24.999508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:24.999508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:24.999508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:24.999508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:24.999508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:24.999508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:24.999508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:24.999508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:25.000387 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:43:25.000387 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:43:25.000387 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:25.000387 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:25.000387 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 538/1081] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:25.006353 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970f4f0-0147-4c35-b10a-31b10a99ae14 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:25.098726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99f9ba-242b-4687-8d31-348a7c4bb490 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:25.134275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:25.136583 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970f4f0-0147-4c35-b10a-31b10a99ae14 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:25.141677 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa2498-ee23-408b-9c66-b6ff63d33174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:25.142323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa2498-ee23-408b-9c66-b6ff63d33174 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:25.142607 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa2498-ee23-408b-9c66-b6ff63d33174 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:25.142887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa2498-ee23-408b-9c66-b6ff63d33174 None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:25.143654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa2498-ee23-408b-9c66-b6ff63d33174 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:25.143963 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa2498-ee23-408b-9c66-b6ff63d33174 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:25.146060 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa2498-ee23-408b-9c66-b6ff63d33174 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:25.159993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 544/1082] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:43:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:25.166652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa2498-ee23-408b-9c66-b6ff63d33174 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:25.173682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33dc1a-8363-4e81-ba13-15a9d028507f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:25.174332 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33dc1a-8363-4e81-ba13-15a9d028507f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:25.174612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33dc1a-8363-4e81-ba13-15a9d028507f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:25.174887 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33dc1a-8363-4e81-ba13-15a9d028507f None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:25.175574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33dc1a-8363-4e81-ba13-15a9d028507f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:25.175987 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33dc1a-8363-4e81-ba13-15a9d028507f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:25.177659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33dc1a-8363-4e81-ba13-15a9d028507f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:25.189869 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 539/1083] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:25.242459 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:25.288467 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa2498-ee23-408b-9c66-b6ff63d33174 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:25.325770 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4afe8a-29f5-4e6e-ac2d-9e67f6f5b5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:25.326458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4afe8a-29f5-4e6e-ac2d-9e67f6f5b5b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:25.326731 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4afe8a-29f5-4e6e-ac2d-9e67f6f5b5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:25.327006 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4afe8a-29f5-4e6e-ac2d-9e67f6f5b5b9 None admin] PATH_INFO: `/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/5ac367247aa54671ae5c33d251017470/roles/94a64ce81e2f4aea95f03b65b3903c8f` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:25.329356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4afe8a-29f5-4e6e-ac2d-9e67f6f5b5b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=db5ce5e789e949d09c183dbe04e53f19, user_id=5ac367247aa54671ae5c33d251017470, role_id=94a64ce81e2f4aea95f03b65b3903c8f)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:25.330817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4afe8a-29f5-4e6e-ac2d-9e67f6f5b5b9 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:25.348462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 545/1084] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:43:25 2022] PUT /identity/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/5ac367247aa54671ae5c33d251017470/roles/94a64ce81e2f4aea95f03b65b3903c8f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:43:26.985950 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9d599-850e-4eff-92ab-6e46225a03c8 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:26.986511 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9d599-850e-4eff-92ab-6e46225a03c8 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:26.986511 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9d599-850e-4eff-92ab-6e46225a03c8 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:26.987839 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 540/1085] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:26.993544 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3acb1-6f7c-4dcf-9204-bc260cf8fbaf None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:26.993975 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3acb1-6f7c-4dcf-9204-bc260cf8fbaf None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:26.994183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3acb1-6f7c-4dcf-9204-bc260cf8fbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:27.013498 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-51d3acb1-6f7c-4dcf-9204-bc260cf8fbaf None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:27.014714 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-51d3acb1-6f7c-4dcf-9204-bc260cf8fbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:27.089165 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 546/1086] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:27.112405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9d599-850e-4eff-92ab-6e46225a03c8 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:27.219845 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9d599-850e-4eff-92ab-6e46225a03c8 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:27.255809 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055e8f0-42aa-4206-9ff1-6d5fe59db271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:27.256367 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055e8f0-42aa-4206-9ff1-6d5fe59db271 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:27.256647 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055e8f0-42aa-4206-9ff1-6d5fe59db271 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:27.256913 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055e8f0-42aa-4206-9ff1-6d5fe59db271 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:27.267796 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055e8f0-42aa-4206-9ff1-6d5fe59db271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:43:27.273249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-a055e8f0-42aa-4206-9ff1-6d5fe59db271 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:43:27.273249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:27.273249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:27.273249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:27.273249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:27.273249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:27.273249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:27.273249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:27.273249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:27.273249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:27.273249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:27.273249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:27.273249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:43:27.273249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:43:27.273249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:43:27.273249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:43:27.274254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:43:27.274254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:43:27.274254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:43:27.274254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:43:27.274254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:27.274254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:27.274254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:27.274254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:27.274254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:27.274254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:27.274254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:27.274254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:27.274254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:27.274254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:27.274254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:27.274254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:27.275113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:27.275113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:27.275113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:27.275113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:27.275113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:43:27.275113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:43:27.275113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:43:27.275113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:43:27.275113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:43:27.275113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:43:27.275113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:43:27.275113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:27.275113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 541/1087] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:43:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:27.280609 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3acb1-6f7c-4dcf-9204-bc260cf8fbaf None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:27.333362 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:27.345451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70a20f-4abe-403b-abd9-f189d4fb51b2 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:27.345737 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70a20f-4abe-403b-abd9-f189d4fb51b2 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:27.346020 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70a20f-4abe-403b-abd9-f189d4fb51b2 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:27.347512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 542/1088] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:43:27.352405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa76cf6-4c02-4342-b5b9-bf67032e5abf None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:27.352692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa76cf6-4c02-4342-b5b9-bf67032e5abf None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:27.352968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa76cf6-4c02-4342-b5b9-bf67032e5abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:27.371063 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-ffa76cf6-4c02-4342-b5b9-bf67032e5abf None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:27.372265 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ffa76cf6-4c02-4342-b5b9-bf67032e5abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:27.383283 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3acb1-6f7c-4dcf-9204-bc260cf8fbaf None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:27.386592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:27.417272 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374dc7c-b07c-4fc0-ab0e-e8682130427f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:27.417875 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374dc7c-b07c-4fc0-ab0e-e8682130427f None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:27.418143 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374dc7c-b07c-4fc0-ab0e-e8682130427f None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:27.418407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374dc7c-b07c-4fc0-ab0e-e8682130427f None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:27.419111 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374dc7c-b07c-4fc0-ab0e-e8682130427f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:27.419406 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374dc7c-b07c-4fc0-ab0e-e8682130427f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:27.420794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374dc7c-b07c-4fc0-ab0e-e8682130427f None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:27.428951 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 547/1089] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:43:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:27.434749 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374dc7c-b07c-4fc0-ab0e-e8682130427f None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:27.441776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 543/1090] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:43:27.464521 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa76cf6-4c02-4342-b5b9-bf67032e5abf None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:27.542038 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374dc7c-b07c-4fc0-ab0e-e8682130427f None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:27.555510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:27.568989 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa76cf6-4c02-4342-b5b9-bf67032e5abf None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:27.576019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60dc14b-f51d-4028-a6f3-49e2b58a0ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:27.576664 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dc14b-f51d-4028-a6f3-49e2b58a0ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:27.576937 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dc14b-f51d-4028-a6f3-49e2b58a0ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:27.577239 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dc14b-f51d-4028-a6f3-49e2b58a0ae4 None admin] PATH_INFO: `/v3/users/b82bb3dcb9b8466b96f1afa8d1f70875` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:27.578394 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60dc14b-f51d-4028-a6f3-49e2b58a0ae4 None admin] RBAC: Authorizing `identity:get_user(user_id=b82bb3dcb9b8466b96f1afa8d1f70875)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:27.579860 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60dc14b-f51d-4028-a6f3-49e2b58a0ae4 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:27.581933 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 548/1091] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:43:27 2022] GET /identity/v3/users/b82bb3dcb9b8466b96f1afa8d1f70875 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:27.587489 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60dc14b-f51d-4028-a6f3-49e2b58a0ae4 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:27.602844 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500e03a-dcf8-40e6-8c38-61899b42dc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:27.603664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500e03a-dcf8-40e6-8c38-61899b42dc47 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:27.603945 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500e03a-dcf8-40e6-8c38-61899b42dc47 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:27.604219 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500e03a-dcf8-40e6-8c38-61899b42dc47 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:27.615611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500e03a-dcf8-40e6-8c38-61899b42dc47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:43:27.620668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-7500e03a-dcf8-40e6-8c38-61899b42dc47 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:43:27.620668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:27.620668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:27.620668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:27.620668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:27.620668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:27.620668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:27.620668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:27.620668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:27.620668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:27.620668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:27.620668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:27.620668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:43:27.620668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:43:27.620668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:43:27.620668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:43:27.621791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:43:27.621791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:43:27.621791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:43:27.621791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:43:27.621791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:27.621791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:27.621791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:27.621791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:27.621791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:27.621791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:27.621791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:27.621791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:27.621791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:27.621791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:27.621791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:27.621791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:27.622782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:27.622782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:27.622782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:27.622782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:27.622782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:43:27.622782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:43:27.622782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:43:27.622782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:43:27.622782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:43:27.622782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:43:27.622782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:43:27.622782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:27.622782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 544/1092] 10.222.0.96 () {56 vars in 1120 bytes} [Thu Jul 28 17:43:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:27.628052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500e03a-dcf8-40e6-8c38-61899b42dc47 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:27.640713 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:27.692804 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60dc14b-f51d-4028-a6f3-49e2b58a0ae4 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:27.726198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee24e57-9784-4edc-b809-75e7bd1d133b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:27.726817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee24e57-9784-4edc-b809-75e7bd1d133b None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:27.727093 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee24e57-9784-4edc-b809-75e7bd1d133b None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:27.727370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee24e57-9784-4edc-b809-75e7bd1d133b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:27.732906 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500e03a-dcf8-40e6-8c38-61899b42dc47 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:27.767742 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab4240-13ec-43d4-883d-226cb9b6bf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:27.768354 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab4240-13ec-43d4-883d-226cb9b6bf9a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:27.768631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab4240-13ec-43d4-883d-226cb9b6bf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:27.768878 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab4240-13ec-43d4-883d-226cb9b6bf9a None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:27.769690 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab4240-13ec-43d4-883d-226cb9b6bf9a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:27.769991 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab4240-13ec-43d4-883d-226cb9b6bf9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:27.771358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab4240-13ec-43d4-883d-226cb9b6bf9a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:27.777513 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:27.779666 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 545/1093] 10.222.0.96 () {56 vars in 1115 bytes} [Thu Jul 28 17:43:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:27.785313 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab4240-13ec-43d4-883d-226cb9b6bf9a None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:27.797391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee24e57-9784-4edc-b809-75e7bd1d133b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:27.798778 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee24e57-9784-4edc-b809-75e7bd1d133b None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:27.855943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:27.887570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab4240-13ec-43d4-883d-226cb9b6bf9a None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:27.903378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 549/1094] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:43:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 17:43:27.909331 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee24e57-9784-4edc-b809-75e7bd1d133b None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:27.923582 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30962832-c572-41dd-a5c2-928db44fb4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:27.924251 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30962832-c572-41dd-a5c2-928db44fb4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:27.924526 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30962832-c572-41dd-a5c2-928db44fb4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:27.924800 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30962832-c572-41dd-a5c2-928db44fb4a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:27.935847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30962832-c572-41dd-a5c2-928db44fb4a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:27.937334 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30962832-c572-41dd-a5c2-928db44fb4a0 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:27.952008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-30962832-c572-41dd-a5c2-928db44fb4a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:27.952008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:27.952008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:27.952008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:27.952008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:27.952008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:27.952008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:27.952008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:27.952008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:27.952008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:27.952008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:27.952008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:27.952008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:43:27.952008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:43:27.952008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:43:27.952988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:43:27.952988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:27.952988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:27.952988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:27.952988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:27.952988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:27.952988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:27.952988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:27.952988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:27.952988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:27.952988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:27.952988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:27.952988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:27.952988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:27.952988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:27.952988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:27.952988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:27.953951 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:43:27.953951 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:43:27.953951 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:27.953951 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:27.953951 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 546/1095] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:43:27.960049 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30962832-c572-41dd-a5c2-928db44fb4a0 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:27.992200 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:28.010524 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee24e57-9784-4edc-b809-75e7bd1d133b None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:28.045891 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e63c12-a7f7-4406-8b3b-dfcc760f6781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:28.046613 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e63c12-a7f7-4406-8b3b-dfcc760f6781 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:28.046887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e63c12-a7f7-4406-8b3b-dfcc760f6781 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:28.047155 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e63c12-a7f7-4406-8b3b-dfcc760f6781 None admin] PATH_INFO: `/v3/projects/0882e47489ee43bd81103e93525ded76` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:28.048353 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e63c12-a7f7-4406-8b3b-dfcc760f6781 None admin] RBAC: Authorizing `identity:get_project(project_id=0882e47489ee43bd81103e93525ded76)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:28.049746 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e63c12-a7f7-4406-8b3b-dfcc760f6781 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:28.051609 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 550/1096] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:43:27 2022] GET /identity/v3/projects/0882e47489ee43bd81103e93525ded76 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:28.057716 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e63c12-a7f7-4406-8b3b-dfcc760f6781 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:28.064198 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30962832-c572-41dd-a5c2-928db44fb4a0 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:28.087641 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:28.100777 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67c985-2bcd-4be8-add7-62db6d975111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:28.101230 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67c985-2bcd-4be8-add7-62db6d975111 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:28.101514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67c985-2bcd-4be8-add7-62db6d975111 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:28.101788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67c985-2bcd-4be8-add7-62db6d975111 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:28.102471 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67c985-2bcd-4be8-add7-62db6d975111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:28.102771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67c985-2bcd-4be8-add7-62db6d975111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:28.104147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67c985-2bcd-4be8-add7-62db6d975111 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:28.116686 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 547/1097] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:28.122396 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67c985-2bcd-4be8-add7-62db6d975111 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:28.156305 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e63c12-a7f7-4406-8b3b-dfcc760f6781 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:28.190465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7f743-d73f-445c-bc95-598baa944b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:28.191104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7f743-d73f-445c-bc95-598baa944b02 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:28.191552 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7f743-d73f-445c-bc95-598baa944b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:28.191840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7f743-d73f-445c-bc95-598baa944b02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:28.192610 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7f743-d73f-445c-bc95-598baa944b02 None admin] RBAC: Adding query filter params (role.id=980cae90acae42189f92fd6dd42867a5, scope.project.id=0882e47489ee43bd81103e93525ded76, user.id=b82bb3dcb9b8466b96f1afa8d1f70875) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:28.192915 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7f743-d73f-445c-bc95-598baa944b02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:28.194442 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7f743-d73f-445c-bc95-598baa944b02 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:28.200045 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 551/1098] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:43:28 2022] GET /identity/v3/role_assignments?user.id=b82bb3dcb9b8466b96f1afa8d1f70875&scope.project.id=0882e47489ee43bd81103e93525ded76&role.id=980cae90acae42189f92fd6dd42867a5 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:28.231231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67c985-2bcd-4be8-add7-62db6d975111 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:28.273160 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418050e-3a1c-47bc-832c-a68a4ec11532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:28.273835 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418050e-3a1c-47bc-832c-a68a4ec11532 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:28.274118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418050e-3a1c-47bc-832c-a68a4ec11532 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:28.274387 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418050e-3a1c-47bc-832c-a68a4ec11532 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:28.282635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418050e-3a1c-47bc-832c-a68a4ec11532 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:28.284119 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418050e-3a1c-47bc-832c-a68a4ec11532 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:28.297553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-5418050e-3a1c-47bc-832c-a68a4ec11532 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:43:28.297553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:28.297553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:28.297553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:28.297553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:28.297553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:28.297553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:28.297553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:28.297553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:28.297553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:28.297553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:28.297553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:28.297553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:43:28.297553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:43:28.297553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:43:28.297553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:43:28.298659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:28.298659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:28.298659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:43:28.298659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:43:28.298659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:43:28.298659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:43:28.298659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:28.298659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:28.298659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:28.298659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:28.298659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:28.298659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:28.298659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:28.298659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:28.298659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:28.298659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:28.298659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:28.298659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:28.299593 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:28.299593 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:28.299593 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:43:28.299593 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:43:28.299593 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:43:28.299593 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:43:28.299593 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:43:28.299593 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:43:28.299593 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:43:28.299593 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:28.299593 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 548/1099] 10.222.0.96 () {56 vars in 1093 bytes} [Thu Jul 28 17:43:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:28.305323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7f743-d73f-445c-bc95-598baa944b02 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:28.323551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:28.412132 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7f743-d73f-445c-bc95-598baa944b02 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:28.446116 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec45b4-5e0a-447c-9078-7947c12da1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:28.446748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec45b4-5e0a-447c-9078-7947c12da1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:28.447061 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec45b4-5e0a-447c-9078-7947c12da1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:28.447334 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec45b4-5e0a-447c-9078-7947c12da1e0 None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:28.448134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec45b4-5e0a-447c-9078-7947c12da1e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:28.448440 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec45b4-5e0a-447c-9078-7947c12da1e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:28.449912 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec45b4-5e0a-447c-9078-7947c12da1e0 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:28.468236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 552/1100] 10.222.0.96 () {56 vars in 1133 bytes} [Thu Jul 28 17:43:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:28.474512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418050e-3a1c-47bc-832c-a68a4ec11532 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:28.519757 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:28.579236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418050e-3a1c-47bc-832c-a68a4ec11532 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:28.614760 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb066b7e-3e48-4e3b-ac7c-adc4d182684f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:28.615382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb066b7e-3e48-4e3b-ac7c-adc4d182684f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:28.615659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb066b7e-3e48-4e3b-ac7c-adc4d182684f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:28.615931 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb066b7e-3e48-4e3b-ac7c-adc4d182684f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:28.685755 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb066b7e-3e48-4e3b-ac7c-adc4d182684f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:28.687167 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb066b7e-3e48-4e3b-ac7c-adc4d182684f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:28.729319 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:28.790430 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 549/1101] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:43:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:43:28.796448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec45b4-5e0a-447c-9078-7947c12da1e0 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:28.871093 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:28.902257 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec45b4-5e0a-447c-9078-7947c12da1e0 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:28.940713 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111e8dc-c782-4425-b4a3-f938629133cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:28.943091 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111e8dc-c782-4425-b4a3-f938629133cf None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:28.943450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111e8dc-c782-4425-b4a3-f938629133cf None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:28.943729 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111e8dc-c782-4425-b4a3-f938629133cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:28.954952 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111e8dc-c782-4425-b4a3-f938629133cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:28.956438 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111e8dc-c782-4425-b4a3-f938629133cf None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:28.971695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-2111e8dc-c782-4425-b4a3-f938629133cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:28.971695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:28.971695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:28.971695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:28.971695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:28.971695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:28.971695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:28.971695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:28.971695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:28.971695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:28.971695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:28.971695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:28.971695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:43:28.971695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:43:28.971695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:43:28.972972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:43:28.972972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:28.972972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:28.972972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:28.972972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:28.972972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:28.972972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:28.972972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:28.972972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:28.972972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:28.972972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:28.972972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:28.972972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:28.972972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:28.972972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:28.972972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:28.972972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:28.973908 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:43:28.973908 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:43:28.973908 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:43:28.973908 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:28.973908 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 553/1102] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:28.979200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb066b7e-3e48-4e3b-ac7c-adc4d182684f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:29.084251 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb066b7e-3e48-4e3b-ac7c-adc4d182684f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:29.118947 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37863b3-65e8-46c4-a85c-cdb14fc18054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:29.119557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37863b3-65e8-46c4-a85c-cdb14fc18054 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:29.119864 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37863b3-65e8-46c4-a85c-cdb14fc18054 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:29.120132 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37863b3-65e8-46c4-a85c-cdb14fc18054 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:29.120807 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37863b3-65e8-46c4-a85c-cdb14fc18054 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:29.121180 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37863b3-65e8-46c4-a85c-cdb14fc18054 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:29.122517 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37863b3-65e8-46c4-a85c-cdb14fc18054 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:29.134047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 550/1103] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:29.140037 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111e8dc-c782-4425-b4a3-f938629133cf None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:29.243466 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111e8dc-c782-4425-b4a3-f938629133cf None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:29.267114 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:29.279743 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b114b-7306-4059-aa65-415a1daf5329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:29.280405 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b114b-7306-4059-aa65-415a1daf5329 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:29.280689 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b114b-7306-4059-aa65-415a1daf5329 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:29.280954 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b114b-7306-4059-aa65-415a1daf5329 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:29.287700 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b114b-7306-4059-aa65-415a1daf5329 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:29.289177 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b114b-7306-4059-aa65-415a1daf5329 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:29.300420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-a57b114b-7306-4059-aa65-415a1daf5329 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:43:29.300420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:29.300420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:29.300420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:29.300420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:29.300420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:29.300420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:29.300420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:29.300420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:29.300420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:29.300420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:29.300420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:29.300420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:43:29.300420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:43:29.300420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:43:29.301473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:43:29.301473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:29.301473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:29.301473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:29.301473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:29.301473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:29.301473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:29.301473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:29.301473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:29.301473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:29.301473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:29.301473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:29.301473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:29.301473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:29.301473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:29.301473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:29.301473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:29.302372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:43:29.302372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:43:29.302372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:43:29.302372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:43:29.302372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:43:29.302372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:43:29.302372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:43:29.302372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:29.302372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 554/1104] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:43:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:29.307986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37863b3-65e8-46c4-a85c-cdb14fc18054 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:29.311085 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:29.414404 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37863b3-65e8-46c4-a85c-cdb14fc18054 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:29.448117 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e1842-502d-45bb-b563-0085bc53523f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:29.448727 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e1842-502d-45bb-b563-0085bc53523f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:29.449001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e1842-502d-45bb-b563-0085bc53523f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:29.449308 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e1842-502d-45bb-b563-0085bc53523f None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:29.450039 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e1842-502d-45bb-b563-0085bc53523f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:29.450342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e1842-502d-45bb-b563-0085bc53523f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:29.451771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e1842-502d-45bb-b563-0085bc53523f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:29.463727 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 551/1105] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:43:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:29.470118 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b114b-7306-4059-aa65-415a1daf5329 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:29.578242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b114b-7306-4059-aa65-415a1daf5329 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:29.612955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dda626-0c67-45c5-850f-24a1d9b213e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:29.613601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dda626-0c67-45c5-850f-24a1d9b213e4 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:29.613882 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dda626-0c67-45c5-850f-24a1d9b213e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:29.614154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dda626-0c67-45c5-850f-24a1d9b213e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:29.614946 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dda626-0c67-45c5-850f-24a1d9b213e4 None admin] RBAC: Adding query filter params (role.id=94a64ce81e2f4aea95f03b65b3903c8f, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=5ac367247aa54671ae5c33d251017470) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:29.615255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dda626-0c67-45c5-850f-24a1d9b213e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:29.616703 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dda626-0c67-45c5-850f-24a1d9b213e4 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:29.622633 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 555/1106] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:43:29 2022] GET /identity/v3/role_assignments?user.id=5ac367247aa54671ae5c33d251017470&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=94a64ce81e2f4aea95f03b65b3903c8f => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:30.233561 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c480dcc-f103-4348-a816-0721b43bf13a None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:30.234105 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c480dcc-f103-4348-a816-0721b43bf13a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:30.234105 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c480dcc-f103-4348-a816-0721b43bf13a None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:30.235470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 552/1107] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:30.241676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fe7d0-2ea9-43d7-bd8d-e3f961a9268c None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:30.242144 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fe7d0-2ea9-43d7-bd8d-e3f961a9268c None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:30.242259 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fe7d0-2ea9-43d7-bd8d-e3f961a9268c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:30.262513 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-194fe7d0-2ea9-43d7-bd8d-e3f961a9268c None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:30.263677 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-194fe7d0-2ea9-43d7-bd8d-e3f961a9268c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:30.307688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:30.332616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 556/1108] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:30.359035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c480dcc-f103-4348-a816-0721b43bf13a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:30.426806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:30.468545 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c480dcc-f103-4348-a816-0721b43bf13a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:30.506927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88708f32-0a71-4483-924e-702629c7791c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:30.507576 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88708f32-0a71-4483-924e-702629c7791c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:30.507852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88708f32-0a71-4483-924e-702629c7791c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:30.508153 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88708f32-0a71-4483-924e-702629c7791c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:30.509409 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88708f32-0a71-4483-924e-702629c7791c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:30.510998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88708f32-0a71-4483-924e-702629c7791c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:30.512930 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 553/1109] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:30.519098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fe7d0-2ea9-43d7-bd8d-e3f961a9268c None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:30.620058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fe7d0-2ea9-43d7-bd8d-e3f961a9268c None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:30.659160 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76336683-7752-44b3-8db8-a1a596f5c8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:30.659764 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76336683-7752-44b3-8db8-a1a596f5c8b2 None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:30.660118 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76336683-7752-44b3-8db8-a1a596f5c8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:30.660386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76336683-7752-44b3-8db8-a1a596f5c8b2 None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:30.661104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76336683-7752-44b3-8db8-a1a596f5c8b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:30.662527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76336683-7752-44b3-8db8-a1a596f5c8b2 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:30.686116 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 557/1110] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Jul 28 17:43:30 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:43:32.715440 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6cc7e-dafe-4e52-afc8-b0ac43d47221 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:32.716470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6cc7e-dafe-4e52-afc8-b0ac43d47221 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:32.716470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6cc7e-dafe-4e52-afc8-b0ac43d47221 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:32.719135 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 554/1111] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:32.727089 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7edb14-8d2b-4ee1-aa68-7af12f9e1a9b None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:32.727554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7edb14-8d2b-4ee1-aa68-7af12f9e1a9b None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:32.727654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7edb14-8d2b-4ee1-aa68-7af12f9e1a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:32.745869 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-fc7edb14-8d2b-4ee1-aa68-7af12f9e1a9b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:32.747046 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-fc7edb14-8d2b-4ee1-aa68-7af12f9e1a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:32.774418 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:32.816495 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 558/1112] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:32.847633 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6cc7e-dafe-4e52-afc8-b0ac43d47221 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:32.962612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6cc7e-dafe-4e52-afc8-b0ac43d47221 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:32.992188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:33.000040 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae985cea-360f-4f64-a328-649577349e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:33.000692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae985cea-360f-4f64-a328-649577349e9a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:33.000976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae985cea-360f-4f64-a328-649577349e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:33.001276 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae985cea-360f-4f64-a328-649577349e9a None admin] PATH_INFO: `/v3/roles/5b95c3aebc8041c7885a9234a9e54d7c` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:33.002751 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae985cea-360f-4f64-a328-649577349e9a None admin] RBAC: Authorizing `identity:get_role(role_id=5b95c3aebc8041c7885a9234a9e54d7c)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:33.004752 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae985cea-360f-4f64-a328-649577349e9a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:33.006134 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 555/1113] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:43:32 2022] GET /identity/v3/roles/5b95c3aebc8041c7885a9234a9e54d7c => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:33.015452 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7edb14-8d2b-4ee1-aa68-7af12f9e1a9b None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:33.134656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7edb14-8d2b-4ee1-aa68-7af12f9e1a9b None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:33.170566 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ceb0e-a8f1-40ac-af55-221601e02bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:33.171199 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ceb0e-a8f1-40ac-af55-221601e02bae None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:33.171473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ceb0e-a8f1-40ac-af55-221601e02bae None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:33.171747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ceb0e-a8f1-40ac-af55-221601e02bae None admin] PATH_INFO: `/v3/users/e75bb3f06572426e82cce3dc18038338` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:33.185983 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ceb0e-a8f1-40ac-af55-221601e02bae None admin] RBAC: Authorizing `identity:get_user(user_id=e75bb3f06572426e82cce3dc18038338)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:33.187442 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ceb0e-a8f1-40ac-af55-221601e02bae None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:33.189083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 559/1114] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:43:33 2022] GET /identity/v3/users/e75bb3f06572426e82cce3dc18038338 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:33.195374 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae985cea-360f-4f64-a328-649577349e9a None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:33.299319 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae985cea-360f-4f64-a328-649577349e9a None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:33.335643 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d0f32-0423-43b6-b1e7-2e1b80d044fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:33.336249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d0f32-0423-43b6-b1e7-2e1b80d044fb None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:33.336525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d0f32-0423-43b6-b1e7-2e1b80d044fb None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:33.336792 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d0f32-0423-43b6-b1e7-2e1b80d044fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:33.404485 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:33.410296 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d0f32-0423-43b6-b1e7-2e1b80d044fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:33.411876 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d0f32-0423-43b6-b1e7-2e1b80d044fb None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:33.513537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 556/1115] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:43:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:43:33.522758 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ceb0e-a8f1-40ac-af55-221601e02bae None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:33.550528 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:33.635764 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ceb0e-a8f1-40ac-af55-221601e02bae None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:33.670646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f21c3-a9fb-4259-a5ff-ad2bf9160443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:33.671288 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f21c3-a9fb-4259-a5ff-ad2bf9160443 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:33.671574 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f21c3-a9fb-4259-a5ff-ad2bf9160443 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:33.671842 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f21c3-a9fb-4259-a5ff-ad2bf9160443 None admin] PATH_INFO: `/v3/projects/0882e47489ee43bd81103e93525ded76` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:33.673023 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f21c3-a9fb-4259-a5ff-ad2bf9160443 None admin] RBAC: Authorizing `identity:get_project(project_id=0882e47489ee43bd81103e93525ded76)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:33.674532 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f21c3-a9fb-4259-a5ff-ad2bf9160443 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:33.676271 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 560/1116] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:43:33 2022] GET /identity/v3/projects/0882e47489ee43bd81103e93525ded76 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:33.683476 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d0f32-0423-43b6-b1e7-2e1b80d044fb None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:33.796079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:33.800189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d0f32-0423-43b6-b1e7-2e1b80d044fb None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:33.833410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ee664-ad17-4c28-b39a-eb3a67b970d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:33.833947 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ee664-ad17-4c28-b39a-eb3a67b970d6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:33.834226 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ee664-ad17-4c28-b39a-eb3a67b970d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:33.834496 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ee664-ad17-4c28-b39a-eb3a67b970d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:33.835270 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ee664-ad17-4c28-b39a-eb3a67b970d6 None admin] RBAC: Adding query filter params (role.id=5b95c3aebc8041c7885a9234a9e54d7c, scope.project.id=0882e47489ee43bd81103e93525ded76, user.id=e75bb3f06572426e82cce3dc18038338) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:33.835573 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ee664-ad17-4c28-b39a-eb3a67b970d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:33.837006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ee664-ad17-4c28-b39a-eb3a67b970d6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:33.842601 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 557/1117] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:43:33 2022] GET /identity/v3/role_assignments?user.id=e75bb3f06572426e82cce3dc18038338&scope.project.id=0882e47489ee43bd81103e93525ded76&role.id=5b95c3aebc8041c7885a9234a9e54d7c => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:35.822548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb7c22-6d35-4ef3-a543-b9cca03e2277 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:35.823164 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb7c22-6d35-4ef3-a543-b9cca03e2277 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:35.823164 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb7c22-6d35-4ef3-a543-b9cca03e2277 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:35.824435 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 561/1118] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:35.830823 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37e8bb-0bb1-4c20-a9bd-cfe78d3c2c5e None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:35.831586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37e8bb-0bb1-4c20-a9bd-cfe78d3c2c5e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:35.831722 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37e8bb-0bb1-4c20-a9bd-cfe78d3c2c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:35.858228 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-cb37e8bb-0bb1-4c20-a9bd-cfe78d3c2c5e None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:35.859414 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-cb37e8bb-0bb1-4c20-a9bd-cfe78d3c2c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:35.937441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 558/1119] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:35.960078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb7c22-6d35-4ef3-a543-b9cca03e2277 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:36.072927 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:36.085908 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb7c22-6d35-4ef3-a543-b9cca03e2277 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:36.140999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428e72c-63ed-4f31-a469-afdef4ae71c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:36.141957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428e72c-63ed-4f31-a469-afdef4ae71c0 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:36.142313 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428e72c-63ed-4f31-a469-afdef4ae71c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:36.142705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428e72c-63ed-4f31-a469-afdef4ae71c0 None admin] PATH_INFO: `/v3/roles/5b95c3aebc8041c7885a9234a9e54d7c` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:36.144948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428e72c-63ed-4f31-a469-afdef4ae71c0 None admin] RBAC: Authorizing `identity:get_role(role_id=5b95c3aebc8041c7885a9234a9e54d7c)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:36.146386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428e72c-63ed-4f31-a469-afdef4ae71c0 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:36.147792 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 562/1120] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:43:35 2022] GET /identity/v3/roles/5b95c3aebc8041c7885a9234a9e54d7c => generated 223 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:36.156740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37e8bb-0bb1-4c20-a9bd-cfe78d3c2c5e None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:36.253394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:36.263348 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37e8bb-0bb1-4c20-a9bd-cfe78d3c2c5e None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:36.313533 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc27f00-d68b-4dce-b42b-038a0a79a7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:36.314175 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc27f00-d68b-4dce-b42b-038a0a79a7db None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:36.314450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc27f00-d68b-4dce-b42b-038a0a79a7db None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:36.314718 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc27f00-d68b-4dce-b42b-038a0a79a7db None admin] PATH_INFO: `/v3/users/e75bb3f06572426e82cce3dc18038338` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:36.316079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc27f00-d68b-4dce-b42b-038a0a79a7db None admin] RBAC: Authorizing `identity:get_user(user_id=e75bb3f06572426e82cce3dc18038338)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:36.317782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc27f00-d68b-4dce-b42b-038a0a79a7db None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:36.319430 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 559/1121] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:43:36 2022] GET /identity/v3/users/e75bb3f06572426e82cce3dc18038338 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:36.329141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428e72c-63ed-4f31-a469-afdef4ae71c0 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:36.443289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428e72c-63ed-4f31-a469-afdef4ae71c0 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:36.478162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d888a-3010-442f-839e-0ffb1906b46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:36.478795 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d888a-3010-442f-839e-0ffb1906b46e None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:36.479068 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d888a-3010-442f-839e-0ffb1906b46e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:36.479344 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d888a-3010-442f-839e-0ffb1906b46e None admin] PATH_INFO: `/v3/projects/0882e47489ee43bd81103e93525ded76` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:36.480610 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d888a-3010-442f-839e-0ffb1906b46e None admin] RBAC: Authorizing `identity:get_project(project_id=0882e47489ee43bd81103e93525ded76)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:36.482069 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d888a-3010-442f-839e-0ffb1906b46e None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:36.483751 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 563/1122] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:43:36 2022] GET /identity/v3/projects/0882e47489ee43bd81103e93525ded76 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:36.490701 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc27f00-d68b-4dce-b42b-038a0a79a7db None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:36.600565 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc27f00-d68b-4dce-b42b-038a0a79a7db None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:36.635570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066f84d-fc0f-4d3d-bb51-e864e82bb846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:36.636215 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066f84d-fc0f-4d3d-bb51-e864e82bb846 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:36.636806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066f84d-fc0f-4d3d-bb51-e864e82bb846 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:36.637115 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066f84d-fc0f-4d3d-bb51-e864e82bb846 None admin] PATH_INFO: `/v3/projects/0882e47489ee43bd81103e93525ded76/users/e75bb3f06572426e82cce3dc18038338/roles/5b95c3aebc8041c7885a9234a9e54d7c` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:36.639671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066f84d-fc0f-4d3d-bb51-e864e82bb846 None admin] RBAC: Authorizing `identity:create_grant(project_id=0882e47489ee43bd81103e93525ded76, user_id=e75bb3f06572426e82cce3dc18038338, role_id=5b95c3aebc8041c7885a9234a9e54d7c)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:36.641095 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066f84d-fc0f-4d3d-bb51-e864e82bb846 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:36.660701 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 560/1123] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:43:36 2022] PUT /identity/v3/projects/0882e47489ee43bd81103e93525ded76/users/e75bb3f06572426e82cce3dc18038338/roles/5b95c3aebc8041c7885a9234a9e54d7c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:43:38.667044 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057bdb6-2371-490b-8a5d-456104da18b1 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:38.667953 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057bdb6-2371-490b-8a5d-456104da18b1 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:38.667953 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057bdb6-2371-490b-8a5d-456104da18b1 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:38.670086 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 564/1124] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:38.677033 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866c5cd-72d8-4749-abb6-a57ab31fdee8 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:38.677763 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866c5cd-72d8-4749-abb6-a57ab31fdee8 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:38.677917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866c5cd-72d8-4749-abb6-a57ab31fdee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:38.708896 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-0866c5cd-72d8-4749-abb6-a57ab31fdee8 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:38.710791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0866c5cd-72d8-4749-abb6-a57ab31fdee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:38.729971 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:38.801509 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 561/1125] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:38.825114 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057bdb6-2371-490b-8a5d-456104da18b1 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:38.853854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:38.933604 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057bdb6-2371-490b-8a5d-456104da18b1 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:38.973532 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fdf5e-07ba-4943-8273-b52a45a7b27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:38.974158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fdf5e-07ba-4943-8273-b52a45a7b27d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:38.974437 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fdf5e-07ba-4943-8273-b52a45a7b27d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:38.974707 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fdf5e-07ba-4943-8273-b52a45a7b27d None admin] PATH_INFO: `/v3/roles/5b95c3aebc8041c7885a9234a9e54d7c` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:38.976262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479fdf5e-07ba-4943-8273-b52a45a7b27d None admin] RBAC: Authorizing `identity:get_role(role_id=5b95c3aebc8041c7885a9234a9e54d7c)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:38.977669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479fdf5e-07ba-4943-8273-b52a45a7b27d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:38.979027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 565/1126] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:43:38 2022] GET /identity/v3/roles/5b95c3aebc8041c7885a9234a9e54d7c => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:38.986105 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866c5cd-72d8-4749-abb6-a57ab31fdee8 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:39.092498 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866c5cd-72d8-4749-abb6-a57ab31fdee8 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:39.134936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3d980-cd2a-4ec0-b047-a29e30cd1178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:39.135582 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3d980-cd2a-4ec0-b047-a29e30cd1178 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:39.135863 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3d980-cd2a-4ec0-b047-a29e30cd1178 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:39.136135 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3d980-cd2a-4ec0-b047-a29e30cd1178 None admin] PATH_INFO: `/v3/users/e75bb3f06572426e82cce3dc18038338` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:39.137752 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3d980-cd2a-4ec0-b047-a29e30cd1178 None admin] RBAC: Authorizing `identity:get_user(user_id=e75bb3f06572426e82cce3dc18038338)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:39.139196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3d980-cd2a-4ec0-b047-a29e30cd1178 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:39.140836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 562/1127] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:43:38 2022] GET /identity/v3/users/e75bb3f06572426e82cce3dc18038338 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:39.147077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fdf5e-07ba-4943-8273-b52a45a7b27d None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:39.244766 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:39.252267 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fdf5e-07ba-4943-8273-b52a45a7b27d None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:39.287514 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67a59b-186f-4548-8f7c-44f381a122e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:39.288092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67a59b-186f-4548-8f7c-44f381a122e1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:39.288391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67a59b-186f-4548-8f7c-44f381a122e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:39.288661 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67a59b-186f-4548-8f7c-44f381a122e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:39.359443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67a59b-186f-4548-8f7c-44f381a122e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:39.360885 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67a59b-186f-4548-8f7c-44f381a122e1 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:39.470477 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:39.479574 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 566/1128] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:43:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:43:39.485847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3d980-cd2a-4ec0-b047-a29e30cd1178 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:39.508114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:39.590467 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3d980-cd2a-4ec0-b047-a29e30cd1178 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:39.627095 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef53d0-e414-4c7f-aaf6-eb8078ec4eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:39.627720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef53d0-e414-4c7f-aaf6-eb8078ec4eca None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:39.627996 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef53d0-e414-4c7f-aaf6-eb8078ec4eca None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:39.628266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef53d0-e414-4c7f-aaf6-eb8078ec4eca None admin] PATH_INFO: `/v3/projects/0882e47489ee43bd81103e93525ded76` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:39.629589 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef53d0-e414-4c7f-aaf6-eb8078ec4eca None admin] RBAC: Authorizing `identity:get_project(project_id=0882e47489ee43bd81103e93525ded76)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:39.631022 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef53d0-e414-4c7f-aaf6-eb8078ec4eca None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:39.632676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 563/1129] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:43:39 2022] GET /identity/v3/projects/0882e47489ee43bd81103e93525ded76 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:39.642508 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67a59b-186f-4548-8f7c-44f381a122e1 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:39.752528 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67a59b-186f-4548-8f7c-44f381a122e1 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:39.788995 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1fbe1-9f85-446b-860d-bdf2b675f839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:39.789570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1fbe1-9f85-446b-860d-bdf2b675f839 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:39.789844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1fbe1-9f85-446b-860d-bdf2b675f839 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:39.790120 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1fbe1-9f85-446b-860d-bdf2b675f839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:39.790905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1fbe1-9f85-446b-860d-bdf2b675f839 None admin] RBAC: Adding query filter params (role.id=5b95c3aebc8041c7885a9234a9e54d7c, scope.project.id=0882e47489ee43bd81103e93525ded76, user.id=e75bb3f06572426e82cce3dc18038338) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:39.791184 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1fbe1-9f85-446b-860d-bdf2b675f839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:39.792643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1fbe1-9f85-446b-860d-bdf2b675f839 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:39.798564 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 567/1130] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:43:39 2022] GET /identity/v3/role_assignments?user.id=e75bb3f06572426e82cce3dc18038338&scope.project.id=0882e47489ee43bd81103e93525ded76&role.id=5b95c3aebc8041c7885a9234a9e54d7c => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:41.854998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0804e22-7ff6-4aae-8c2c-d42952f7fda2 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:41.855888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0804e22-7ff6-4aae-8c2c-d42952f7fda2 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:41.855888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0804e22-7ff6-4aae-8c2c-d42952f7fda2 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:41.858106 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 564/1131] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:41.863595 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c768b19-ea21-4c84-b41a-5e39c803eb2e None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:41.864042 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c768b19-ea21-4c84-b41a-5e39c803eb2e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:41.864131 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c768b19-ea21-4c84-b41a-5e39c803eb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:41.884624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-3c768b19-ea21-4c84-b41a-5e39c803eb2e None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:41.885846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-3c768b19-ea21-4c84-b41a-5e39c803eb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:41.941881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:41.958588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 568/1132] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:41.983094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0804e22-7ff6-4aae-8c2c-d42952f7fda2 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:42.087088 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:42.106507 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0804e22-7ff6-4aae-8c2c-d42952f7fda2 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:42.143510 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5d5b6-442c-4ed5-af98-8ea742d784ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:42.144186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5d5b6-442c-4ed5-af98-8ea742d784ab None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:42.144449 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5d5b6-442c-4ed5-af98-8ea742d784ab None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:42.144717 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5d5b6-442c-4ed5-af98-8ea742d784ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:42.145985 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5d5b6-442c-4ed5-af98-8ea742d784ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:42.147418 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5d5b6-442c-4ed5-af98-8ea742d784ab None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:42.148993 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 565/1133] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:42.155987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c768b19-ea21-4c84-b41a-5e39c803eb2e None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:42.278120 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c768b19-ea21-4c84-b41a-5e39c803eb2e None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:42.324491 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0a964-b29d-4419-86d1-697a0d51219c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:42.325125 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0a964-b29d-4419-86d1-697a0d51219c None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:42.325402 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0a964-b29d-4419-86d1-697a0d51219c None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:42.325668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0a964-b29d-4419-86d1-697a0d51219c None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:42.326340 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0a964-b29d-4419-86d1-697a0d51219c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:42.327765 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0a964-b29d-4419-86d1-697a0d51219c None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:42.358221 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 569/1134] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Jul 28 17:43:42 2022] POST /identity/v3/projects => generated 311 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:43:44.384556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1bad8-e668-46e6-9855-74a3d9c09d24 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:44.385466 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1bad8-e668-46e6-9855-74a3d9c09d24 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:44.385466 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1bad8-e668-46e6-9855-74a3d9c09d24 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:44.388050 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 566/1135] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:44.394337 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e934cd8-cefa-4c1d-a242-9bc1cdf946c8 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:44.394789 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e934cd8-cefa-4c1d-a242-9bc1cdf946c8 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:44.394894 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e934cd8-cefa-4c1d-a242-9bc1cdf946c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:44.413772 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-7e934cd8-cefa-4c1d-a242-9bc1cdf946c8 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:44.414969 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-7e934cd8-cefa-4c1d-a242-9bc1cdf946c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:44.451647 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:44.486299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 570/1136] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:44.512438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1bad8-e668-46e6-9855-74a3d9c09d24 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:44.625367 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1bad8-e668-46e6-9855-74a3d9c09d24 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:44.670114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cb913-9ce5-4c96-9f47-e04432e24500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:44.670709 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cb913-9ce5-4c96-9f47-e04432e24500 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:44.670983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cb913-9ce5-4c96-9f47-e04432e24500 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:44.671254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cb913-9ce5-4c96-9f47-e04432e24500 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:44.672519 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122cb913-9ce5-4c96-9f47-e04432e24500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:44.674057 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122cb913-9ce5-4c96-9f47-e04432e24500 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:44.675827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 567/1137] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:43:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:44.682165 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e934cd8-cefa-4c1d-a242-9bc1cdf946c8 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:44.792644 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e934cd8-cefa-4c1d-a242-9bc1cdf946c8 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:44.827622 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479a5bf-4413-44e9-b84f-81153f3862a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:44.828232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479a5bf-4413-44e9-b84f-81153f3862a9 None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:44.828508 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479a5bf-4413-44e9-b84f-81153f3862a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:44.828776 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479a5bf-4413-44e9-b84f-81153f3862a9 None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:44.829480 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479a5bf-4413-44e9-b84f-81153f3862a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:44.830913 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479a5bf-4413-44e9-b84f-81153f3862a9 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:44.854977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 571/1138] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Jul 28 17:43:44 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:43:46.896496 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cec69-1333-4dd6-a2f3-b070287f044c None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:46.897412 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cec69-1333-4dd6-a2f3-b070287f044c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:46.897412 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cec69-1333-4dd6-a2f3-b070287f044c None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:46.899594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 568/1139] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:46.906008 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760544f0-309a-409e-95da-ed85643dd98f None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:46.906726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760544f0-309a-409e-95da-ed85643dd98f None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:46.906905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760544f0-309a-409e-95da-ed85643dd98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:46.927856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-760544f0-309a-409e-95da-ed85643dd98f None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:46.929052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-760544f0-309a-409e-95da-ed85643dd98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:46.950323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:47.001916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 572/1140] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:47.029409 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cec69-1333-4dd6-a2f3-b070287f044c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:47.059544 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:47.154669 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cec69-1333-4dd6-a2f3-b070287f044c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:47.192590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648862e-b77f-49b7-84a4-a63c4373a39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:47.193318 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648862e-b77f-49b7-84a4-a63c4373a39f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:47.193594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648862e-b77f-49b7-84a4-a63c4373a39f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:47.193860 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648862e-b77f-49b7-84a4-a63c4373a39f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:47.205293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648862e-b77f-49b7-84a4-a63c4373a39f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:43:47.210155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-0648862e-b77f-49b7-84a4-a63c4373a39f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:43:47.210155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:47.210155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:47.210155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:47.210155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:47.210155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:47.210155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:47.210155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:47.210155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:47.210155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:47.210155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:47.210155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:47.210155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:43:47.210155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:43:47.210155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:43:47.210155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:43:47.217395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:43:47.217395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:43:47.217395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:43:47.217395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:43:47.217395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:47.217395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:47.217395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:47.217395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:47.217395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:47.217395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:47.217395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:47.217395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:47.217395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:47.217395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:47.217395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:47.217395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:47.218806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:47.218806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:47.218806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:47.218806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:47.218806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:43:47.218806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:43:47.218806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:43:47.218806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:43:47.218806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:43:47.218806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:43:47.218806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:43:47.218806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:47.218806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 569/1141] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:43:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:47.220214 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760544f0-309a-409e-95da-ed85643dd98f None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:47.329330 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760544f0-309a-409e-95da-ed85643dd98f None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:47.364826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5034d-7c4a-42cc-83b0-f6da510b9495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:47.365532 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5034d-7c4a-42cc-83b0-f6da510b9495 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:47.365809 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5034d-7c4a-42cc-83b0-f6da510b9495 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:47.366085 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5034d-7c4a-42cc-83b0-f6da510b9495 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:47.366796 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5034d-7c4a-42cc-83b0-f6da510b9495 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:47.367098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5034d-7c4a-42cc-83b0-f6da510b9495 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:47.368468 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5034d-7c4a-42cc-83b0-f6da510b9495 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:47.376647 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 573/1142] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:43:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:47.384460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648862e-b77f-49b7-84a4-a63c4373a39f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:47.472977 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:47.492285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648862e-b77f-49b7-84a4-a63c4373a39f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:47.529299 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcf68b-1258-4886-8ab1-bf3c678251f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:47.529934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcf68b-1258-4886-8ab1-bf3c678251f9 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:47.530218 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcf68b-1258-4886-8ab1-bf3c678251f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:47.530491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcf68b-1258-4886-8ab1-bf3c678251f9 None admin] PATH_INFO: `/v3/users/0f8632d3b44046ddb98295c7ef770ace` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:47.544490 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dcf68b-1258-4886-8ab1-bf3c678251f9 None admin] RBAC: Authorizing `identity:get_user(user_id=0f8632d3b44046ddb98295c7ef770ace)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:47.545963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dcf68b-1258-4886-8ab1-bf3c678251f9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:47.547625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 570/1143] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:43:47 2022] GET /identity/v3/users/0f8632d3b44046ddb98295c7ef770ace => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:47.554105 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5034d-7c4a-42cc-83b0-f6da510b9495 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:47.576313 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:47.660453 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5034d-7c4a-42cc-83b0-f6da510b9495 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:47.699978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276e823-71c1-468b-bdd8-2eb26710c92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:47.700602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276e823-71c1-468b-bdd8-2eb26710c92c None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:47.700877 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276e823-71c1-468b-bdd8-2eb26710c92c None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:47.701176 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276e823-71c1-468b-bdd8-2eb26710c92c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:47.773659 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276e823-71c1-468b-bdd8-2eb26710c92c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:47.775032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276e823-71c1-468b-bdd8-2eb26710c92c None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:47.792651 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:47.874825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 574/1144] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:43:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 17:43:47.882026 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcf68b-1258-4886-8ab1-bf3c678251f9 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:47.999933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcf68b-1258-4886-8ab1-bf3c678251f9 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:48.037973 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0a60d-c306-4387-bdc9-e187d228256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:48.038548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0a60d-c306-4387-bdc9-e187d228256b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:48.038829 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0a60d-c306-4387-bdc9-e187d228256b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:48.039103 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0a60d-c306-4387-bdc9-e187d228256b None admin] PATH_INFO: `/v3/projects/4d7597caf8774cf581b0e1c35e16d4f1` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:48.040266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0a60d-c306-4387-bdc9-e187d228256b None admin] RBAC: Authorizing `identity:get_project(project_id=4d7597caf8774cf581b0e1c35e16d4f1)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:48.041752 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0a60d-c306-4387-bdc9-e187d228256b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:48.043460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 571/1145] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:43:47 2022] GET /identity/v3/projects/4d7597caf8774cf581b0e1c35e16d4f1 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:48.049831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276e823-71c1-468b-bdd8-2eb26710c92c None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:48.149530 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276e823-71c1-468b-bdd8-2eb26710c92c None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:48.167567 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:48.184345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76844035-1579-445c-8b43-5eb243d4c499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:48.184953 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76844035-1579-445c-8b43-5eb243d4c499 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:48.185268 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76844035-1579-445c-8b43-5eb243d4c499 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:48.185539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76844035-1579-445c-8b43-5eb243d4c499 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:48.186325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76844035-1579-445c-8b43-5eb243d4c499 None admin] RBAC: Adding query filter params (role.id=980cae90acae42189f92fd6dd42867a5, scope.project.id=4d7597caf8774cf581b0e1c35e16d4f1, user.id=0f8632d3b44046ddb98295c7ef770ace) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:48.186630 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76844035-1579-445c-8b43-5eb243d4c499 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:48.188046 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76844035-1579-445c-8b43-5eb243d4c499 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:48.193510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 575/1146] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:43:48 2022] GET /identity/v3/role_assignments?user.id=0f8632d3b44046ddb98295c7ef770ace&scope.project.id=4d7597caf8774cf581b0e1c35e16d4f1&role.id=980cae90acae42189f92fd6dd42867a5 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:50.177957 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f01bcd-48b1-4283-93fe-65cae4ce2519 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:50.178508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f01bcd-48b1-4283-93fe-65cae4ce2519 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:50.178508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f01bcd-48b1-4283-93fe-65cae4ce2519 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:50.179853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 572/1147] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:50.186378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacd0f5-c4ad-400b-aadf-3bd74bb3d533 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:50.187099 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacd0f5-c4ad-400b-aadf-3bd74bb3d533 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:50.187200 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacd0f5-c4ad-400b-aadf-3bd74bb3d533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:50.207612 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-fcacd0f5-c4ad-400b-aadf-3bd74bb3d533 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:50.208855 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-fcacd0f5-c4ad-400b-aadf-3bd74bb3d533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:50.286840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 576/1148] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:50.309778 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f01bcd-48b1-4283-93fe-65cae4ce2519 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:50.322182 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:50.420933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f01bcd-48b1-4283-93fe-65cae4ce2519 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:50.456063 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9902a09-cf9c-4686-8bcb-562176d404ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:50.456685 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9902a09-cf9c-4686-8bcb-562176d404ac None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:50.456960 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9902a09-cf9c-4686-8bcb-562176d404ac None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:50.457265 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9902a09-cf9c-4686-8bcb-562176d404ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:50.467716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9902a09-cf9c-4686-8bcb-562176d404ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:43:50.472537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-b9902a09-cf9c-4686-8bcb-562176d404ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:43:50.472537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:50.472537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:50.472537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:50.472537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:50.472537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:50.472537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:50.472537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:50.472537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:50.472537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:50.472537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:50.472537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:50.472537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:43:50.472537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:43:50.472537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:43:50.472537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:43:50.474001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:43:50.474001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:43:50.474001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:43:50.474001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:43:50.474001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:50.474001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:50.474001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:50.474001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:50.474001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:50.474001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:50.474001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:50.474001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:50.474001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:50.474001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:50.474001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:50.474001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:50.474937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:50.474937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:50.474937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:50.474937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:50.474937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:43:50.474937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:43:50.474937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:43:50.474937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:43:50.474937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:43:50.474937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:43:50.474937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:43:50.474937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:50.474937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 573/1149] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:43:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:50.480258 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacd0f5-c4ad-400b-aadf-3bd74bb3d533 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:50.589592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacd0f5-c4ad-400b-aadf-3bd74bb3d533 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:50.602693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:50.625297 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e5164-5454-45bd-84cc-dd7b43e3b768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:50.625923 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e5164-5454-45bd-84cc-dd7b43e3b768 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:50.626198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e5164-5454-45bd-84cc-dd7b43e3b768 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:50.626467 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e5164-5454-45bd-84cc-dd7b43e3b768 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:50.627189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e5164-5454-45bd-84cc-dd7b43e3b768 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:50.627489 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e5164-5454-45bd-84cc-dd7b43e3b768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:50.628886 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e5164-5454-45bd-84cc-dd7b43e3b768 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:50.637367 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 577/1150] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:43:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:50.643568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9902a09-cf9c-4686-8bcb-562176d404ac None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:50.715984 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:50.755279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9902a09-cf9c-4686-8bcb-562176d404ac None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:50.791336 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6536db8-870f-443b-bcfb-f9509bded273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:50.791961 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6536db8-870f-443b-bcfb-f9509bded273 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:50.792239 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6536db8-870f-443b-bcfb-f9509bded273 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:50.792512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6536db8-870f-443b-bcfb-f9509bded273 None admin] PATH_INFO: `/v3/users/0f8632d3b44046ddb98295c7ef770ace` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:50.793702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6536db8-870f-443b-bcfb-f9509bded273 None admin] RBAC: Authorizing `identity:get_user(user_id=0f8632d3b44046ddb98295c7ef770ace)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:50.795154 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6536db8-870f-443b-bcfb-f9509bded273 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:50.796755 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 574/1151] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:43:50 2022] GET /identity/v3/users/0f8632d3b44046ddb98295c7ef770ace => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:50.805562 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e5164-5454-45bd-84cc-dd7b43e3b768 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:50.928630 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e5164-5454-45bd-84cc-dd7b43e3b768 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:50.964927 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a138875-2653-4014-abfc-124dfd4582c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:50.965592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a138875-2653-4014-abfc-124dfd4582c8 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:50.965894 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a138875-2653-4014-abfc-124dfd4582c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:50.966169 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a138875-2653-4014-abfc-124dfd4582c8 None admin] PATH_INFO: `/v3/projects/4d7597caf8774cf581b0e1c35e16d4f1` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:50.967433 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a138875-2653-4014-abfc-124dfd4582c8 None admin] RBAC: Authorizing `identity:get_project(project_id=4d7597caf8774cf581b0e1c35e16d4f1)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:50.968867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a138875-2653-4014-abfc-124dfd4582c8 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:50.970570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 578/1152] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:43:50 2022] GET /identity/v3/projects/4d7597caf8774cf581b0e1c35e16d4f1 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:50.976956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6536db8-870f-443b-bcfb-f9509bded273 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:51.088972 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6536db8-870f-443b-bcfb-f9509bded273 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:51.129168 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465b236-1d38-489c-8406-89561ca68bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:51.129935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465b236-1d38-489c-8406-89561ca68bf0 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:51.130250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465b236-1d38-489c-8406-89561ca68bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:51.130535 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465b236-1d38-489c-8406-89561ca68bf0 None admin] PATH_INFO: `/v3/projects/4d7597caf8774cf581b0e1c35e16d4f1/users/0f8632d3b44046ddb98295c7ef770ace/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:51.132706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465b236-1d38-489c-8406-89561ca68bf0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d7597caf8774cf581b0e1c35e16d4f1, user_id=0f8632d3b44046ddb98295c7ef770ace, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:51.134223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465b236-1d38-489c-8406-89561ca68bf0 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:51.137711 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:51.157427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 575/1153] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:43:50 2022] PUT /identity/v3/projects/4d7597caf8774cf581b0e1c35e16d4f1/users/0f8632d3b44046ddb98295c7ef770ace/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:43:53.135601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b647a-fcb1-422b-9213-dcd736509c1a None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:53.136552 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b647a-fcb1-422b-9213-dcd736509c1a None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:53.136552 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b647a-fcb1-422b-9213-dcd736509c1a None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:53.137913 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 579/1154] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:53.144332 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cf099-db69-4a67-9761-bd6d6f185f5d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:53.145111 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cf099-db69-4a67-9761-bd6d6f185f5d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:53.145333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cf099-db69-4a67-9761-bd6d6f185f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:53.175910 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-fe7cf099-db69-4a67-9761-bd6d6f185f5d None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:53.177684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fe7cf099-db69-4a67-9761-bd6d6f185f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:53.247713 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 576/1155] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:53.274893 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b647a-fcb1-422b-9213-dcd736509c1a None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:53.325205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:53.394944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b647a-fcb1-422b-9213-dcd736509c1a None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:53.434465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7783d77-7169-4654-8032-3d2652254537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:53.435098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7783d77-7169-4654-8032-3d2652254537 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:53.435489 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7783d77-7169-4654-8032-3d2652254537 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:53.435863 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7783d77-7169-4654-8032-3d2652254537 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:53.449343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7783d77-7169-4654-8032-3d2652254537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:43:53.455183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-a7783d77-7169-4654-8032-3d2652254537 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:43:53.455183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:53.455183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:53.455183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:53.455183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:53.455183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:53.455183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:53.455183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:53.455183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:53.455183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:53.455183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:53.455183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:53.455183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:43:53.455183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:43:53.455183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:43:53.455183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:43:53.456245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:43:53.456245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:43:53.456245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:43:53.456245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:43:53.456245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:53.456245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:53.456245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:53.456245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:53.456245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:53.456245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:53.456245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:53.456245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:53.456245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:53.456245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:53.456245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:53.456245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:53.457675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:53.457675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:53.457675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:53.457675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:53.457675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:43:53.457675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:43:53.457675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:43:53.457675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:43:53.457675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:43:53.457675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:43:53.457675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:43:53.457675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:43:53.457675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 580/1156] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:43:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:43:53.465798 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cf099-db69-4a67-9761-bd6d6f185f5d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:53.574839 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cf099-db69-4a67-9761-bd6d6f185f5d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:53.600032 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:53.615255 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818110c-3013-45c3-9a4f-1637c21a2157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:53.615874 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818110c-3013-45c3-9a4f-1637c21a2157 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:53.616150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818110c-3013-45c3-9a4f-1637c21a2157 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:53.616415 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818110c-3013-45c3-9a4f-1637c21a2157 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:53.617153 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818110c-3013-45c3-9a4f-1637c21a2157 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:53.617455 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818110c-3013-45c3-9a4f-1637c21a2157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:53.618949 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818110c-3013-45c3-9a4f-1637c21a2157 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:53.628354 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 577/1157] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:43:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:53.634850 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7783d77-7169-4654-8032-3d2652254537 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:53.756582 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7783d77-7169-4654-8032-3d2652254537 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:53.758162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:53.813126 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b21c1c-91d1-44a5-95f5-6a44ca5ffbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:53.813799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b21c1c-91d1-44a5-95f5-6a44ca5ffbbd None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:53.814076 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b21c1c-91d1-44a5-95f5-6a44ca5ffbbd None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:53.814351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b21c1c-91d1-44a5-95f5-6a44ca5ffbbd None admin] PATH_INFO: `/v3/users/0f8632d3b44046ddb98295c7ef770ace` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:53.815641 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b21c1c-91d1-44a5-95f5-6a44ca5ffbbd None admin] RBAC: Authorizing `identity:get_user(user_id=0f8632d3b44046ddb98295c7ef770ace)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:53.817107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b21c1c-91d1-44a5-95f5-6a44ca5ffbbd None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:53.818947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 581/1158] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:43:53 2022] GET /identity/v3/users/0f8632d3b44046ddb98295c7ef770ace => generated 286 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:43:53.828251 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818110c-3013-45c3-9a4f-1637c21a2157 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:53.937342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818110c-3013-45c3-9a4f-1637c21a2157 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:53.986169 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccd54b-16d9-4700-9f51-9c8c9d5da977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:53.987080 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccd54b-16d9-4700-9f51-9c8c9d5da977 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:53.987447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccd54b-16d9-4700-9f51-9c8c9d5da977 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:53.987819 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccd54b-16d9-4700-9f51-9c8c9d5da977 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:54.060171 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:54.077006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccd54b-16d9-4700-9f51-9c8c9d5da977 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:54.078713 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccd54b-16d9-4700-9f51-9c8c9d5da977 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:54.187546 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 578/1159] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:43:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:43:54.194060 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b21c1c-91d1-44a5-95f5-6a44ca5ffbbd None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:54.305375 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b21c1c-91d1-44a5-95f5-6a44ca5ffbbd None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:54.341034 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090d896-45bc-4a95-b3fd-cdda49e49ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:54.341642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090d896-45bc-4a95-b3fd-cdda49e49ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:54.341917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090d896-45bc-4a95-b3fd-cdda49e49ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:54.342192 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090d896-45bc-4a95-b3fd-cdda49e49ae1 None admin] PATH_INFO: `/v3/projects/4d7597caf8774cf581b0e1c35e16d4f1` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:54.343471 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090d896-45bc-4a95-b3fd-cdda49e49ae1 None admin] RBAC: Authorizing `identity:get_project(project_id=4d7597caf8774cf581b0e1c35e16d4f1)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:54.344909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090d896-45bc-4a95-b3fd-cdda49e49ae1 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:54.346753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 582/1160] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:43:54 2022] GET /identity/v3/projects/4d7597caf8774cf581b0e1c35e16d4f1 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:54.353733 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccd54b-16d9-4700-9f51-9c8c9d5da977 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:54.444105 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:54.458422 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccd54b-16d9-4700-9f51-9c8c9d5da977 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:54.496332 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eece75a-0f24-4a9f-ade6-5000905e4476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:54.496941 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eece75a-0f24-4a9f-ade6-5000905e4476 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:54.497248 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eece75a-0f24-4a9f-ade6-5000905e4476 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:54.497521 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eece75a-0f24-4a9f-ade6-5000905e4476 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:54.498289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eece75a-0f24-4a9f-ade6-5000905e4476 None admin] RBAC: Adding query filter params (role.id=980cae90acae42189f92fd6dd42867a5, scope.project.id=4d7597caf8774cf581b0e1c35e16d4f1, user.id=0f8632d3b44046ddb98295c7ef770ace) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:54.498599 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eece75a-0f24-4a9f-ade6-5000905e4476 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:54.500035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eece75a-0f24-4a9f-ade6-5000905e4476 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:54.506004 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 579/1161] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:43:54 2022] GET /identity/v3/role_assignments?user.id=0f8632d3b44046ddb98295c7ef770ace&scope.project.id=4d7597caf8774cf581b0e1c35e16d4f1&role.id=980cae90acae42189f92fd6dd42867a5 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:56.513010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd242a-d6df-4f5c-900d-89c5fd9a8b68 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:56.513938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd242a-d6df-4f5c-900d-89c5fd9a8b68 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:56.513938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd242a-d6df-4f5c-900d-89c5fd9a8b68 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:56.516113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 583/1162] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:56.522439 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bdddd-1846-47e3-a0fd-dac9c2b2623b None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:56.522987 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bdddd-1846-47e3-a0fd-dac9c2b2623b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:56.523219 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bdddd-1846-47e3-a0fd-dac9c2b2623b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:56.543241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-bd1bdddd-1846-47e3-a0fd-dac9c2b2623b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:56.544444 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-bd1bdddd-1846-47e3-a0fd-dac9c2b2623b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:56.617712 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 580/1163] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:56.640435 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd242a-d6df-4f5c-900d-89c5fd9a8b68 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:56.691963 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:56.754271 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd242a-d6df-4f5c-900d-89c5fd9a8b68 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:56.795898 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc24c0a-b4e6-4abb-ba30-4b234610ba19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:56.796438 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc24c0a-b4e6-4abb-ba30-4b234610ba19 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:56.796714 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc24c0a-b4e6-4abb-ba30-4b234610ba19 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:56.796981 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc24c0a-b4e6-4abb-ba30-4b234610ba19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:56.866956 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc24c0a-b4e6-4abb-ba30-4b234610ba19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:56.868423 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc24c0a-b4e6-4abb-ba30-4b234610ba19 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:56.907266 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:56.978214 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 584/1164] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:43:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 17:43:56.984557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bdddd-1846-47e3-a0fd-dac9c2b2623b None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:57.071225 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:57.088994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bdddd-1846-47e3-a0fd-dac9c2b2623b None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:57.124432 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb44fa0-8b2d-42d3-a29b-9f7b2718685a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:57.125086 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb44fa0-8b2d-42d3-a29b-9f7b2718685a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:57.125371 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb44fa0-8b2d-42d3-a29b-9f7b2718685a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:57.125643 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb44fa0-8b2d-42d3-a29b-9f7b2718685a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:57.132659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb44fa0-8b2d-42d3-a29b-9f7b2718685a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:57.134148 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb44fa0-8b2d-42d3-a29b-9f7b2718685a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:57.146458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-5fb44fa0-8b2d-42d3-a29b-9f7b2718685a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 17:43:57.146458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:57.146458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 28 17:43:57.146458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 28 17:43:57.146458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:43:57.146458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:43:57.146458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:43:57.146458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:43:57.146458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 28 17:43:57.146458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:57.146458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:43:57.146458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:57.146458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:43:57.146458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:43:57.146458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:43:57.146458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:43:57.146458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:43:57.147612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:43:57.147612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:43:57.147612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:43:57.147612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:43:57.147612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:43:57.147612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:43:57.147612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:43:57.147612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:43:57.147612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:43:57.147612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:43:57.147612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:43:57.147612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:43:57.147612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:43:57.147612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:43:57.147612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:43:57.147612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:43:57.149053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:43:57.149053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:43:57.149053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:43:57.149053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:43:57.149053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:43:57.149053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:43:57.149053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:43:57.149053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:43:57.149053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:43:57.149053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:43:57.149053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 28 17:43:57.149053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:43:57.149053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 17:43:57.149053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:43:57.149053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 581/1165] 10.222.0.96 () {56 vars in 1117 bytes} [Thu Jul 28 17:43:56 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:43:57.157208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc24c0a-b4e6-4abb-ba30-4b234610ba19 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:57.263157 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc24c0a-b4e6-4abb-ba30-4b234610ba19 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:57.300527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bf58d-2e9f-476a-b423-0a36261dfe5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:57.301160 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bf58d-2e9f-476a-b423-0a36261dfe5c None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:57.301437 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bf58d-2e9f-476a-b423-0a36261dfe5c None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:57.301708 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bf58d-2e9f-476a-b423-0a36261dfe5c None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:57.302651 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0bf58d-2e9f-476a-b423-0a36261dfe5c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:43:57.303009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0bf58d-2e9f-476a-b423-0a36261dfe5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:57.304711 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0bf58d-2e9f-476a-b423-0a36261dfe5c None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:57.313343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 585/1166] 10.222.0.96 () {56 vars in 1115 bytes} [Thu Jul 28 17:43:57 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:43:59.341209 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcd119-0bac-41fe-be0a-f766c3f52aa5 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:59.341732 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcd119-0bac-41fe-be0a-f766c3f52aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:59.341732 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcd119-0bac-41fe-be0a-f766c3f52aa5 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:59.343671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 582/1167] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:43:59.352441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711ed57-b7ca-4d3c-9032-23c745e9a852 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:59.353136 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711ed57-b7ca-4d3c-9032-23c745e9a852 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:59.353367 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711ed57-b7ca-4d3c-9032-23c745e9a852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:59.364073 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:43:59.382992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-8711ed57-b7ca-4d3c-9032-23c745e9a852 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:43:59.384173 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-8711ed57-b7ca-4d3c-9032-23c745e9a852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:43:59.465683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 586/1168] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:43:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:43:59.491680 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcd119-0bac-41fe-be0a-f766c3f52aa5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:43:59.599373 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcd119-0bac-41fe-be0a-f766c3f52aa5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:43:59.636549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17217bd5-9b0f-44b0-9661-daee27a0c8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:43:59.637186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17217bd5-9b0f-44b0-9661-daee27a0c8c2 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:43:59.637463 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17217bd5-9b0f-44b0-9661-daee27a0c8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:43:59.637738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17217bd5-9b0f-44b0-9661-daee27a0c8c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:43:59.638434 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17217bd5-9b0f-44b0-9661-daee27a0c8c2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:43:59.639798 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17217bd5-9b0f-44b0-9661-daee27a0c8c2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:43:59.663578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 583/1169] 10.222.0.96 () {60 vars in 1138 bytes} [Thu Jul 28 17:43:59 2022] POST /identity/v3/domains => generated 267 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:44:01.678678 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3d9e1-c3e4-4d4a-b819-ca6ba63858c8 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:01.679235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3d9e1-c3e4-4d4a-b819-ca6ba63858c8 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:01.679235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3d9e1-c3e4-4d4a-b819-ca6ba63858c8 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:01.680585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 587/1170] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:01.686973 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc6095-577b-4499-b8da-59bc5d1d1ada None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:01.687756 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc6095-577b-4499-b8da-59bc5d1d1ada None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:01.687988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc6095-577b-4499-b8da-59bc5d1d1ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:01.696585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:01.711671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-85dc6095-577b-4499-b8da-59bc5d1d1ada None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:01.712886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-85dc6095-577b-4499-b8da-59bc5d1d1ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:01.782622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 584/1171] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:44:01.806679 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3d9e1-c3e4-4d4a-b819-ca6ba63858c8 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:01.925762 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3d9e1-c3e4-4d4a-b819-ca6ba63858c8 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:01.955755 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:01.961934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c070d8-7006-4c75-a333-b71fd1a7ea8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:01.962594 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c070d8-7006-4c75-a333-b71fd1a7ea8e None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:01.962875 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c070d8-7006-4c75-a333-b71fd1a7ea8e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:01.963152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c070d8-7006-4c75-a333-b71fd1a7ea8e None admin] PATH_INFO: `/v3/domains/3e68d86c5d524a25877998510f59e5e2` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:01.974076 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c070d8-7006-4c75-a333-b71fd1a7ea8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=3e68d86c5d524a25877998510f59e5e2)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:01.975665 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c070d8-7006-4c75-a333-b71fd1a7ea8e None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:01.977330 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 588/1172] 10.222.0.96 () {56 vars in 1183 bytes} [Thu Jul 28 17:44:01 2022] GET /identity/v3/domains/3e68d86c5d524a25877998510f59e5e2 => generated 267 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:01.984862 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc6095-577b-4499-b8da-59bc5d1d1ada None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:02.090700 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc6095-577b-4499-b8da-59bc5d1d1ada None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:02.122533 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:02.128569 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59de5c8-d1a6-4e0b-8923-3fe84f378aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:02.129237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59de5c8-d1a6-4e0b-8923-3fe84f378aa9 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:02.129516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59de5c8-d1a6-4e0b-8923-3fe84f378aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:02.129790 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59de5c8-d1a6-4e0b-8923-3fe84f378aa9 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:02.130854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59de5c8-d1a6-4e0b-8923-3fe84f378aa9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:02.132467 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59de5c8-d1a6-4e0b-8923-3fe84f378aa9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:02.164997 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 585/1173] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Jul 28 17:44:01 2022] POST /identity/v3/projects => generated 361 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:44:04.208597 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008ed58-a7ab-41d4-bdb7-9135faa22ee1 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:04.209569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008ed58-a7ab-41d4-bdb7-9135faa22ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:04.209569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008ed58-a7ab-41d4-bdb7-9135faa22ee1 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:04.211597 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 589/1174] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:44:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:04.219552 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87a384-6a6d-417e-8a72-fb4b481f0d69 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:04.220010 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87a384-6a6d-417e-8a72-fb4b481f0d69 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:04.220107 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87a384-6a6d-417e-8a72-fb4b481f0d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:04.240246 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-de87a384-6a6d-417e-8a72-fb4b481f0d69 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:04.241484 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-de87a384-6a6d-417e-8a72-fb4b481f0d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:04.326433 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 586/1175] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:44:04.351004 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008ed58-a7ab-41d4-bdb7-9135faa22ee1 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:04.474896 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008ed58-a7ab-41d4-bdb7-9135faa22ee1 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:04.511650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b09daa-a4bf-4a46-80f1-81d50b483403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:04.512273 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b09daa-a4bf-4a46-80f1-81d50b483403 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:04.512545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b09daa-a4bf-4a46-80f1-81d50b483403 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:04.512811 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b09daa-a4bf-4a46-80f1-81d50b483403 None admin] PATH_INFO: `/v3/domains/3e68d86c5d524a25877998510f59e5e2` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:04.514088 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b09daa-a4bf-4a46-80f1-81d50b483403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3e68d86c5d524a25877998510f59e5e2)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:04.515519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b09daa-a4bf-4a46-80f1-81d50b483403 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:04.517113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 590/1176] 10.222.0.96 () {56 vars in 1183 bytes} [Thu Jul 28 17:44:04 2022] GET /identity/v3/domains/3e68d86c5d524a25877998510f59e5e2 => generated 267 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:04.523435 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87a384-6a6d-417e-8a72-fb4b481f0d69 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:04.640352 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87a384-6a6d-417e-8a72-fb4b481f0d69 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:04.656051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:04.679431 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074993a-b28c-46c3-b25c-07ac71600768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:04.680077 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074993a-b28c-46c3-b25c-07ac71600768 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:04.680350 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074993a-b28c-46c3-b25c-07ac71600768 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:04.680627 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074993a-b28c-46c3-b25c-07ac71600768 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:04.681361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074993a-b28c-46c3-b25c-07ac71600768 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:04.682802 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074993a-b28c-46c3-b25c-07ac71600768 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:04.705018 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 587/1177] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Jul 28 17:44:04 2022] POST /identity/v3/users => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:44:06.958291 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4a401-9f08-4659-a503-ade586f2e3fd None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:06.959173 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4a401-9f08-4659-a503-ade586f2e3fd None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:06.959331 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4a401-9f08-4659-a503-ade586f2e3fd None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:06.961580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 591/1178] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:44:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:06.967845 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f4066-43e9-424d-80b5-da910325085d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:06.968289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f4066-43e9-424d-80b5-da910325085d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:06.968381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f4066-43e9-424d-80b5-da910325085d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:06.993285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d55f4066-43e9-424d-80b5-da910325085d None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:06.994502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d55f4066-43e9-424d-80b5-da910325085d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:07.079717 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 588/1179] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:44:07.103927 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4a401-9f08-4659-a503-ade586f2e3fd None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:07.176288 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:07.227266 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4a401-9f08-4659-a503-ade586f2e3fd None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:07.267988 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66009938-613f-4e31-98c9-c0bc01acb058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:07.268620 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66009938-613f-4e31-98c9-c0bc01acb058 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:07.268891 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66009938-613f-4e31-98c9-c0bc01acb058 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:07.269186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66009938-613f-4e31-98c9-c0bc01acb058 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:07.287647 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66009938-613f-4e31-98c9-c0bc01acb058 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:07.292710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-66009938-613f-4e31-98c9-c0bc01acb058 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:07.292710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:07.292710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:07.292710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:07.292710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:07.292710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:07.292710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:07.292710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:07.292710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:07.292710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:07.292710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:07.292710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:07.292710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:07.292710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:07.292710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:07.292710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:07.293947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:07.293947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:07.293947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:07.293947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:07.293947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:07.293947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:07.293947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:07.293947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:07.293947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:07.293947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:07.293947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:07.293947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:07.293947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:07.293947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:07.293947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:07.293947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:07.294942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:07.294942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:07.294942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:07.294942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:07.294942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:07.294942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:07.294942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:07.294942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:07.294942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:07.294942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:07.294942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:07.294942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:44:07.294942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 592/1180] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:44:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:07.300888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f4066-43e9-424d-80b5-da910325085d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:07.427679 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:07.431017 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f4066-43e9-424d-80b5-da910325085d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:07.467665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c2f94-c623-4992-ba6f-d65f64b1dcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:07.468285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c2f94-c623-4992-ba6f-d65f64b1dcc9 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:07.468563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c2f94-c623-4992-ba6f-d65f64b1dcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:07.468842 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c2f94-c623-4992-ba6f-d65f64b1dcc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:07.469599 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c2f94-c623-4992-ba6f-d65f64b1dcc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:07.469906 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c2f94-c623-4992-ba6f-d65f64b1dcc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:07.471303 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c2f94-c623-4992-ba6f-d65f64b1dcc9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:07.480308 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 589/1181] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:07.489521 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66009938-613f-4e31-98c9-c0bc01acb058 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:07.595300 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66009938-613f-4e31-98c9-c0bc01acb058 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:07.618919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:07.635152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f32de9-8e0a-4b5c-8bca-072169cb94eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:07.636109 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f32de9-8e0a-4b5c-8bca-072169cb94eb None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:07.636387 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f32de9-8e0a-4b5c-8bca-072169cb94eb None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:07.636664 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f32de9-8e0a-4b5c-8bca-072169cb94eb None admin] PATH_INFO: `/v3/users/946bbdc2350c4972a5d6235847f73812` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:07.650512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f32de9-8e0a-4b5c-8bca-072169cb94eb None admin] RBAC: Authorizing `identity:get_user(user_id=946bbdc2350c4972a5d6235847f73812)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:07.651950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f32de9-8e0a-4b5c-8bca-072169cb94eb None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:07.653595 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 593/1182] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:07 2022] GET /identity/v3/users/946bbdc2350c4972a5d6235847f73812 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:07.659921 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c2f94-c623-4992-ba6f-d65f64b1dcc9 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:07.768295 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c2f94-c623-4992-ba6f-d65f64b1dcc9 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:07.803752 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e886e9-a859-4661-9d8f-dd8da155c5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:07.804364 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e886e9-a859-4661-9d8f-dd8da155c5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:07.804648 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e886e9-a859-4661-9d8f-dd8da155c5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:07.804925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e886e9-a859-4661-9d8f-dd8da155c5d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:07.837814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:07.887511 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e886e9-a859-4661-9d8f-dd8da155c5d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:07.888961 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e886e9-a859-4661-9d8f-dd8da155c5d7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:08.013475 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 590/1183] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:44:08.019993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f32de9-8e0a-4b5c-8bca-072169cb94eb None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:08.139292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f32de9-8e0a-4b5c-8bca-072169cb94eb None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:08.174350 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e4aa9-6941-44b8-b689-99c38d133417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:08.174981 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e4aa9-6941-44b8-b689-99c38d133417 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:08.175265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e4aa9-6941-44b8-b689-99c38d133417 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:08.175539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e4aa9-6941-44b8-b689-99c38d133417 None admin] PATH_INFO: `/v3/projects/7410018a9ee14f60a134ad330ff50d44` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:08.176711 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e4aa9-6941-44b8-b689-99c38d133417 None admin] RBAC: Authorizing `identity:get_project(project_id=7410018a9ee14f60a134ad330ff50d44)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:08.178536 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e4aa9-6941-44b8-b689-99c38d133417 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:08.180204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 594/1184] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:08 2022] GET /identity/v3/projects/7410018a9ee14f60a134ad330ff50d44 => generated 361 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:08.189979 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e886e9-a859-4661-9d8f-dd8da155c5d7 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:08.258662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:08.300158 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e886e9-a859-4661-9d8f-dd8da155c5d7 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:08.338544 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ddbd3-47b6-4eb5-8a53-469090640e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:08.339155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ddbd3-47b6-4eb5-8a53-469090640e32 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:08.339431 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ddbd3-47b6-4eb5-8a53-469090640e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:08.339702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ddbd3-47b6-4eb5-8a53-469090640e32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:08.340478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ddbd3-47b6-4eb5-8a53-469090640e32 None admin] RBAC: Adding query filter params (role.id=980cae90acae42189f92fd6dd42867a5, scope.project.id=7410018a9ee14f60a134ad330ff50d44, user.id=946bbdc2350c4972a5d6235847f73812) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:08.340795 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ddbd3-47b6-4eb5-8a53-469090640e32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:08.342261 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ddbd3-47b6-4eb5-8a53-469090640e32 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:08.347692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 591/1185] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:44:08 2022] GET /identity/v3/role_assignments?user.id=946bbdc2350c4972a5d6235847f73812&scope.project.id=7410018a9ee14f60a134ad330ff50d44&role.id=980cae90acae42189f92fd6dd42867a5 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:10.377215 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba9914-c573-477f-9b7a-cedad4deede6 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:10.378052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba9914-c573-477f-9b7a-cedad4deede6 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:10.378052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba9914-c573-477f-9b7a-cedad4deede6 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:10.380427 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 595/1186] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:44:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:10.387312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd860ac0-29d6-4f03-906d-e7ad5242d9e5 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:10.388086 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd860ac0-29d6-4f03-906d-e7ad5242d9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:10.388184 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd860ac0-29d6-4f03-906d-e7ad5242d9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:10.416234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-bd860ac0-29d6-4f03-906d-e7ad5242d9e5 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:10.417460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-bd860ac0-29d6-4f03-906d-e7ad5242d9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:10.486331 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 592/1187] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:44:10.508867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba9914-c573-477f-9b7a-cedad4deede6 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:10.568208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:10.624261 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba9914-c573-477f-9b7a-cedad4deede6 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:10.659127 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a7bff-0b41-45a5-a92a-989c4b6623fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:10.659698 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a7bff-0b41-45a5-a92a-989c4b6623fc None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:10.659972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a7bff-0b41-45a5-a92a-989c4b6623fc None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:10.660248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a7bff-0b41-45a5-a92a-989c4b6623fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:10.670460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a7bff-0b41-45a5-a92a-989c4b6623fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:10.675407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-f53a7bff-0b41-45a5-a92a-989c4b6623fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:10.675407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:10.675407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:10.675407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:10.675407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:10.675407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:10.675407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:10.675407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:10.675407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:10.675407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:10.675407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:10.675407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:10.675407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:10.675407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:10.675407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:10.675407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:10.676493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:10.676493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:10.676493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:10.676493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:10.676493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:10.676493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:10.676493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:10.676493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:10.676493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:10.676493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:10.676493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:10.676493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:10.676493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:10.676493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:10.676493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:10.676493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:10.678611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:10.678611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:10.678611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:10.678611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:10.678611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:10.678611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:10.678611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:10.678611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:10.678611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:10.678611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:10.678611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:10.678611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:44:10.678611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 596/1188] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:44:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:10.683270 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd860ac0-29d6-4f03-906d-e7ad5242d9e5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:10.747002 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:10.794152 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd860ac0-29d6-4f03-906d-e7ad5242d9e5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:10.829323 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496558e-5f61-423b-8c81-3c605cca29c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:10.829937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496558e-5f61-423b-8c81-3c605cca29c7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:10.830195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496558e-5f61-423b-8c81-3c605cca29c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:10.830495 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496558e-5f61-423b-8c81-3c605cca29c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:10.831192 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496558e-5f61-423b-8c81-3c605cca29c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:10.831494 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496558e-5f61-423b-8c81-3c605cca29c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:10.832888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496558e-5f61-423b-8c81-3c605cca29c7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:10.841426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 593/1189] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:10.848053 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a7bff-0b41-45a5-a92a-989c4b6623fc None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:10.960583 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a7bff-0b41-45a5-a92a-989c4b6623fc None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:10.967927 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:11.000834 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08d9d6-a5c1-4495-bf77-7e18b4ee6471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:11.001511 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08d9d6-a5c1-4495-bf77-7e18b4ee6471 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:11.001785 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08d9d6-a5c1-4495-bf77-7e18b4ee6471 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:11.002054 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08d9d6-a5c1-4495-bf77-7e18b4ee6471 None admin] PATH_INFO: `/v3/users/946bbdc2350c4972a5d6235847f73812` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:11.003429 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08d9d6-a5c1-4495-bf77-7e18b4ee6471 None admin] RBAC: Authorizing `identity:get_user(user_id=946bbdc2350c4972a5d6235847f73812)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:11.004920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08d9d6-a5c1-4495-bf77-7e18b4ee6471 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:11.006884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 597/1190] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:10 2022] GET /identity/v3/users/946bbdc2350c4972a5d6235847f73812 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:11.016549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496558e-5f61-423b-8c81-3c605cca29c7 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:11.128806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496558e-5f61-423b-8c81-3c605cca29c7 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:11.149615 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:11.169571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e2798-37ee-468c-bd54-cfb875b72983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:11.170255 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e2798-37ee-468c-bd54-cfb875b72983 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:11.170536 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e2798-37ee-468c-bd54-cfb875b72983 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:11.170812 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e2798-37ee-468c-bd54-cfb875b72983 None admin] PATH_INFO: `/v3/projects/7410018a9ee14f60a134ad330ff50d44` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:11.171989 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e2798-37ee-468c-bd54-cfb875b72983 None admin] RBAC: Authorizing `identity:get_project(project_id=7410018a9ee14f60a134ad330ff50d44)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:11.173490 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e2798-37ee-468c-bd54-cfb875b72983 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:11.175183 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 594/1191] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:11 2022] GET /identity/v3/projects/7410018a9ee14f60a134ad330ff50d44 => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:11.182187 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08d9d6-a5c1-4495-bf77-7e18b4ee6471 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:11.303644 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08d9d6-a5c1-4495-bf77-7e18b4ee6471 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:11.339592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2465d-15d3-4544-9051-ccafc97010f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:11.340264 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2465d-15d3-4544-9051-ccafc97010f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:11.340541 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2465d-15d3-4544-9051-ccafc97010f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:11.340816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2465d-15d3-4544-9051-ccafc97010f2 None admin] PATH_INFO: `/v3/projects/7410018a9ee14f60a134ad330ff50d44/users/946bbdc2350c4972a5d6235847f73812/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:11.343053 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2465d-15d3-4544-9051-ccafc97010f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7410018a9ee14f60a134ad330ff50d44, user_id=946bbdc2350c4972a5d6235847f73812, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:11.344499 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2465d-15d3-4544-9051-ccafc97010f2 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:11.362879 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 598/1192] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:44:11 2022] PUT /identity/v3/projects/7410018a9ee14f60a134ad330ff50d44/users/946bbdc2350c4972a5d6235847f73812/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:44:13.306125 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81902b2d-8155-468f-aa14-743fa4ee4033 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:13.306948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81902b2d-8155-468f-aa14-743fa4ee4033 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:13.306948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81902b2d-8155-468f-aa14-743fa4ee4033 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:13.309176 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 595/1193] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:44:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:44:13.317880 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f3b4f-d71b-4b24-a060-24aec9c26782 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:13.318344 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f3b4f-d71b-4b24-a060-24aec9c26782 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:13.318433 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f3b4f-d71b-4b24-a060-24aec9c26782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:13.337866 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-da2f3b4f-d71b-4b24-a060-24aec9c26782 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:44:13.339054 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-da2f3b4f-d71b-4b24-a060-24aec9c26782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:44:13.366553 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:13.409564 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 599/1194] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:44:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:44:13.433701 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81902b2d-8155-468f-aa14-743fa4ee4033 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:13.561425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81902b2d-8155-468f-aa14-743fa4ee4033 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:13.606597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c3000-09f6-48e2-8b40-6d74beb78068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:13.607219 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c3000-09f6-48e2-8b40-6d74beb78068 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:13.607498 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c3000-09f6-48e2-8b40-6d74beb78068 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:13.607774 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c3000-09f6-48e2-8b40-6d74beb78068 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:13.619433 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c3000-09f6-48e2-8b40-6d74beb78068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:44:13.624245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-191c3000-09f6-48e2-8b40-6d74beb78068 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:13.624245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:44:13.624245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:44:13.624245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:44:13.624245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:44:13.624245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:44:13.624245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:44:13.624245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:44:13.624245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:44:13.624245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:44:13.624245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:44:13.624245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:44:13.624245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:44:13.624245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:44:13.624245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:44:13.624245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:44:13.625314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:44:13.625314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:44:13.625314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:44:13.625314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:44:13.625314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:44:13.625314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:44:13.625314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:44:13.625314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:44:13.625314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:44:13.625314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:44:13.625314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:44:13.625314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:44:13.625314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:44:13.625314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:44:13.625314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:44:13.625314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:44:13.626654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:44:13.626654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:44:13.626654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:44:13.626654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:44:13.626654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:44:13.626654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:44:13.626654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:44:13.626654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:44:13.626654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:44:13.626654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:44:13.626654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:44:13.626654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:44:13.626654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 596/1195] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:44:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:44:13.636406 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f3b4f-d71b-4b24-a060-24aec9c26782 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:13.750474 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f3b4f-d71b-4b24-a060-24aec9c26782 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:13.789088 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d9d6a-56ca-452d-9b51-e02955dc52c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:13.789694 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d9d6a-56ca-452d-9b51-e02955dc52c1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:13.789983 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d9d6a-56ca-452d-9b51-e02955dc52c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:13.790250 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d9d6a-56ca-452d-9b51-e02955dc52c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:13.790966 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d9d6a-56ca-452d-9b51-e02955dc52c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:13.791272 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d9d6a-56ca-452d-9b51-e02955dc52c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:13.792642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d9d6a-56ca-452d-9b51-e02955dc52c1 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:13.801465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 600/1196] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:44:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:13.807801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c3000-09f6-48e2-8b40-6d74beb78068 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:13.858263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:13.923394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c3000-09f6-48e2-8b40-6d74beb78068 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:13.960987 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb63cc-8f6b-48c3-997e-0c8e70968c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:13.961681 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb63cc-8f6b-48c3-997e-0c8e70968c56 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:13.961968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb63cc-8f6b-48c3-997e-0c8e70968c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:13.962240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb63cc-8f6b-48c3-997e-0c8e70968c56 None admin] PATH_INFO: `/v3/users/946bbdc2350c4972a5d6235847f73812` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:13.963444 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb63cc-8f6b-48c3-997e-0c8e70968c56 None admin] RBAC: Authorizing `identity:get_user(user_id=946bbdc2350c4972a5d6235847f73812)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:13.964915 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb63cc-8f6b-48c3-997e-0c8e70968c56 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:13.966603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 597/1197] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Jul 28 17:44:13 2022] GET /identity/v3/users/946bbdc2350c4972a5d6235847f73812 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:13.975938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d9d6a-56ca-452d-9b51-e02955dc52c1 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:14.005115 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:14.090304 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d9d6a-56ca-452d-9b51-e02955dc52c1 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:14.131657 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99642c-8163-4325-b783-a8cb45c22048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:14.132450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99642c-8163-4325-b783-a8cb45c22048 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:14.132757 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99642c-8163-4325-b783-a8cb45c22048 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:14.133029 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99642c-8163-4325-b783-a8cb45c22048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:14.218269 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99642c-8163-4325-b783-a8cb45c22048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:14.220480 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99642c-8163-4325-b783-a8cb45c22048 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:14.254693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:14.332769 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 601/1198] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:44:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 17:44:14.342075 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb63cc-8f6b-48c3-997e-0c8e70968c56 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:14.447204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb63cc-8f6b-48c3-997e-0c8e70968c56 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:14.462384 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:14.486771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a13df-9906-41b4-b134-e7f9b1deaf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:14.487401 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a13df-9906-41b4-b134-e7f9b1deaf5c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:14.487671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a13df-9906-41b4-b134-e7f9b1deaf5c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:14.487941 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a13df-9906-41b4-b134-e7f9b1deaf5c None admin] PATH_INFO: `/v3/projects/7410018a9ee14f60a134ad330ff50d44` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:14.489134 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a13df-9906-41b4-b134-e7f9b1deaf5c None admin] RBAC: Authorizing `identity:get_project(project_id=7410018a9ee14f60a134ad330ff50d44)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:14.490586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a13df-9906-41b4-b134-e7f9b1deaf5c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:14.492302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 598/1199] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Jul 28 17:44:14 2022] GET /identity/v3/projects/7410018a9ee14f60a134ad330ff50d44 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:44:14.501735 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99642c-8163-4325-b783-a8cb45c22048 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:44:14.611159 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99642c-8163-4325-b783-a8cb45c22048 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:44:14.638062 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:14.649796 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3aa5f-15c5-48a4-9516-901f91564f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:44:14.650011 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3aa5f-15c5-48a4-9516-901f91564f2f None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:44:14.650570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3aa5f-15c5-48a4-9516-901f91564f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:44:14.650570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3aa5f-15c5-48a4-9516-901f91564f2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:44:14.651383 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3aa5f-15c5-48a4-9516-901f91564f2f None admin] RBAC: Adding query filter params (role.id=980cae90acae42189f92fd6dd42867a5, scope.project.id=7410018a9ee14f60a134ad330ff50d44, user.id=946bbdc2350c4972a5d6235847f73812) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:44:14.651649 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3aa5f-15c5-48a4-9516-901f91564f2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:44:14.653154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3aa5f-15c5-48a4-9516-901f91564f2f None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:44:14.659430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 602/1200] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:44:14 2022] GET /identity/v3/role_assignments?user.id=946bbdc2350c4972a5d6235847f73812&scope.project.id=7410018a9ee14f60a134ad330ff50d44&role.id=980cae90acae42189f92fd6dd42867a5 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:44:24.481451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=9 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:44:24.656987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=5 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:10.792268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1abe8-5b51-4af2-8a02-09f3a9ed5d40 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:10.792268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1abe8-5b51-4af2-8a02-09f3a9ed5d40 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:10.792268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1abe8-5b51-4af2-8a02-09f3a9ed5d40 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:10.792268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 599/1201] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:45:10.805103 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eba63f-b8a9-4d19-a601-c2637479ea21 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:10.805103 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eba63f-b8a9-4d19-a601-c2637479ea21 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:10.805103 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eba63f-b8a9-4d19-a601-c2637479ea21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:10.825229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-e1eba63f-b8a9-4d19-a601-c2637479ea21 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:10.826642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e1eba63f-b8a9-4d19-a601-c2637479ea21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:10.926396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 603/1202] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:10.953563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1abe8-5b51-4af2-8a02-09f3a9ed5d40 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:11.084741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1abe8-5b51-4af2-8a02-09f3a9ed5d40 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:11.133351 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c362c-2149-461d-a9bb-1c38f2ceafe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:11.134529 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c362c-2149-461d-a9bb-1c38f2ceafe0 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:11.134716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c362c-2149-461d-a9bb-1c38f2ceafe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:11.135016 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c362c-2149-461d-a9bb-1c38f2ceafe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:11.151551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c362c-2149-461d-a9bb-1c38f2ceafe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:11.156284 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c362c-2149-461d-a9bb-1c38f2ceafe0 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:11.176426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-7d6c362c-2149-461d-a9bb-1c38f2ceafe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:11.176426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:11.176426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:11.176426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:11.176426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:11.176426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:11.176426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:11.176426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:11.176426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:11.176426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:11.176426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:11.176426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:11.176426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:11.176426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:11.176426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:11.177710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:11.177710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:11.177710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:11.177710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:11.177710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:11.177710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:11.177710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:11.177710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:11.177710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:11.177710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:11.177710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:11.177710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:11.177710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:11.177710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:11.177710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:11.177710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:11.177710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:11.178699 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:11.178699 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:11.178699 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:11.178699 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:45:11.178699 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 600/1203] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:11.185571 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eba63f-b8a9-4d19-a601-c2637479ea21 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:11.326922 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eba63f-b8a9-4d19-a601-c2637479ea21 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:11.364117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:11.372776 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272f357-3813-4553-b19b-52d712856175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:11.373549 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272f357-3813-4553-b19b-52d712856175 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:11.373828 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272f357-3813-4553-b19b-52d712856175 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:11.374162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272f357-3813-4553-b19b-52d712856175 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:11.374808 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272f357-3813-4553-b19b-52d712856175 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:11.375191 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272f357-3813-4553-b19b-52d712856175 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:11.376800 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272f357-3813-4553-b19b-52d712856175 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:11.404277 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 604/1204] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:11.406211 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c362c-2149-461d-a9bb-1c38f2ceafe0 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:11.479075 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:11.543236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c362c-2149-461d-a9bb-1c38f2ceafe0 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:11.589184 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808652bc-057c-4797-b20a-f80bd4f33c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:11.590237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808652bc-057c-4797-b20a-f80bd4f33c60 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:11.590592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808652bc-057c-4797-b20a-f80bd4f33c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:11.590865 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808652bc-057c-4797-b20a-f80bd4f33c60 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:11.591808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808652bc-057c-4797-b20a-f80bd4f33c60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:11.593512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808652bc-057c-4797-b20a-f80bd4f33c60 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:11.621965 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 601/1205] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Jul 28 17:45:11 2022] POST /identity/v3/users => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:45:13.879661 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b122cb-e315-48b0-a477-6fd9f05afa2f None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:13.880229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b122cb-e315-48b0-a477-6fd9f05afa2f None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:13.880341 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b122cb-e315-48b0-a477-6fd9f05afa2f None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:13.882237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 605/1206] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:45:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:13.890086 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e688cd-e610-465d-8398-948a63d5eac4 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:13.890597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e688cd-e610-465d-8398-948a63d5eac4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:13.890714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e688cd-e610-465d-8398-948a63d5eac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:13.914279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-76e688cd-e610-465d-8398-948a63d5eac4 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:13.915587 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-76e688cd-e610-465d-8398-948a63d5eac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:13.987081 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 602/1207] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:14.012225 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b122cb-e315-48b0-a477-6fd9f05afa2f None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:14.134646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b122cb-e315-48b0-a477-6fd9f05afa2f None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:14.176679 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d675fd-2f5c-421e-9a6b-5ee15fe7213e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:14.177464 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d675fd-2f5c-421e-9a6b-5ee15fe7213e None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:14.177801 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d675fd-2f5c-421e-9a6b-5ee15fe7213e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:14.178085 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d675fd-2f5c-421e-9a6b-5ee15fe7213e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:14.190225 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d675fd-2f5c-421e-9a6b-5ee15fe7213e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:14.197958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-e8d675fd-2f5c-421e-9a6b-5ee15fe7213e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:14.197958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:14.197958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:14.197958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:14.197958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:14.197958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:14.197958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:14.197958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:14.197958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:14.197958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:14.197958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:14.197958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:14.197958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:14.197958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:14.197958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:14.197958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:14.198950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:14.198950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:14.198950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:14.198950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:14.198950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:14.198950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:14.198950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:14.198950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:14.198950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:14.198950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:14.198950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:14.198950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:14.198950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:14.198950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:14.198950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:14.198950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:14.199823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:14.199823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:14.199823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:14.199823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:14.199823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:14.199823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:14.199823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:14.199823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:14.199823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:14.199823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:14.199823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:14.199823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:14.199823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 606/1208] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:14.203951 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e688cd-e610-465d-8398-948a63d5eac4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:14.250271 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:14.331940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e688cd-e610-465d-8398-948a63d5eac4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:14.378574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e76a3-576d-4b08-86f5-0284ec22c4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:14.379460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e76a3-576d-4b08-86f5-0284ec22c4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:14.379842 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e76a3-576d-4b08-86f5-0284ec22c4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:14.380218 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e76a3-576d-4b08-86f5-0284ec22c4f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:14.385021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e76a3-576d-4b08-86f5-0284ec22c4f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:14.385021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e76a3-576d-4b08-86f5-0284ec22c4f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:14.385021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e76a3-576d-4b08-86f5-0284ec22c4f8 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:14.396310 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 603/1209] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Jul 28 17:45:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:14.402871 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d675fd-2f5c-421e-9a6b-5ee15fe7213e None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:14.470723 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:14.526284 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d675fd-2f5c-421e-9a6b-5ee15fe7213e None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:14.572998 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc224aa-0709-4d50-9bee-766dc88c2ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:14.573707 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc224aa-0709-4d50-9bee-766dc88c2ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:14.574030 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc224aa-0709-4d50-9bee-766dc88c2ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:14.574375 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc224aa-0709-4d50-9bee-766dc88c2ed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:14.587882 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc224aa-0709-4d50-9bee-766dc88c2ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:14.589373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc224aa-0709-4d50-9bee-766dc88c2ed9 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:14.606928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-1fc224aa-0709-4d50-9bee-766dc88c2ed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:14.606928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:14.606928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:14.606928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:14.606928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:14.606928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:14.606928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:14.606928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:14.606928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:14.606928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:14.606928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:14.606928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:14.606928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:14.606928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:14.606928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:14.608278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:14.608278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:14.608278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:14.608278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:14.608278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:14.608278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:14.608278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:14.608278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:14.608278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:14.608278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:14.608278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:14.608278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:14.608278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:14.608278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:14.608278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:14.608278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:14.608278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:14.609577 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:14.609577 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:14.609577 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:14.609577 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:14.612477 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 607/1210] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:14.614402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e76a3-576d-4b08-86f5-0284ec22c4f8 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:14.753684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:14.758083 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e76a3-576d-4b08-86f5-0284ec22c4f8 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:14.801035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971a4f8-199e-4563-9e7d-f1aed170ab0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:14.802065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971a4f8-199e-4563-9e7d-f1aed170ab0f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:14.802345 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971a4f8-199e-4563-9e7d-f1aed170ab0f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:14.802668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971a4f8-199e-4563-9e7d-f1aed170ab0f None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:14.803398 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971a4f8-199e-4563-9e7d-f1aed170ab0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:14.803679 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971a4f8-199e-4563-9e7d-f1aed170ab0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:14.805233 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971a4f8-199e-4563-9e7d-f1aed170ab0f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:14.818128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 604/1211] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:14.825943 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc224aa-0709-4d50-9bee-766dc88c2ed9 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:14.950507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc224aa-0709-4d50-9bee-766dc88c2ed9 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:14.953375 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:14.991734 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3bd88-c655-4b48-9a8d-ca9c824813f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:14.992540 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3bd88-c655-4b48-9a8d-ca9c824813f5 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:14.992813 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3bd88-c655-4b48-9a8d-ca9c824813f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:14.993101 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3bd88-c655-4b48-9a8d-ca9c824813f5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:15.000937 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3bd88-c655-4b48-9a8d-ca9c824813f5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:15.002569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3bd88-c655-4b48-9a8d-ca9c824813f5 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:15.014693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-3fb3bd88-c655-4b48-9a8d-ca9c824813f5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:45:15.014693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:15.014693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:15.014693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:15.014693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:15.014693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:15.014693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:15.014693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:15.014693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:15.014693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:15.014693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:15.014693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:15.014693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:15.014693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:15.014693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:15.014693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:15.015767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:15.015767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:15.015767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:15.015767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:15.015767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:15.015767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:15.015767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:15.015767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:15.015767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:15.015767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:15.015767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:15.015767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:15.015767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:15.015767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:15.015767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:15.015767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:15.015767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:15.015767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:15.016741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:15.016741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:15.016741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:15.016741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:15.016741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:15.016741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:15.016741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:15.016741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:15.016741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:45:15.016741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:15.016741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 608/1212] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:15.022460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971a4f8-199e-4563-9e7d-f1aed170ab0f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:15.143683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971a4f8-199e-4563-9e7d-f1aed170ab0f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:15.182464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65b7ab-2f7f-4c61-b5f2-eb427a8d331c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:15.183102 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65b7ab-2f7f-4c61-b5f2-eb427a8d331c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:15.183380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65b7ab-2f7f-4c61-b5f2-eb427a8d331c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:15.183655 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65b7ab-2f7f-4c61-b5f2-eb427a8d331c None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:15.184478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65b7ab-2f7f-4c61-b5f2-eb427a8d331c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:15.184786 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65b7ab-2f7f-4c61-b5f2-eb427a8d331c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:15.186667 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65b7ab-2f7f-4c61-b5f2-eb427a8d331c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:15.207419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 605/1213] 10.222.0.96 () {56 vars in 1143 bytes} [Thu Jul 28 17:45:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:15.213523 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3bd88-c655-4b48-9a8d-ca9c824813f5 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:15.329443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3bd88-c655-4b48-9a8d-ca9c824813f5 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:15.365431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c7b24-5151-4fe6-afa4-0d9aff598ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:15.366061 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c7b24-5151-4fe6-afa4-0d9aff598ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:15.366338 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c7b24-5151-4fe6-afa4-0d9aff598ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:15.366625 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c7b24-5151-4fe6-afa4-0d9aff598ac7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:15.405594 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:15.456141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c7b24-5151-4fe6-afa4-0d9aff598ac7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:15.457941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c7b24-5151-4fe6-afa4-0d9aff598ac7 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:15.572531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 609/1214] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:45:15.578092 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65b7ab-2f7f-4c61-b5f2-eb427a8d331c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:15.598792 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:15.698829 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65b7ab-2f7f-4c61-b5f2-eb427a8d331c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:15.742948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe17d6-dd19-4fca-b094-e44775e8b15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:15.743718 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe17d6-dd19-4fca-b094-e44775e8b15a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:15.743985 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe17d6-dd19-4fca-b094-e44775e8b15a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:15.744279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe17d6-dd19-4fca-b094-e44775e8b15a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:15.760143 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe17d6-dd19-4fca-b094-e44775e8b15a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:15.762096 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe17d6-dd19-4fca-b094-e44775e8b15a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:15.784964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-c6fe17d6-dd19-4fca-b094-e44775e8b15a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:15.784964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:15.784964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:15.784964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:15.784964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:15.784964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:15.784964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:15.784964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:15.784964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:15.784964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:15.784964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:15.784964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:15.784964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:15.784964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:15.784964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:15.786221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:15.786221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:15.786221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:15.786221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:15.786221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:15.786221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:15.786221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:15.786221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:15.786221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:15.786221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:15.786221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:15.786221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:15.786221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:15.786221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:15.786221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:15.786221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:15.786221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:15.787492 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:15.787492 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:15.787492 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:15.787492 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:45:15.787492 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 606/1215] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:15.793102 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c7b24-5151-4fe6-afa4-0d9aff598ac7 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:15.866564 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:15.909506 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c7b24-5151-4fe6-afa4-0d9aff598ac7 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:15.946603 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b25f20-207e-499f-b9c6-67f9e0bd8781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:15.947236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b25f20-207e-499f-b9c6-67f9e0bd8781 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:15.947514 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b25f20-207e-499f-b9c6-67f9e0bd8781 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:15.947780 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b25f20-207e-499f-b9c6-67f9e0bd8781 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:15.948475 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b25f20-207e-499f-b9c6-67f9e0bd8781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:15.948777 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b25f20-207e-499f-b9c6-67f9e0bd8781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:15.950190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b25f20-207e-499f-b9c6-67f9e0bd8781 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:15.962391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 610/1216] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:15.968375 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe17d6-dd19-4fca-b094-e44775e8b15a None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:16.045266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:16.081546 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe17d6-dd19-4fca-b094-e44775e8b15a None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:16.120184 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fb7af-48bb-40c1-ad9b-c7f7ff307c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:16.120773 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fb7af-48bb-40c1-ad9b-c7f7ff307c8b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:16.121123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fb7af-48bb-40c1-ad9b-c7f7ff307c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:16.121526 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fb7af-48bb-40c1-ad9b-c7f7ff307c8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:16.129410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fb7af-48bb-40c1-ad9b-c7f7ff307c8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:16.131005 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fb7af-48bb-40c1-ad9b-c7f7ff307c8b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:16.143936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-895fb7af-48bb-40c1-ad9b-c7f7ff307c8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:16.143936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:16.143936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:16.143936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:16.143936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:16.143936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:16.143936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:16.143936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:16.143936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:16.143936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:16.143936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:16.143936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:16.143936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:16.143936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:16.143936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:16.145417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:16.145417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:16.145417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:16.145417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:16.145417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:16.145417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:16.145417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:16.145417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:16.145417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:16.145417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:16.145417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:16.145417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:16.145417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:16.145417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:16.145417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:16.145417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:16.145417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:16.146307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:16.146307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:16.146307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:16.146307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:16.146307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:16.146307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:16.146307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:16.146307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:45:16.146307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 607/1217] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:16.151818 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b25f20-207e-499f-b9c6-67f9e0bd8781 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:16.257794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b25f20-207e-499f-b9c6-67f9e0bd8781 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:16.285890 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:16.301566 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd9fca-c53d-4075-bb06-c8f0efa64eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:16.302534 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd9fca-c53d-4075-bb06-c8f0efa64eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:16.302950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd9fca-c53d-4075-bb06-c8f0efa64eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:16.303312 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd9fca-c53d-4075-bb06-c8f0efa64eb4 None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:16.304243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd9fca-c53d-4075-bb06-c8f0efa64eb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:16.304616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd9fca-c53d-4075-bb06-c8f0efa64eb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:16.307478 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd9fca-c53d-4075-bb06-c8f0efa64eb4 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:16.328307 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 611/1218] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:16.329813 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fb7af-48bb-40c1-ad9b-c7f7ff307c8b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:16.437173 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fb7af-48bb-40c1-ad9b-c7f7ff307c8b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:16.466322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:16.473170 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a58e53-a96c-4faf-af0a-4a3fdca6986b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:16.473822 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a58e53-a96c-4faf-af0a-4a3fdca6986b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:16.474100 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a58e53-a96c-4faf-af0a-4a3fdca6986b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:16.474414 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a58e53-a96c-4faf-af0a-4a3fdca6986b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:16.475206 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a58e53-a96c-4faf-af0a-4a3fdca6986b None admin] RBAC: Adding query filter params (role.id=f8cbbf969cfc442595755799825094f6, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=38257735924d44488e1407fefb886324) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:16.475527 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a58e53-a96c-4faf-af0a-4a3fdca6986b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:16.477232 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a58e53-a96c-4faf-af0a-4a3fdca6986b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:16.493113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 608/1219] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:16 2022] GET /identity/v3/role_assignments?user.id=38257735924d44488e1407fefb886324&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=f8cbbf969cfc442595755799825094f6 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:18.595794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b0c99-3ab3-4f4e-a4ac-a66a29e426b2 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:18.596403 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b0c99-3ab3-4f4e-a4ac-a66a29e426b2 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:18.596403 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b0c99-3ab3-4f4e-a4ac-a66a29e426b2 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:18.598418 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 612/1220] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:45:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:18.604855 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f07492-a825-488c-8a7e-fa208eadf41c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:18.605382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f07492-a825-488c-8a7e-fa208eadf41c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:18.605479 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f07492-a825-488c-8a7e-fa208eadf41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:18.624298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-32f07492-a825-488c-8a7e-fa208eadf41c None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:18.625545 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-32f07492-a825-488c-8a7e-fa208eadf41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:18.695962 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 609/1221] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:18.722132 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b0c99-3ab3-4f4e-a4ac-a66a29e426b2 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:18.834387 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b0c99-3ab3-4f4e-a4ac-a66a29e426b2 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:18.870004 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0469d-c128-42cc-aec9-9ea631b8ff8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:18.870662 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0469d-c128-42cc-aec9-9ea631b8ff8f None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:18.870934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0469d-c128-42cc-aec9-9ea631b8ff8f None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:18.871245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0469d-c128-42cc-aec9-9ea631b8ff8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:18.882195 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0469d-c128-42cc-aec9-9ea631b8ff8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:18.887588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-40a0469d-c128-42cc-aec9-9ea631b8ff8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:18.887588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:18.887588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:18.887588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:18.887588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:18.887588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:18.887588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:18.887588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:18.887588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:18.887588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:18.887588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:18.887588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:18.887588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:18.887588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:18.887588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:18.887588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:18.888753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:18.888753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:18.888753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:18.888753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:18.888753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:18.888753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:18.888753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:18.888753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:18.888753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:18.888753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:18.888753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:18.888753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:18.888753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:18.888753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:18.888753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:18.888753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:18.889675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:18.889675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:18.889675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:18.889675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:18.889675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:18.889675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:18.889675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:18.889675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:18.889675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:18.889675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:18.889675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:18.889675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:18.889675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 613/1222] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:18.896189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f07492-a825-488c-8a7e-fa208eadf41c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:19.011347 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f07492-a825-488c-8a7e-fa208eadf41c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:19.042234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:19.054962 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef13a9-3660-4e23-be27-a31994951fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:19.055630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef13a9-3660-4e23-be27-a31994951fdb None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:19.055946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef13a9-3660-4e23-be27-a31994951fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:19.056212 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef13a9-3660-4e23-be27-a31994951fdb None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:19.057135 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef13a9-3660-4e23-be27-a31994951fdb None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:19.057487 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef13a9-3660-4e23-be27-a31994951fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:19.059068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef13a9-3660-4e23-be27-a31994951fdb None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:19.068616 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 610/1223] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Jul 28 17:45:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:19.075316 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0469d-c128-42cc-aec9-9ea631b8ff8f None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:19.127506 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:19.187925 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0469d-c128-42cc-aec9-9ea631b8ff8f None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:19.225017 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bf889-feb5-4b43-b66a-677a5307210d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:19.225761 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bf889-feb5-4b43-b66a-677a5307210d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:19.226786 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bf889-feb5-4b43-b66a-677a5307210d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:19.227146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bf889-feb5-4b43-b66a-677a5307210d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:19.239656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bf889-feb5-4b43-b66a-677a5307210d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:19.241303 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bf889-feb5-4b43-b66a-677a5307210d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:19.259321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-667bf889-feb5-4b43-b66a-677a5307210d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:19.259321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:19.259321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:19.259321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:19.259321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:19.259321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:19.259321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:19.259321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:19.259321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:19.259321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:19.259321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:19.259321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:19.259321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:19.259321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:19.259321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:19.260420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:19.260420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:19.260420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:19.260420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:19.260420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:19.260420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:19.260420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:19.260420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:19.260420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:19.260420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:19.260420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:19.260420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:19.260420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:19.260420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:19.260420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:19.260420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:19.260420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:19.261568 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:19.261568 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:19.261568 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:19.261568 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:19.266287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 614/1224] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:19.267572 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef13a9-3660-4e23-be27-a31994951fdb None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:19.384739 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef13a9-3660-4e23-be27-a31994951fdb None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:19.419376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87c1ae-019e-435c-8532-357c29206cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:19.419971 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87c1ae-019e-435c-8532-357c29206cdd None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:19.420260 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87c1ae-019e-435c-8532-357c29206cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:19.420509 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87c1ae-019e-435c-8532-357c29206cdd None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:19.421234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87c1ae-019e-435c-8532-357c29206cdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:19.421533 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87c1ae-019e-435c-8532-357c29206cdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:19.423051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87c1ae-019e-435c-8532-357c29206cdd None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:19.436037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 611/1225] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:19.442386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bf889-feb5-4b43-b66a-677a5307210d None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:19.540316 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:19.547431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bf889-feb5-4b43-b66a-677a5307210d None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:19.582333 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70011a0-5402-467a-a280-71c7fa11c913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:19.582990 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70011a0-5402-467a-a280-71c7fa11c913 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:19.583270 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70011a0-5402-467a-a280-71c7fa11c913 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:19.583542 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70011a0-5402-467a-a280-71c7fa11c913 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:19.591660 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70011a0-5402-467a-a280-71c7fa11c913 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:19.593137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70011a0-5402-467a-a280-71c7fa11c913 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:19.605039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-a70011a0-5402-467a-a280-71c7fa11c913 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:45:19.605039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:19.605039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:19.605039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:19.605039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:19.605039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:19.605039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:19.605039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:19.605039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:19.605039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:19.605039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:19.605039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:19.605039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:19.605039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:19.605039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:19.605039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:19.612920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:19.612920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:19.612920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:19.612920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:19.612920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:19.612920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:19.612920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:19.612920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:19.612920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:19.612920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:19.612920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:19.612920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:19.612920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:19.612920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:19.612920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:19.612920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:19.612920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:19.612920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:19.614150 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:19.614150 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:19.614150 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:19.614150 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:19.614150 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:19.614150 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:19.614150 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:19.614150 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:19.614150 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:45:19.614150 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:19.614150 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 615/1226] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:19.615001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87c1ae-019e-435c-8532-357c29206cdd None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:19.665011 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:19.732030 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87c1ae-019e-435c-8532-357c29206cdd None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:19.773081 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6f213-80e7-4bbe-8007-8f8a20804d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:19.773752 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6f213-80e7-4bbe-8007-8f8a20804d91 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:19.774033 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6f213-80e7-4bbe-8007-8f8a20804d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:19.774309 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6f213-80e7-4bbe-8007-8f8a20804d91 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:19.775097 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6f213-80e7-4bbe-8007-8f8a20804d91 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:19.775396 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6f213-80e7-4bbe-8007-8f8a20804d91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:19.776875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6f213-80e7-4bbe-8007-8f8a20804d91 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:19.794680 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 612/1227] 10.222.0.96 () {56 vars in 1143 bytes} [Thu Jul 28 17:45:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:19.800714 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70011a0-5402-467a-a280-71c7fa11c913 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:19.907291 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70011a0-5402-467a-a280-71c7fa11c913 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:19.944772 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c4dcd-810d-4d39-ac4b-52a3bc97d97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:19.945368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c4dcd-810d-4d39-ac4b-52a3bc97d97a None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:19.945648 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c4dcd-810d-4d39-ac4b-52a3bc97d97a None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:19.945917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c4dcd-810d-4d39-ac4b-52a3bc97d97a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:19.958097 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c4dcd-810d-4d39-ac4b-52a3bc97d97a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:19.959873 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c4dcd-810d-4d39-ac4b-52a3bc97d97a None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:19.974265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-1a2c4dcd-810d-4d39-ac4b-52a3bc97d97a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:19.974265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:19.974265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:19.974265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:19.974265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:19.974265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:19.974265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:19.974265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:19.974265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:19.974265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:19.974265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:19.974265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:19.974265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:19.974265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:19.974265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:19.975401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:19.975401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:19.975401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:19.975401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:19.975401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:19.975401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:19.975401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:19.975401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:19.975401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:19.975401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:19.975401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:19.975401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:19.975401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:19.975401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:19.975401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:19.975401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:19.975401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:19.976487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:19.976487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:19.976487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:19.976487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:19.976487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 616/1228] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:19.981706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6f213-80e7-4bbe-8007-8f8a20804d91 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:20.092278 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6f213-80e7-4bbe-8007-8f8a20804d91 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:20.095271 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:20.133706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02085204-481e-42c5-8300-77cec47306da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:20.134806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02085204-481e-42c5-8300-77cec47306da None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:20.135130 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02085204-481e-42c5-8300-77cec47306da None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:20.135408 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02085204-481e-42c5-8300-77cec47306da None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:20.136202 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02085204-481e-42c5-8300-77cec47306da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:20.136510 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02085204-481e-42c5-8300-77cec47306da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:20.137918 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02085204-481e-42c5-8300-77cec47306da None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:20.150441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 613/1229] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:20.157262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c4dcd-810d-4d39-ac4b-52a3bc97d97a None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:20.166571 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:20.265950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c4dcd-810d-4d39-ac4b-52a3bc97d97a None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:20.302443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b5347-faf2-4ed4-875f-fe919c8a123f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:20.303156 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b5347-faf2-4ed4-875f-fe919c8a123f None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:20.303422 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b5347-faf2-4ed4-875f-fe919c8a123f None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:20.303726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b5347-faf2-4ed4-875f-fe919c8a123f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:20.311314 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b5347-faf2-4ed4-875f-fe919c8a123f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:20.312932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b5347-faf2-4ed4-875f-fe919c8a123f None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:20.324825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-b10b5347-faf2-4ed4-875f-fe919c8a123f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:20.324825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:20.324825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:20.324825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:20.324825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:20.324825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:20.324825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:20.324825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:20.324825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:20.324825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:20.324825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:20.324825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:20.324825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:20.324825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:20.324825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:20.326249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:20.326249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:20.326249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:20.326249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:20.326249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:20.326249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:20.326249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:20.326249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:20.326249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:20.326249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:20.326249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:20.326249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:20.326249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:20.326249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:20.326249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:20.326249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:20.326249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:20.327251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:20.327251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:20.327251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:20.327251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:20.327251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:20.327251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:20.327251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:20.327251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:20.327251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 617/1230] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:20.332849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02085204-481e-42c5-8300-77cec47306da None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:20.451165 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02085204-481e-42c5-8300-77cec47306da None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:20.490262 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a14919-c06e-4bbc-99b5-41ff25d1f7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:20.491524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a14919-c06e-4bbc-99b5-41ff25d1f7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:20.491524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a14919-c06e-4bbc-99b5-41ff25d1f7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:20.491524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a14919-c06e-4bbc-99b5-41ff25d1f7c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:20.492212 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a14919-c06e-4bbc-99b5-41ff25d1f7c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:20.492635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a14919-c06e-4bbc-99b5-41ff25d1f7c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:20.494154 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a14919-c06e-4bbc-99b5-41ff25d1f7c7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:20.510934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 614/1231] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:20.517497 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b5347-faf2-4ed4-875f-fe919c8a123f None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:20.586854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:20.625668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b5347-faf2-4ed4-875f-fe919c8a123f None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:20.666041 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82fe05-7c9b-4a61-a4c4-4ab3ec3b77b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:20.666818 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82fe05-7c9b-4a61-a4c4-4ab3ec3b77b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:20.667098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82fe05-7c9b-4a61-a4c4-4ab3ec3b77b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:20.667416 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82fe05-7c9b-4a61-a4c4-4ab3ec3b77b5 None admin] PATH_INFO: `/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/38257735924d44488e1407fefb886324/roles/f8cbbf969cfc442595755799825094f6` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:20.685046 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82fe05-7c9b-4a61-a4c4-4ab3ec3b77b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=db5ce5e789e949d09c183dbe04e53f19, user_id=38257735924d44488e1407fefb886324, role_id=f8cbbf969cfc442595755799825094f6)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:20.686607 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82fe05-7c9b-4a61-a4c4-4ab3ec3b77b5 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:20.701798 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 618/1232] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:45:20 2022] PUT /identity/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/38257735924d44488e1407fefb886324/roles/f8cbbf969cfc442595755799825094f6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:45:23.030789 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe39668-71f9-494a-924b-9fadd85b1645 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:23.031326 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe39668-71f9-494a-924b-9fadd85b1645 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:23.031326 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe39668-71f9-494a-924b-9fadd85b1645 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:23.032693 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 615/1233] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:23.038303 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfec617-9e87-4bc3-a772-c1f68558c3eb None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:23.039018 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfec617-9e87-4bc3-a772-c1f68558c3eb None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:23.039213 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfec617-9e87-4bc3-a772-c1f68558c3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:23.058767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-bbfec617-9e87-4bc3-a772-c1f68558c3eb None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:23.060050 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-bbfec617-9e87-4bc3-a772-c1f68558c3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:23.137498 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 619/1234] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:23.160707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe39668-71f9-494a-924b-9fadd85b1645 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:23.187799 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:23.266789 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe39668-71f9-494a-924b-9fadd85b1645 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:23.301786 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d18fc-5a75-4760-886a-fc6607656e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:23.302334 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d18fc-5a75-4760-886a-fc6607656e21 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:23.302609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d18fc-5a75-4760-886a-fc6607656e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:23.302879 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d18fc-5a75-4760-886a-fc6607656e21 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:23.313249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d18fc-5a75-4760-886a-fc6607656e21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:23.318525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-559d18fc-5a75-4760-886a-fc6607656e21 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:23.318525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:23.318525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:23.318525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:23.318525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:23.318525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:23.318525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:23.318525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:23.318525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:23.318525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:23.318525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:23.318525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:23.318525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:23.318525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:23.318525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:23.318525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:23.319674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:23.319674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:23.319674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:23.319674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:23.319674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:23.319674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:23.319674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:23.319674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:23.319674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:23.319674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:23.319674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:23.319674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:23.319674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:23.319674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:23.319674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:23.319674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:23.320831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:23.320831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:23.320831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:23.320831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:23.320831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:23.320831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:23.320831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:23.320831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:23.320831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:23.320831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:23.320831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:45:23.320831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:45:23.320831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 616/1235] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Jul 28 17:45:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:23.326436 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfec617-9e87-4bc3-a772-c1f68558c3eb None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:23.377781 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:23.441403 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfec617-9e87-4bc3-a772-c1f68558c3eb None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:23.481016 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e7c5e-27d9-4007-b25d-d675e16b768f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:23.481676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e7c5e-27d9-4007-b25d-d675e16b768f None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:23.481958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e7c5e-27d9-4007-b25d-d675e16b768f None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:23.482234 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e7c5e-27d9-4007-b25d-d675e16b768f None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:23.482982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e7c5e-27d9-4007-b25d-d675e16b768f None admin] RBAC: Adding query filter params (name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:23.483287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e7c5e-27d9-4007-b25d-d675e16b768f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:23.484701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e7c5e-27d9-4007-b25d-d675e16b768f None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:23.493608 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 620/1236] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Jul 28 17:45:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:23.500378 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d18fc-5a75-4760-886a-fc6607656e21 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:23.593712 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:23.610965 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d18fc-5a75-4760-886a-fc6607656e21 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:23.646802 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a980624-1e9c-4ee0-8344-4a1ee1c72bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:23.647441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a980624-1e9c-4ee0-8344-4a1ee1c72bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:23.647918 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a980624-1e9c-4ee0-8344-4a1ee1c72bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:23.648246 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a980624-1e9c-4ee0-8344-4a1ee1c72bb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:23.660452 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a980624-1e9c-4ee0-8344-4a1ee1c72bb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:23.662171 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a980624-1e9c-4ee0-8344-4a1ee1c72bb4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:23.677098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-2a980624-1e9c-4ee0-8344-4a1ee1c72bb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:23.677098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:23.677098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:23.677098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:23.677098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:23.677098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:23.677098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:23.677098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:23.677098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:23.677098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:23.677098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:23.677098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:23.677098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:23.677098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:23.677098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:23.678186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:23.678186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:23.678186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:23.678186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:23.678186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:23.678186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:23.678186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:23.678186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:23.678186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:23.678186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:23.678186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:23.678186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:23.678186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:23.678186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:23.678186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:23.678186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:23.678186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:23.679194 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:23.679194 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:23.679194 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:23.679194 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:45:23.681243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 617/1237] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:23.685861 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e7c5e-27d9-4007-b25d-d675e16b768f None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:23.805996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e7c5e-27d9-4007-b25d-d675e16b768f None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:23.815072 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:23.843480 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054e092-a123-471a-82c6-c6cdb1aee3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:23.844251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054e092-a123-471a-82c6-c6cdb1aee3bf None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:23.844480 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054e092-a123-471a-82c6-c6cdb1aee3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:23.844769 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054e092-a123-471a-82c6-c6cdb1aee3bf None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:23.845576 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054e092-a123-471a-82c6-c6cdb1aee3bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:23.845894 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054e092-a123-471a-82c6-c6cdb1aee3bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:23.847513 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054e092-a123-471a-82c6-c6cdb1aee3bf None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:23.861159 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 621/1238] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:23.867408 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a980624-1e9c-4ee0-8344-4a1ee1c72bb4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:23.975588 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a980624-1e9c-4ee0-8344-4a1ee1c72bb4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:24.019588 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79992d7e-1449-489b-b9f1-72035a4135d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:24.020919 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79992d7e-1449-489b-b9f1-72035a4135d2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:24.020919 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79992d7e-1449-489b-b9f1-72035a4135d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:24.020919 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79992d7e-1449-489b-b9f1-72035a4135d2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:24.025585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:24.032635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79992d7e-1449-489b-b9f1-72035a4135d2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:24.034799 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79992d7e-1449-489b-b9f1-72035a4135d2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:24.050204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-79992d7e-1449-489b-b9f1-72035a4135d2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:45:24.050204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:24.050204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:24.050204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:24.050204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:24.050204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:24.050204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:24.050204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:24.050204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:24.050204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:24.050204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:24.050204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:24.050204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:24.050204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:24.050204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:24.050204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:24.051480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:24.051480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:24.051480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:24.051480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:24.051480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:24.051480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:24.051480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:24.051480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:24.051480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:24.051480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:24.051480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:24.051480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:24.051480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:24.051480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:24.051480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:24.051480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:24.051480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:24.051480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:24.052481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:24.052481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:24.052481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:24.052481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:24.052481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:24.052481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:24.052481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:24.052481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:24.052481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:45:24.052481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:45:24.052481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 618/1239] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:24.058358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054e092-a123-471a-82c6-c6cdb1aee3bf None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:24.171992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054e092-a123-471a-82c6-c6cdb1aee3bf None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:24.207338 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a7b74-139a-4a42-95ed-8f6305a0124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:24.207968 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a7b74-139a-4a42-95ed-8f6305a0124f None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:24.208266 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a7b74-139a-4a42-95ed-8f6305a0124f None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:24.208526 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a7b74-139a-4a42-95ed-8f6305a0124f None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:24.209364 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a7b74-139a-4a42-95ed-8f6305a0124f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:24.209671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a7b74-139a-4a42-95ed-8f6305a0124f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:24.211260 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a7b74-139a-4a42-95ed-8f6305a0124f None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:24.231638 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 622/1240] 10.222.0.96 () {56 vars in 1143 bytes} [Thu Jul 28 17:45:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:24.237755 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79992d7e-1449-489b-b9f1-72035a4135d2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:24.347353 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79992d7e-1449-489b-b9f1-72035a4135d2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:24.386335 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64842c97-a3ca-4208-8856-504a3357c47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:24.387013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64842c97-a3ca-4208-8856-504a3357c47b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:24.387320 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64842c97-a3ca-4208-8856-504a3357c47b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:24.387579 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64842c97-a3ca-4208-8856-504a3357c47b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:24.455092 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:24.467748 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64842c97-a3ca-4208-8856-504a3357c47b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:24.469784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64842c97-a3ca-4208-8856-504a3357c47b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:24.578877 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 619/1241] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:45:24.584906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a7b74-139a-4a42-95ed-8f6305a0124f None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:24.614939 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:24.694410 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a7b74-139a-4a42-95ed-8f6305a0124f None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:24.733424 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460ec8d-dee9-4907-96c6-f38bc61018e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:24.734232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460ec8d-dee9-4907-96c6-f38bc61018e1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:24.734515 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460ec8d-dee9-4907-96c6-f38bc61018e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:24.734916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460ec8d-dee9-4907-96c6-f38bc61018e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:24.749462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460ec8d-dee9-4907-96c6-f38bc61018e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:24.751296 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460ec8d-dee9-4907-96c6-f38bc61018e1 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:24.770753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-5460ec8d-dee9-4907-96c6-f38bc61018e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:24.770753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:24.770753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:24.770753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:24.770753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:24.770753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:24.770753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:24.770753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:24.770753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:24.770753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:24.770753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:24.770753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:24.770753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:24.770753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:24.770753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:24.772015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:24.772015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:24.772015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:24.772015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:24.772015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:24.772015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:24.772015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:24.772015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:24.772015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:24.772015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:24.772015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:24.772015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:24.772015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:24.772015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:24.772015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:24.772015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:24.772015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:24.772944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:24.772944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:24.772944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:24.772944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:24.772944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 623/1242] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:24.779047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64842c97-a3ca-4208-8856-504a3357c47b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:24.887661 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:24.896226 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64842c97-a3ca-4208-8856-504a3357c47b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:24.935273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9bc16-bc31-4686-81ac-804d248fb1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:24.935955 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9bc16-bc31-4686-81ac-804d248fb1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:24.936238 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9bc16-bc31-4686-81ac-804d248fb1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:24.936514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9bc16-bc31-4686-81ac-804d248fb1d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:24.937255 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9bc16-bc31-4686-81ac-804d248fb1d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:24.937594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9bc16-bc31-4686-81ac-804d248fb1d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:24.938988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9bc16-bc31-4686-81ac-804d248fb1d4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:24.952923 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 620/1243] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:24.961668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460ec8d-dee9-4907-96c6-f38bc61018e1 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:25.049921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:25.076506 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460ec8d-dee9-4907-96c6-f38bc61018e1 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:25.113088 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba63af-da61-466e-98cc-5a86c436f372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:25.113763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba63af-da61-466e-98cc-5a86c436f372 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:25.114079 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba63af-da61-466e-98cc-5a86c436f372 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:25.114357 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba63af-da61-466e-98cc-5a86c436f372 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:25.121846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba63af-da61-466e-98cc-5a86c436f372 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:25.123315 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba63af-da61-466e-98cc-5a86c436f372 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:25.136146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-1fba63af-da61-466e-98cc-5a86c436f372 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:25.136146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:25.136146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:25.136146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:25.136146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:25.136146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:25.136146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:25.136146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:25.136146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:25.136146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:25.136146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:25.136146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:25.136146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:25.136146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:25.136146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:25.137370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:25.137370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:25.137370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:25.137370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:25.137370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:25.137370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:25.137370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:25.137370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:25.137370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:25.137370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:25.137370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:25.137370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:25.137370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:25.137370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:25.137370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:25.137370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:25.137370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:25.138449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:25.138449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:25.138449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:25.138449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:25.138449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:25.138449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:25.138449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:25.138449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:25.138449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 624/1244] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:25.143524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9bc16-bc31-4686-81ac-804d248fb1d4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:25.252165 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9bc16-bc31-4686-81ac-804d248fb1d4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:25.291154 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036c71b-ff28-4e15-bc90-ac305efdd289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:25.291682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036c71b-ff28-4e15-bc90-ac305efdd289 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:25.291965 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036c71b-ff28-4e15-bc90-ac305efdd289 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:25.292269 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036c71b-ff28-4e15-bc90-ac305efdd289 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:25.293006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036c71b-ff28-4e15-bc90-ac305efdd289 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:25.293337 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036c71b-ff28-4e15-bc90-ac305efdd289 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:25.294779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036c71b-ff28-4e15-bc90-ac305efdd289 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:25.310187 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 621/1245] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:25.316599 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba63af-da61-466e-98cc-5a86c436f372 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:25.429078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba63af-da61-466e-98cc-5a86c436f372 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:25.470163 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac97a2-3ed3-4c02-8c83-899f84903ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:25.471219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac97a2-3ed3-4c02-8c83-899f84903ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:25.471700 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac97a2-3ed3-4c02-8c83-899f84903ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:25.472198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac97a2-3ed3-4c02-8c83-899f84903ed1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:25.473089 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac97a2-3ed3-4c02-8c83-899f84903ed1 None admin] RBAC: Adding query filter params (role.id=f8cbbf969cfc442595755799825094f6, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=38257735924d44488e1407fefb886324) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:25.473400 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac97a2-3ed3-4c02-8c83-899f84903ed1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:25.474882 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac97a2-3ed3-4c02-8c83-899f84903ed1 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:25.481782 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 625/1246] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:25 2022] GET /identity/v3/role_assignments?user.id=38257735924d44488e1407fefb886324&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=f8cbbf969cfc442595755799825094f6 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:27.632061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839d5f4-35d5-4c69-bd8c-cf3016f5538b None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:27.632691 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839d5f4-35d5-4c69-bd8c-cf3016f5538b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:27.632691 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839d5f4-35d5-4c69-bd8c-cf3016f5538b None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:27.635445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 622/1247] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:45:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:27.641839 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363048bf-bda2-4d87-b736-4a5c583a04a3 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:27.642358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363048bf-bda2-4d87-b736-4a5c583a04a3 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:27.642468 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363048bf-bda2-4d87-b736-4a5c583a04a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:27.651285 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:27.666848 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-363048bf-bda2-4d87-b736-4a5c583a04a3 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:27.668176 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-363048bf-bda2-4d87-b736-4a5c583a04a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:27.746996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 626/1248] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:27.772861 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839d5f4-35d5-4c69-bd8c-cf3016f5538b None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:27.794743 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:27.898394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839d5f4-35d5-4c69-bd8c-cf3016f5538b None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:27.935758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845f9ab-12b8-478e-8aee-db8251b82a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:27.936439 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845f9ab-12b8-478e-8aee-db8251b82a40 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:27.936723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845f9ab-12b8-478e-8aee-db8251b82a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:27.937076 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845f9ab-12b8-478e-8aee-db8251b82a40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:27.948816 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845f9ab-12b8-478e-8aee-db8251b82a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:27.953671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-4845f9ab-12b8-478e-8aee-db8251b82a40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:45:27.953671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:27.953671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:27.953671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:27.953671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:27.953671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:27.953671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:27.953671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:27.953671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:27.953671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:27.953671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:27.953671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:27.953671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:27.953671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:27.953671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:27.953671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:27.954853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:27.954853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:27.954853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:27.954853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:27.954853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:27.954853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:27.954853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:27.954853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:27.954853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:27.954853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:27.954853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:27.954853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:27.954853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:27.954853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:27.954853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:27.954853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:27.955745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:27.955745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:27.955745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:27.955745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:27.955745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:27.955745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:27.955745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:27.955745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:27.955745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:27.955745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:27.955745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:45:27.955745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:45:27.955745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 623/1249] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:45:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:27.961614 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363048bf-bda2-4d87-b736-4a5c583a04a3 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:28.074985 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363048bf-bda2-4d87-b736-4a5c583a04a3 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:28.107635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:28.114517 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859eda9-f5f0-41f4-a798-785ecddd61df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:28.115287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859eda9-f5f0-41f4-a798-785ecddd61df None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:28.115609 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859eda9-f5f0-41f4-a798-785ecddd61df None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:28.116082 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859eda9-f5f0-41f4-a798-785ecddd61df None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:28.116900 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859eda9-f5f0-41f4-a798-785ecddd61df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:28.117244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859eda9-f5f0-41f4-a798-785ecddd61df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:28.118645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859eda9-f5f0-41f4-a798-785ecddd61df None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:28.132740 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 627/1250] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:45:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:28.138984 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845f9ab-12b8-478e-8aee-db8251b82a40 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:28.228872 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:28.254588 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845f9ab-12b8-478e-8aee-db8251b82a40 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:28.291933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ac85a-179e-4413-99f8-7d938bfffd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:28.292827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ac85a-179e-4413-99f8-7d938bfffd2c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:28.293190 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ac85a-179e-4413-99f8-7d938bfffd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:28.293514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ac85a-179e-4413-99f8-7d938bfffd2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:28.307114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ac85a-179e-4413-99f8-7d938bfffd2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:28.308643 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ac85a-179e-4413-99f8-7d938bfffd2c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:28.325692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-590ac85a-179e-4413-99f8-7d938bfffd2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:28.325692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:28.325692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:28.325692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:28.325692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:28.325692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:28.325692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:28.325692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:28.325692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:28.325692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:28.325692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:28.325692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:28.325692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:28.325692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:28.325692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:28.326731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:28.326731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:28.326731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:28.326731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:28.326731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:28.326731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:28.326731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:28.326731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:28.326731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:28.326731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:28.326731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:28.326731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:28.326731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:28.326731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:28.326731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:28.326731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:28.326731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:28.327722 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:28.327722 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:28.327722 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:28.327722 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:45:28.327722 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 624/1251] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:28.333530 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859eda9-f5f0-41f4-a798-785ecddd61df None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:28.443108 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859eda9-f5f0-41f4-a798-785ecddd61df None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:28.482655 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d71f8-3e31-4db6-9ca1-c114623104e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:28.483203 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d71f8-3e31-4db6-9ca1-c114623104e1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:28.483487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d71f8-3e31-4db6-9ca1-c114623104e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:28.483763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d71f8-3e31-4db6-9ca1-c114623104e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:28.484451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d71f8-3e31-4db6-9ca1-c114623104e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:28.484761 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d71f8-3e31-4db6-9ca1-c114623104e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:28.486347 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d71f8-3e31-4db6-9ca1-c114623104e1 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:28.500265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 628/1252] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:28.506393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ac85a-179e-4413-99f8-7d938bfffd2c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:28.615690 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ac85a-179e-4413-99f8-7d938bfffd2c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:28.646781 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:28.656308 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b262ea-c938-4028-a159-ebade4bd0b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:28.656955 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b262ea-c938-4028-a159-ebade4bd0b1e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:28.657248 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b262ea-c938-4028-a159-ebade4bd0b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:28.657532 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b262ea-c938-4028-a159-ebade4bd0b1e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:28.668317 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b262ea-c938-4028-a159-ebade4bd0b1e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:28.671576 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b262ea-c938-4028-a159-ebade4bd0b1e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:28.689568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-46b262ea-c938-4028-a159-ebade4bd0b1e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:45:28.689568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:28.689568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:28.689568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:28.689568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:28.689568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:28.689568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:28.689568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:28.689568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:28.689568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:28.689568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:28.689568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:28.689568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:28.689568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:28.689568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:28.689568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:28.691805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:28.691805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:28.691805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:28.691805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:28.691805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:28.691805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:28.691805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:28.691805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:28.691805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:28.691805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:28.691805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:28.691805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:28.691805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:28.691805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:28.691805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:28.691805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:28.691805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:28.691805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:28.692762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:28.692762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:28.692762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:28.692762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:28.692762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:28.692762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:28.692762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:28.692762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:28.692762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:45:28.692762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:45:28.692762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 625/1253] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:28.697814 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d71f8-3e31-4db6-9ca1-c114623104e1 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:28.765725 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:28.814691 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d71f8-3e31-4db6-9ca1-c114623104e1 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:28.848368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f6a91-21f9-42f0-9422-0360a5b4cbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:28.848989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f6a91-21f9-42f0-9422-0360a5b4cbec None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:28.849339 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f6a91-21f9-42f0-9422-0360a5b4cbec None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:28.849634 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f6a91-21f9-42f0-9422-0360a5b4cbec None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:28.850457 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f6a91-21f9-42f0-9422-0360a5b4cbec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:28.850972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f6a91-21f9-42f0-9422-0360a5b4cbec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:28.852715 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f6a91-21f9-42f0-9422-0360a5b4cbec None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:28.872115 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 629/1254] 10.222.0.96 () {56 vars in 1143 bytes} [Thu Jul 28 17:45:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:28.878314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b262ea-c938-4028-a159-ebade4bd0b1e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:28.990624 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b262ea-c938-4028-a159-ebade4bd0b1e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:29.039739 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343892d3-bc45-40b6-aa74-d1915a5fda92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:29.040368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343892d3-bc45-40b6-aa74-d1915a5fda92 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:29.040677 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343892d3-bc45-40b6-aa74-d1915a5fda92 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:29.040923 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343892d3-bc45-40b6-aa74-d1915a5fda92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:29.100694 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:29.114225 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343892d3-bc45-40b6-aa74-d1915a5fda92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:29.115772 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343892d3-bc45-40b6-aa74-d1915a5fda92 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:29.229534 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 626/1255] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:45:29.239078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f6a91-21f9-42f0-9422-0360a5b4cbec None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:29.359995 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f6a91-21f9-42f0-9422-0360a5b4cbec None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:29.377187 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:29.403599 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204ee46-87c1-42eb-866d-b5dc5ad7b155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:29.404373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204ee46-87c1-42eb-866d-b5dc5ad7b155 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:29.404651 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204ee46-87c1-42eb-866d-b5dc5ad7b155 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:29.404954 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204ee46-87c1-42eb-866d-b5dc5ad7b155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:29.416772 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204ee46-87c1-42eb-866d-b5dc5ad7b155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:29.418546 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204ee46-87c1-42eb-866d-b5dc5ad7b155 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:29.435724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-6204ee46-87c1-42eb-866d-b5dc5ad7b155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:29.435724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:29.435724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:29.435724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:29.435724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:29.435724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:29.435724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:29.435724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:29.435724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:29.435724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:29.435724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:29.435724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:29.435724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:29.435724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:29.435724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:29.442525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:29.442525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:29.442525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:29.442525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:29.442525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:29.442525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:29.442525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:29.442525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:29.442525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:29.442525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:29.442525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:29.442525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:29.442525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:29.442525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:29.442525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:29.442525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:29.442525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:29.443636 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:29.443636 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:29.443636 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:29.443636 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:29.443636 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 630/1256] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:29.443984 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343892d3-bc45-40b6-aa74-d1915a5fda92 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:29.553709 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:29.568577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343892d3-bc45-40b6-aa74-d1915a5fda92 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:29.610371 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44b5ee-06e2-4477-91a7-0133175a8c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:29.610898 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44b5ee-06e2-4477-91a7-0133175a8c89 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:29.611176 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44b5ee-06e2-4477-91a7-0133175a8c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:29.611447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44b5ee-06e2-4477-91a7-0133175a8c89 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:29.612142 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44b5ee-06e2-4477-91a7-0133175a8c89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:29.612420 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44b5ee-06e2-4477-91a7-0133175a8c89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:29.614096 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44b5ee-06e2-4477-91a7-0133175a8c89 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:29.626984 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 627/1257] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:29.633317 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204ee46-87c1-42eb-866d-b5dc5ad7b155 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:29.749447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204ee46-87c1-42eb-866d-b5dc5ad7b155 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:29.794119 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7dd93-d243-402f-abdc-269eab271e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:29.794899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7dd93-d243-402f-abdc-269eab271e23 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:29.795177 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7dd93-d243-402f-abdc-269eab271e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:29.795481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7dd93-d243-402f-abdc-269eab271e23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:29.802733 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7dd93-d243-402f-abdc-269eab271e23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:29.804349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7dd93-d243-402f-abdc-269eab271e23 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:29.816683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-10b7dd93-d243-402f-abdc-269eab271e23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:29.816683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:29.816683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:29.816683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:29.816683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:29.816683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:29.816683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:29.816683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:29.816683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:29.816683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:29.816683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:29.816683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:29.816683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:29.816683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:29.816683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:29.817978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:29.817978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:29.817978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:29.817978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:29.817978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:29.817978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:29.817978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:29.817978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:29.817978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:29.817978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:29.817978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:29.817978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:29.817978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:29.817978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:29.817978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:29.817978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:29.817978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:29.819027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:29.819027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:29.819027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:29.819027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:29.819027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:29.819027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:29.819027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:29.819027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:29.819027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 631/1258] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:29.824969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44b5ee-06e2-4477-91a7-0133175a8c89 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:29.937518 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44b5ee-06e2-4477-91a7-0133175a8c89 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:29.974848 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a619af3-45de-4307-be4b-b40b0ee79398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:29.975482 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a619af3-45de-4307-be4b-b40b0ee79398 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:29.975985 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a619af3-45de-4307-be4b-b40b0ee79398 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:29.976431 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a619af3-45de-4307-be4b-b40b0ee79398 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:29.977220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a619af3-45de-4307-be4b-b40b0ee79398 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:29.977528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a619af3-45de-4307-be4b-b40b0ee79398 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:29.978984 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a619af3-45de-4307-be4b-b40b0ee79398 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:29.990906 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 628/1259] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:29.997620 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7dd93-d243-402f-abdc-269eab271e23 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:30.026583 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:30.111987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7dd93-d243-402f-abdc-269eab271e23 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:30.151856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847f43d-e9cf-472a-bd29-3a91d6296d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:30.152686 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847f43d-e9cf-472a-bd29-3a91d6296d72 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:30.152922 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847f43d-e9cf-472a-bd29-3a91d6296d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:30.153421 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847f43d-e9cf-472a-bd29-3a91d6296d72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:30.154392 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847f43d-e9cf-472a-bd29-3a91d6296d72 None admin] RBAC: Adding query filter params (role.id=980cae90acae42189f92fd6dd42867a5, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=38257735924d44488e1407fefb886324) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:30.154708 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847f43d-e9cf-472a-bd29-3a91d6296d72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:30.156486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847f43d-e9cf-472a-bd29-3a91d6296d72 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:30.162556 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 632/1260] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:29 2022] GET /identity/v3/role_assignments?user.id=38257735924d44488e1407fefb886324&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=980cae90acae42189f92fd6dd42867a5 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:32.259030 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cd4e2-e983-447a-aef2-78f35c82abea None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:32.259597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cd4e2-e983-447a-aef2-78f35c82abea None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:32.259597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cd4e2-e983-447a-aef2-78f35c82abea None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:32.260944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 629/1261] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:32.267351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8eee4-bac1-4fa9-9e2f-bc48a0cebe33 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:32.268069 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8eee4-bac1-4fa9-9e2f-bc48a0cebe33 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:32.268208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8eee4-bac1-4fa9-9e2f-bc48a0cebe33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:32.290763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-8ae8eee4-bac1-4fa9-9e2f-bc48a0cebe33 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:32.291924 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-8ae8eee4-bac1-4fa9-9e2f-bc48a0cebe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:32.366057 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 633/1262] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:32.401381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cd4e2-e983-447a-aef2-78f35c82abea None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:32.413847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:32.515705 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cd4e2-e983-447a-aef2-78f35c82abea None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:32.550556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ef376-cfa5-40a1-a0f0-aa7c90303c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:32.551113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ef376-cfa5-40a1-a0f0-aa7c90303c76 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:32.551390 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ef376-cfa5-40a1-a0f0-aa7c90303c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:32.551662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ef376-cfa5-40a1-a0f0-aa7c90303c76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:32.563230 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ef376-cfa5-40a1-a0f0-aa7c90303c76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:32.568082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-774ef376-cfa5-40a1-a0f0-aa7c90303c76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:45:32.568082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:32.568082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:32.568082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:32.568082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:32.568082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:32.568082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:32.568082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:32.568082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:32.568082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:32.568082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:32.568082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:32.568082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:32.568082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:32.568082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:32.568082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:32.569181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:32.569181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:32.569181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:32.569181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:32.569181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:32.569181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:32.569181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:32.569181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:32.569181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:32.569181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:32.569181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:32.569181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:32.569181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:32.569181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:32.569181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:32.569181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:32.570203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:32.570203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:32.570203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:32.570203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:32.570203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:32.570203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:32.570203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:32.570203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:32.570203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:32.570203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:32.570203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:45:32.570203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:45:32.570203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 630/1263] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:45:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:32.577398 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8eee4-bac1-4fa9-9e2f-bc48a0cebe33 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:32.595748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:32.682095 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8eee4-bac1-4fa9-9e2f-bc48a0cebe33 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:32.718577 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1a8fe-c479-4dc8-82dd-96fe27617f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:32.719338 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1a8fe-c479-4dc8-82dd-96fe27617f17 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:32.719668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1a8fe-c479-4dc8-82dd-96fe27617f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:32.719946 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1a8fe-c479-4dc8-82dd-96fe27617f17 None admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:32.720860 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1a8fe-c479-4dc8-82dd-96fe27617f17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:32.721216 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1a8fe-c479-4dc8-82dd-96fe27617f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:32.722887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1a8fe-c479-4dc8-82dd-96fe27617f17 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:32.733994 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 634/1264] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:45:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:32.740458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ef376-cfa5-40a1-a0f0-aa7c90303c76 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:32.830848 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:32.869643 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ef376-cfa5-40a1-a0f0-aa7c90303c76 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:32.905037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f196ff-9d8e-4b6f-95d0-ec512e99fe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:32.905708 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f196ff-9d8e-4b6f-95d0-ec512e99fe11 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:32.905991 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f196ff-9d8e-4b6f-95d0-ec512e99fe11 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:32.906268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f196ff-9d8e-4b6f-95d0-ec512e99fe11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:32.917188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f196ff-9d8e-4b6f-95d0-ec512e99fe11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:32.918642 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f196ff-9d8e-4b6f-95d0-ec512e99fe11 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:32.933285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-d5f196ff-9d8e-4b6f-95d0-ec512e99fe11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:32.933285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:32.933285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:32.933285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:32.933285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:32.933285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:32.933285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:32.933285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:32.933285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:32.933285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:32.933285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:32.933285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:32.933285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:32.933285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:32.933285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:32.934264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:32.934264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:32.934264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:32.934264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:32.934264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:32.934264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:32.934264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:32.934264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:32.934264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:32.934264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:32.934264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:32.934264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:32.934264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:32.934264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:32.934264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:32.934264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:32.934264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:32.935197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:32.935197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:32.935197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:32.935197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:45:32.935197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 631/1265] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:32.943247 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1a8fe-c479-4dc8-82dd-96fe27617f17 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:33.032028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:33.051967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1a8fe-c479-4dc8-82dd-96fe27617f17 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:33.093039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f9adf-89f5-4d6f-82cd-903b1398d75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:33.093608 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f9adf-89f5-4d6f-82cd-903b1398d75d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:33.093884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f9adf-89f5-4d6f-82cd-903b1398d75d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:33.094158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f9adf-89f5-4d6f-82cd-903b1398d75d None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:33.094852 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f9adf-89f5-4d6f-82cd-903b1398d75d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:33.095152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f9adf-89f5-4d6f-82cd-903b1398d75d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:33.096529 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f9adf-89f5-4d6f-82cd-903b1398d75d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:33.108145 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 635/1266] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:33.117213 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f196ff-9d8e-4b6f-95d0-ec512e99fe11 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:33.221615 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f196ff-9d8e-4b6f-95d0-ec512e99fe11 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:33.244028 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:33.261239 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46658f46-5fd0-4444-8cce-819f1c7b1ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:33.261881 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46658f46-5fd0-4444-8cce-819f1c7b1ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:33.262161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46658f46-5fd0-4444-8cce-819f1c7b1ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:33.262434 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46658f46-5fd0-4444-8cce-819f1c7b1ed5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:33.270139 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46658f46-5fd0-4444-8cce-819f1c7b1ed5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:33.271601 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46658f46-5fd0-4444-8cce-819f1c7b1ed5 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:33.283147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-46658f46-5fd0-4444-8cce-819f1c7b1ed5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:45:33.283147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:33.283147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:33.283147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:33.283147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:33.283147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:33.283147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:33.283147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:33.283147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:33.283147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:33.283147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:33.283147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:33.283147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:33.283147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:33.283147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:33.283147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:33.284229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:33.284229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:33.284229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:33.284229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:33.284229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:33.284229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:33.284229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:33.284229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:33.284229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:33.284229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:33.284229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:33.284229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:33.284229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:33.284229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:33.284229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:33.284229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:33.284229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:33.284229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:33.285662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:33.285662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:33.285662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:33.285662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:33.285662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:33.285662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:33.285662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:33.285662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:33.285662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:45:33.285662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:45:33.285662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 632/1267] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:33.292032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f9adf-89f5-4d6f-82cd-903b1398d75d None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:33.407805 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f9adf-89f5-4d6f-82cd-903b1398d75d None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:33.449839 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29151a-f0be-4a3e-8591-86da27aee76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:33.450457 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29151a-f0be-4a3e-8591-86da27aee76d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:33.450734 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29151a-f0be-4a3e-8591-86da27aee76d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:33.451006 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29151a-f0be-4a3e-8591-86da27aee76d None admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:33.451802 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29151a-f0be-4a3e-8591-86da27aee76d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:33.452104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29151a-f0be-4a3e-8591-86da27aee76d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:33.453581 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29151a-f0be-4a3e-8591-86da27aee76d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:33.462678 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:33.472745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 636/1268] 10.222.0.96 () {56 vars in 1143 bytes} [Thu Jul 28 17:45:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:33.479169 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46658f46-5fd0-4444-8cce-819f1c7b1ed5 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:33.600142 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46658f46-5fd0-4444-8cce-819f1c7b1ed5 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:33.637373 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a30cc3-9ab7-4d56-9d74-2e1d95a025af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:33.638004 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a30cc3-9ab7-4d56-9d74-2e1d95a025af None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:33.638279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a30cc3-9ab7-4d56-9d74-2e1d95a025af None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:33.638545 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a30cc3-9ab7-4d56-9d74-2e1d95a025af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:33.649552 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a30cc3-9ab7-4d56-9d74-2e1d95a025af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:33.650994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a30cc3-9ab7-4d56-9d74-2e1d95a025af None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:33.665741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-e9a30cc3-9ab7-4d56-9d74-2e1d95a025af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:33.665741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:33.665741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:33.665741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:33.665741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:33.665741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:33.665741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:33.665741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:33.665741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:33.665741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:33.665741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:33.665741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:33.665741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:33.665741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:33.665741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:33.666766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:33.666766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:33.666766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:33.666766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:33.666766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:33.666766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:33.666766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:33.666766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:33.666766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:33.666766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:33.666766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:33.666766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:33.666766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:33.666766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:33.666766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:33.666766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:33.666766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:33.667983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:33.667983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:33.667983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:33.667983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:45:33.667983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 633/1269] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:33.672841 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29151a-f0be-4a3e-8591-86da27aee76d None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:33.786540 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29151a-f0be-4a3e-8591-86da27aee76d None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:33.829500 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df951f79-ca3b-46bf-b58f-33ce48e04cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:33.830121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df951f79-ca3b-46bf-b58f-33ce48e04cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:33.830399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df951f79-ca3b-46bf-b58f-33ce48e04cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:33.830680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df951f79-ca3b-46bf-b58f-33ce48e04cb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:33.831347 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df951f79-ca3b-46bf-b58f-33ce48e04cb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:33.831650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df951f79-ca3b-46bf-b58f-33ce48e04cb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:33.833194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df951f79-ca3b-46bf-b58f-33ce48e04cb2 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:33.848723 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 637/1270] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:33.857585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a30cc3-9ab7-4d56-9d74-2e1d95a025af None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:33.891874 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:33.977668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a30cc3-9ab7-4d56-9d74-2e1d95a025af None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:34.013362 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3d59a-3c07-44d0-947d-18ae4f5e134c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:34.013991 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3d59a-3c07-44d0-947d-18ae4f5e134c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:34.014270 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3d59a-3c07-44d0-947d-18ae4f5e134c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:34.014544 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3d59a-3c07-44d0-947d-18ae4f5e134c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:34.022255 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3d59a-3c07-44d0-947d-18ae4f5e134c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:34.023881 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3d59a-3c07-44d0-947d-18ae4f5e134c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:34.036208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-93b3d59a-3c07-44d0-947d-18ae4f5e134c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:34.036208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:34.036208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:34.036208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:34.036208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:34.036208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:34.036208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:34.036208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:34.036208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:34.036208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:34.036208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:34.036208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:34.036208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:34.036208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:34.036208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:34.037357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:34.037357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:34.037357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:34.037357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:34.037357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:34.037357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:34.037357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:34.037357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:34.037357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:34.037357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:34.037357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:34.037357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:34.037357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:34.037357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:34.037357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:34.037357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:34.037357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:34.038331 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:34.038331 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:34.038331 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:34.038331 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:34.038331 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:34.038331 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:34.038331 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:34.038331 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:45:34.038331 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 634/1271] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:34.044109 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df951f79-ca3b-46bf-b58f-33ce48e04cb2 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:34.104758 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:34.147740 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df951f79-ca3b-46bf-b58f-33ce48e04cb2 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:34.185027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a6b22-d213-40bf-9713-7718ec3cb825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:34.185681 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a6b22-d213-40bf-9713-7718ec3cb825 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:34.185957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a6b22-d213-40bf-9713-7718ec3cb825 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:34.186231 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a6b22-d213-40bf-9713-7718ec3cb825 None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:34.186984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a6b22-d213-40bf-9713-7718ec3cb825 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:34.187290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a6b22-d213-40bf-9713-7718ec3cb825 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:34.188728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a6b22-d213-40bf-9713-7718ec3cb825 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:34.200886 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 638/1272] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:34.207815 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3d59a-3c07-44d0-947d-18ae4f5e134c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:34.320793 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:34.331423 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3d59a-3c07-44d0-947d-18ae4f5e134c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:34.366957 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd32259-2d3a-49cc-9ade-727e23dd0624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:34.367613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd32259-2d3a-49cc-9ade-727e23dd0624 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:34.367895 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd32259-2d3a-49cc-9ade-727e23dd0624 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:34.368170 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd32259-2d3a-49cc-9ade-727e23dd0624 None admin] PATH_INFO: `/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/38257735924d44488e1407fefb886324/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:34.370387 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd32259-2d3a-49cc-9ade-727e23dd0624 None admin] RBAC: Authorizing `identity:create_grant(project_id=db5ce5e789e949d09c183dbe04e53f19, user_id=38257735924d44488e1407fefb886324, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:34.371831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd32259-2d3a-49cc-9ade-727e23dd0624 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:34.389474 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 635/1273] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Jul 28 17:45:34 2022] PUT /identity/v3/projects/db5ce5e789e949d09c183dbe04e53f19/users/38257735924d44488e1407fefb886324/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:45:36.391374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254daca-19d8-4fa1-b501-312ede94737e None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:36.391999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254daca-19d8-4fa1-b501-312ede94737e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:36.391999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254daca-19d8-4fa1-b501-312ede94737e None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:36.393299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 639/1274] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:36.400662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5671e-1ace-4ae3-a0f1-caa863cc40b2 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:36.401427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5671e-1ace-4ae3-a0f1-caa863cc40b2 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:36.401599 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5671e-1ace-4ae3-a0f1-caa863cc40b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:36.424545 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-6ef5671e-1ace-4ae3-a0f1-caa863cc40b2 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:36.425781 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6ef5671e-1ace-4ae3-a0f1-caa863cc40b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:36.496622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 636/1275] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:36.525721 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254daca-19d8-4fa1-b501-312ede94737e None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:36.648833 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254daca-19d8-4fa1-b501-312ede94737e None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:36.668869 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:36.688801 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b48ce-89ec-4e3a-a831-37d131c473e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:36.689592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b48ce-89ec-4e3a-a831-37d131c473e1 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:36.689970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b48ce-89ec-4e3a-a831-37d131c473e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:36.690344 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b48ce-89ec-4e3a-a831-37d131c473e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:36.701672 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b48ce-89ec-4e3a-a831-37d131c473e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:45:36.706548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-9d3b48ce-89ec-4e3a-a831-37d131c473e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:45:36.706548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:36.706548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:36.706548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:36.706548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:36.706548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:36.706548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:36.706548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:36.706548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:36.706548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:36.706548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:36.706548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:36.706548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:45:36.706548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:45:36.706548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:45:36.706548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:45:36.707744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:45:36.707744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:45:36.707744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:45:36.707744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:45:36.707744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:36.707744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:36.707744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:36.707744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:36.707744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:36.707744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:36.707744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:36.707744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:36.707744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:36.707744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:36.707744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:36.707744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:36.708989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:36.708989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:36.708989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:36.708989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:36.708989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:45:36.708989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:45:36.708989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:45:36.708989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:45:36.708989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:45:36.708989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:45:36.708989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:45:36.708989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:36.708989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 640/1276] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Jul 28 17:45:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:36.718171 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5671e-1ace-4ae3-a0f1-caa863cc40b2 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:36.811919 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:36.831227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5671e-1ace-4ae3-a0f1-caa863cc40b2 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:36.868144 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ffba3-3384-4162-a264-c41c3e3c3009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:36.868753 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ffba3-3384-4162-a264-c41c3e3c3009 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:36.869025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ffba3-3384-4162-a264-c41c3e3c3009 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:36.869334 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ffba3-3384-4162-a264-c41c3e3c3009 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:36.870038 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ffba3-3384-4162-a264-c41c3e3c3009 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:36.870333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ffba3-3384-4162-a264-c41c3e3c3009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:36.871706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ffba3-3384-4162-a264-c41c3e3c3009 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:36.879883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 637/1277] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Jul 28 17:45:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:36.886328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b48ce-89ec-4e3a-a831-37d131c473e1 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:37.007832 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b48ce-89ec-4e3a-a831-37d131c473e1 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:37.050971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f31242-b69f-4bfa-9c1c-debe3c57dec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:37.051604 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f31242-b69f-4bfa-9c1c-debe3c57dec3 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:37.051878 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f31242-b69f-4bfa-9c1c-debe3c57dec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:37.052144 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f31242-b69f-4bfa-9c1c-debe3c57dec3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:37.063125 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f31242-b69f-4bfa-9c1c-debe3c57dec3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:37.064756 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f31242-b69f-4bfa-9c1c-debe3c57dec3 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:37.080372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-37f31242-b69f-4bfa-9c1c-debe3c57dec3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:37.080372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:37.080372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:37.080372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:37.080372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:37.080372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:37.080372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:37.080372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:37.080372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:37.080372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:37.080372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:37.080372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:37.080372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:37.080372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:37.080372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:37.081487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:37.081487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:37.081487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:37.081487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:37.081487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:37.081487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:37.081487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:37.081487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:37.081487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:37.081487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:37.081487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:37.081487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:37.081487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:37.081487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:37.081487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:37.081487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:37.081487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:37.082460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:37.082460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:37.082460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:37.082460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:37.082460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 641/1278] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:37.090114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ffba3-3384-4162-a264-c41c3e3c3009 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:37.211270 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ffba3-3384-4162-a264-c41c3e3c3009 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:37.246790 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b273c-1362-416d-84d2-0f9d18471758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:37.247411 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b273c-1362-416d-84d2-0f9d18471758 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:37.247688 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b273c-1362-416d-84d2-0f9d18471758 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:37.247962 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b273c-1362-416d-84d2-0f9d18471758 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:37.248643 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b273c-1362-416d-84d2-0f9d18471758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:37.248950 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b273c-1362-416d-84d2-0f9d18471758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:37.250384 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b273c-1362-416d-84d2-0f9d18471758 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:37.263022 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 638/1279] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:37.268983 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f31242-b69f-4bfa-9c1c-debe3c57dec3 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:37.304895 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:37.374817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f31242-b69f-4bfa-9c1c-debe3c57dec3 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:37.412834 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238ee3c-4856-442c-b7c1-344e3118d4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:37.413512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238ee3c-4856-442c-b7c1-344e3118d4ee None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:37.413803 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238ee3c-4856-442c-b7c1-344e3118d4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:37.414071 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238ee3c-4856-442c-b7c1-344e3118d4ee None admin] PATH_INFO: `/v3/users/placement` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:37.422113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238ee3c-4856-442c-b7c1-344e3118d4ee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:37.423557 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238ee3c-4856-442c-b7c1-344e3118d4ee None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:37.435243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-9238ee3c-4856-442c-b7c1-344e3118d4ee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:45:37.435243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:37.435243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:37.435243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:37.435243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:37.435243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:37.435243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:37.435243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:37.435243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:37.435243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:37.435243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:37.435243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:37.435243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:45:37.435243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:45:37.435243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:45:37.435243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:45:37.436374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:37.436374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:37.436374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:45:37.436374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:37.436374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:45:37.436374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:45:37.436374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:37.436374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:37.436374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:37.436374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:37.436374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:37.436374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:37.436374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:37.436374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:37.436374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:37.436374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:37.436374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:37.436374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:37.437567 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:37.437567 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:37.437567 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:45:37.437567 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:45:37.437567 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:45:37.437567 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:45:37.437567 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:45:37.437567 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:45:37.437567 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:45:37.437567 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:37.437567 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 642/1280] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:37.445599 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b273c-1362-416d-84d2-0f9d18471758 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:37.451855 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:37.575789 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b273c-1362-416d-84d2-0f9d18471758 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:37.620799 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec55fbe-97cf-4a76-add5-f2f908ac61f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:37.621556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec55fbe-97cf-4a76-add5-f2f908ac61f6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:37.621843 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec55fbe-97cf-4a76-add5-f2f908ac61f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:37.622102 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec55fbe-97cf-4a76-add5-f2f908ac61f6 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:37.622876 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec55fbe-97cf-4a76-add5-f2f908ac61f6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:37.623179 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec55fbe-97cf-4a76-add5-f2f908ac61f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:37.624592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec55fbe-97cf-4a76-add5-f2f908ac61f6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:37.644558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 639/1281] 10.222.0.96 () {56 vars in 1143 bytes} [Thu Jul 28 17:45:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:37.651426 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238ee3c-4856-442c-b7c1-344e3118d4ee None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:37.767346 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:37.777407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238ee3c-4856-442c-b7c1-344e3118d4ee None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:37.813429 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0214f9-a49e-4a3f-bc13-388acdad3e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:37.814051 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0214f9-a49e-4a3f-bc13-388acdad3e70 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:37.814333 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0214f9-a49e-4a3f-bc13-388acdad3e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:37.814602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0214f9-a49e-4a3f-bc13-388acdad3e70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:37.887410 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0214f9-a49e-4a3f-bc13-388acdad3e70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:37.888844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0214f9-a49e-4a3f-bc13-388acdad3e70 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:37.990226 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:38.001629 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 643/1282] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Jul 28 17:45:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:45:38.008570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec55fbe-97cf-4a76-add5-f2f908ac61f6 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:38.085960 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:38.134552 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec55fbe-97cf-4a76-add5-f2f908ac61f6 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:38.172564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc89d7-ff14-43c5-9ddb-e6371c89c512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:38.173161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc89d7-ff14-43c5-9ddb-e6371c89c512 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:38.173441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc89d7-ff14-43c5-9ddb-e6371c89c512 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:38.173714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc89d7-ff14-43c5-9ddb-e6371c89c512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:38.185231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc89d7-ff14-43c5-9ddb-e6371c89c512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:38.186686 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc89d7-ff14-43c5-9ddb-e6371c89c512 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:38.202943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-0edc89d7-ff14-43c5-9ddb-e6371c89c512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:38.202943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:38.202943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:38.202943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:38.202943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:38.202943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:38.202943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:38.202943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:38.202943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:38.202943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:38.202943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:38.202943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:38.202943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:45:38.202943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:45:38.202943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:45:38.204082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:45:38.204082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:38.204082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:38.204082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:38.204082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:38.204082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:38.204082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:38.204082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:38.204082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:38.204082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:38.204082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:38.204082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:38.204082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:38.204082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:38.204082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:38.204082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:38.204082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:38.206035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:45:38.206035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:45:38.206035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:45:38.206035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:45:38.206035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 640/1283] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:38.212751 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0214f9-a49e-4a3f-bc13-388acdad3e70 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:38.328037 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0214f9-a49e-4a3f-bc13-388acdad3e70 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:38.366118 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad1f48-faf1-478f-99b0-95b4f9e787fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:38.366775 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad1f48-faf1-478f-99b0-95b4f9e787fd None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:38.367060 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad1f48-faf1-478f-99b0-95b4f9e787fd None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:38.367332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad1f48-faf1-478f-99b0-95b4f9e787fd None admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:38.368028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad1f48-faf1-478f-99b0-95b4f9e787fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:38.368334 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad1f48-faf1-478f-99b0-95b4f9e787fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:38.369765 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad1f48-faf1-478f-99b0-95b4f9e787fd None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:38.381027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 644/1284] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Jul 28 17:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:38.387378 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc89d7-ff14-43c5-9ddb-e6371c89c512 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:38.497335 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc89d7-ff14-43c5-9ddb-e6371c89c512 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:38.511856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:38.536538 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721231a-c519-44a0-8213-b8fa1321881f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:38.537203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721231a-c519-44a0-8213-b8fa1321881f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:38.537483 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721231a-c519-44a0-8213-b8fa1321881f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:38.537757 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721231a-c519-44a0-8213-b8fa1321881f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:38.545137 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721231a-c519-44a0-8213-b8fa1321881f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:38.546591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721231a-c519-44a0-8213-b8fa1321881f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:38.558302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-2721231a-c519-44a0-8213-b8fa1321881f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:38.558302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:38.558302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:38.558302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:38.558302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:38.558302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:38.558302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:38.558302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:38.558302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:38.558302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:38.558302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:38.558302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:38.558302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:45:38.558302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:45:38.558302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:45:38.559346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:45:38.559346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:38.559346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:38.559346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:38.559346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:38.559346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:38.559346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:38.559346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:38.559346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:38.559346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:38.559346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:38.559346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:38.559346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:38.559346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:38.559346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:38.559346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:38.559346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:38.560650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:45:38.560650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:45:38.560650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:45:38.560650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:45:38.560650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:45:38.560650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:45:38.560650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:45:38.560650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jul 28 17:45:38.560650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 641/1285] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Jul 28 17:45:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:45:38.566275 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad1f48-faf1-478f-99b0-95b4f9e787fd None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:38.630718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:38.684868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad1f48-faf1-478f-99b0-95b4f9e787fd None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:38.722977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a58d5-3dfd-4531-898a-331b4530d73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:38.723631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a58d5-3dfd-4531-898a-331b4530d73c None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:38.723980 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a58d5-3dfd-4531-898a-331b4530d73c None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:38.724233 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a58d5-3dfd-4531-898a-331b4530d73c None admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:38.725248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a58d5-3dfd-4531-898a-331b4530d73c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:38.725671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a58d5-3dfd-4531-898a-331b4530d73c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:38.727637 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a58d5-3dfd-4531-898a-331b4530d73c None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:38.742321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 645/1286] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Jul 28 17:45:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:38.749015 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721231a-c519-44a0-8213-b8fa1321881f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:38.860990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721231a-c519-44a0-8213-b8fa1321881f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:38.898486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8af3a1-4bc3-486f-a1f6-9618916337bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:38.899117 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8af3a1-4bc3-486f-a1f6-9618916337bf None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:38.899377 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8af3a1-4bc3-486f-a1f6-9618916337bf None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:38.899652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8af3a1-4bc3-486f-a1f6-9618916337bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:38.900445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8af3a1-4bc3-486f-a1f6-9618916337bf None admin] RBAC: Adding query filter params (role.id=980cae90acae42189f92fd6dd42867a5, scope.project.id=db5ce5e789e949d09c183dbe04e53f19, user.id=38257735924d44488e1407fefb886324) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:38.900756 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8af3a1-4bc3-486f-a1f6-9618916337bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:38.902264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8af3a1-4bc3-486f-a1f6-9618916337bf None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:38.908162 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 642/1287] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Jul 28 17:45:38 2022] GET /identity/v3/role_assignments?user.id=38257735924d44488e1407fefb886324&scope.project.id=db5ce5e789e949d09c183dbe04e53f19&role.id=980cae90acae42189f92fd6dd42867a5 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:40.952718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438b249-5bbc-42aa-a7d0-58f20c98015c None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:40.953624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438b249-5bbc-42aa-a7d0-58f20c98015c None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:40.953624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438b249-5bbc-42aa-a7d0-58f20c98015c None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:40.955731 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 646/1288] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:45:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:40.962345 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baa5c1-6711-4453-b5d4-28e878f080fe None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:40.963025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baa5c1-6711-4453-b5d4-28e878f080fe None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:40.963201 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baa5c1-6711-4453-b5d4-28e878f080fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:40.987017 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-54baa5c1-6711-4453-b5d4-28e878f080fe None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:40.988220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-54baa5c1-6711-4453-b5d4-28e878f080fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:41.023257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:41.067686 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 643/1289] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:41.090054 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438b249-5bbc-42aa-a7d0-58f20c98015c None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:41.204218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438b249-5bbc-42aa-a7d0-58f20c98015c None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:41.216096 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:41.242285 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ca8c9-446f-47a2-b56e-b89e7e331b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:41.243035 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ca8c9-446f-47a2-b56e-b89e7e331b7a None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:41.243309 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ca8c9-446f-47a2-b56e-b89e7e331b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:41.243579 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ca8c9-446f-47a2-b56e-b89e7e331b7a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:41.244207 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ca8c9-446f-47a2-b56e-b89e7e331b7a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:41.245632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ca8c9-446f-47a2-b56e-b89e7e331b7a None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:41.254942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-eb4ca8c9-446f-47a2-b56e-b89e7e331b7a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:45:41.254942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:41.254942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:41.254942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:41.254942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:41.254942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:41.254942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:41.254942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:41.254942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:45:41.254942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:41.254942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:41.254942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:41.254942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:41.254942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:41.254942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:41.254942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:41.254942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:41.256031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:41.256031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:41.256031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:41.256031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:41.256031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:41.256031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:41.256031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:41.256031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:41.256031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:41.256031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:41.256031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:41.256031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:41.256031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:41.256031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:41.256031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:41.256031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:41.257012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:41.257012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:41.257012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:41.257012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:41.257012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:41.257012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:41.257012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:41.257012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:41.257012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:41.257012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:41.257012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:41.257012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:41.257012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:45:41.257012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:41.257012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 647/1290] 10.222.0.96 () {56 vars in 1117 bytes} [Thu Jul 28 17:45:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:41.265247 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baa5c1-6711-4453-b5d4-28e878f080fe None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:41.371736 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baa5c1-6711-4453-b5d4-28e878f080fe None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:41.409364 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf22dc-fefb-4017-83f6-e0d208ca3b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:41.409972 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf22dc-fefb-4017-83f6-e0d208ca3b6a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:41.410257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf22dc-fefb-4017-83f6-e0d208ca3b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:41.410523 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf22dc-fefb-4017-83f6-e0d208ca3b6a None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:41.411195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf22dc-fefb-4017-83f6-e0d208ca3b6a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:41.411494 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf22dc-fefb-4017-83f6-e0d208ca3b6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:41.412859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf22dc-fefb-4017-83f6-e0d208ca3b6a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:41.417943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 644/1291] 10.222.0.96 () {56 vars in 1116 bytes} [Thu Jul 28 17:45:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:45:41.424097 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ca8c9-446f-47a2-b56e-b89e7e331b7a None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:41.531422 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ca8c9-446f-47a2-b56e-b89e7e331b7a None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:41.570309 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf171c-72c8-49c6-b8a7-d7a359ee02d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:41.571265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf171c-72c8-49c6-b8a7-d7a359ee02d6 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:41.571695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf171c-72c8-49c6-b8a7-d7a359ee02d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:41.572117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf171c-72c8-49c6-b8a7-d7a359ee02d6 None admin] PATH_INFO: `/v3/services` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:41.573286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf171c-72c8-49c6-b8a7-d7a359ee02d6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:41.573839 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf171c-72c8-49c6-b8a7-d7a359ee02d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:41.575537 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf171c-72c8-49c6-b8a7-d7a359ee02d6 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:41.582587 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 648/1292] 10.222.0.96 () {56 vars in 1116 bytes} [Thu Jul 28 17:45:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:43.561164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb412a74-5f6a-4601-8075-b3d8a0d30376 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:43.561725 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb412a74-5f6a-4601-8075-b3d8a0d30376 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:43.561725 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb412a74-5f6a-4601-8075-b3d8a0d30376 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:43.563037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 645/1293] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:43.569454 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542512c-8aa4-4032-9e57-926094219ea3 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:43.570282 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542512c-8aa4-4032-9e57-926094219ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:43.570459 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542512c-8aa4-4032-9e57-926094219ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:43.601445 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-1542512c-8aa4-4032-9e57-926094219ea3 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:43.603132 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1542512c-8aa4-4032-9e57-926094219ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:43.638719 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:43.678482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 649/1294] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:43.710990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb412a74-5f6a-4601-8075-b3d8a0d30376 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:43.747104 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:43.829594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb412a74-5f6a-4601-8075-b3d8a0d30376 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:43.863205 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed11c91-23e9-47a5-9515-ae9e1e0261d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:43.863826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed11c91-23e9-47a5-9515-ae9e1e0261d3 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:43.864105 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed11c91-23e9-47a5-9515-ae9e1e0261d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:43.864380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed11c91-23e9-47a5-9515-ae9e1e0261d3 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:43.865079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed11c91-23e9-47a5-9515-ae9e1e0261d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:43.866578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed11c91-23e9-47a5-9515-ae9e1e0261d3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:43.887687 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 646/1295] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Jul 28 17:45:43 2022] POST /identity/v3/services => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:45:45.912111 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9436c2-9301-4698-aec3-32810ba9bb58 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:45.912761 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9436c2-9301-4698-aec3-32810ba9bb58 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:45.912761 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9436c2-9301-4698-aec3-32810ba9bb58 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:45.914797 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 650/1296] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:45:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:45.923456 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4668ba-01cf-4843-8fb3-153e2cd9e4be None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:45.924171 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4668ba-01cf-4843-8fb3-153e2cd9e4be None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:45.924362 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4668ba-01cf-4843-8fb3-153e2cd9e4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:45.952828 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-2b4668ba-01cf-4843-8fb3-153e2cd9e4be None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:45.954073 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2b4668ba-01cf-4843-8fb3-153e2cd9e4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:46.033595 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 647/1297] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:46.056854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9436c2-9301-4698-aec3-32810ba9bb58 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:46.169330 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9436c2-9301-4698-aec3-32810ba9bb58 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:46.216921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2a5cc-1308-41d7-a868-7275fa12e2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:46.217593 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2a5cc-1308-41d7-a868-7275fa12e2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:46.217874 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2a5cc-1308-41d7-a868-7275fa12e2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:46.218148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2a5cc-1308-41d7-a868-7275fa12e2f3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:46.218782 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2a5cc-1308-41d7-a868-7275fa12e2f3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:46.220190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2a5cc-1308-41d7-a868-7275fa12e2f3 None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:46.229652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-31f2a5cc-1308-41d7-a868-7275fa12e2f3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:45:46.229652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:46.229652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:46.229652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:46.229652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:46.229652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:46.229652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:46.229652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:46.229652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:45:46.229652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:46.229652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:46.229652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:46.229652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:46.229652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:46.229652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:46.229652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:46.229652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:46.230799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:46.230799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:46.230799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:46.230799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:46.230799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:46.230799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:46.230799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:46.230799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:46.230799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:46.230799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:46.230799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:46.230799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:46.230799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:46.230799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:46.230799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:46.230799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:46.231941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:46.231941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:46.231941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:46.231941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:46.231941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:46.231941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:46.231941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:46.231941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:46.231941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:46.231941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:46.231941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:46.231941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:46.231941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:45:46.231941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:46.231941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 651/1298] 10.222.0.96 () {56 vars in 1117 bytes} [Thu Jul 28 17:45:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:46.236999 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4668ba-01cf-4843-8fb3-153e2cd9e4be None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:46.257798 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:46.360962 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4668ba-01cf-4843-8fb3-153e2cd9e4be None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:46.402729 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32687f-b4f2-4a22-b353-527f579886d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:46.403350 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32687f-b4f2-4a22-b353-527f579886d5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:46.403635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32687f-b4f2-4a22-b353-527f579886d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:46.403912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32687f-b4f2-4a22-b353-527f579886d5 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:46.404591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32687f-b4f2-4a22-b353-527f579886d5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:46.404906 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32687f-b4f2-4a22-b353-527f579886d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:46.406358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32687f-b4f2-4a22-b353-527f579886d5 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:46.411854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 648/1299] 10.222.0.96 () {56 vars in 1116 bytes} [Thu Jul 28 17:45:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:46.418887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2a5cc-1308-41d7-a868-7275fa12e2f3 None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:46.462229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:46.547146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2a5cc-1308-41d7-a868-7275fa12e2f3 None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:46.581805 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea33b1-fcb4-4687-8d40-6cb8cd60844e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:46.582430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea33b1-fcb4-4687-8d40-6cb8cd60844e None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:46.582700 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea33b1-fcb4-4687-8d40-6cb8cd60844e None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:46.582965 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea33b1-fcb4-4687-8d40-6cb8cd60844e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:46.583727 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea33b1-fcb4-4687-8d40-6cb8cd60844e None admin] RBAC: Adding query filter params (interface=public, service_id=2d0d1882d1af4d6fb1d5c2c48594229f, region_id=RegionOne) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:46.584039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea33b1-fcb4-4687-8d40-6cb8cd60844e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:46.585466 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea33b1-fcb4-4687-8d40-6cb8cd60844e None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:46.590716 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 652/1300] 10.222.0.96 () {56 vars in 1251 bytes} [Thu Jul 28 17:45:46 2022] GET /identity/v3/endpoints?service_id=2d0d1882d1af4d6fb1d5c2c48594229f&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:46.596934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32687f-b4f2-4a22-b353-527f579886d5 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:46.686754 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:46.706878 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32687f-b4f2-4a22-b353-527f579886d5 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:46.754884 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da7724-4752-4284-8184-c40a4c1366e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:46.755575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da7724-4752-4284-8184-c40a4c1366e5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:46.755984 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da7724-4752-4284-8184-c40a4c1366e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:46.756168 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da7724-4752-4284-8184-c40a4c1366e5 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:46.756916 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da7724-4752-4284-8184-c40a4c1366e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:46.758879 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da7724-4752-4284-8184-c40a4c1366e5 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:46.769373 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 649/1301] 10.222.0.96 () {56 vars in 1087 bytes} [Thu Jul 28 17:45:46 2022] GET /identity/v3/services => generated 2191 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:45:48.840072 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47180b22-d7ac-4832-8a83-50e600cf1de4 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:48.840960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47180b22-d7ac-4832-8a83-50e600cf1de4 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:48.840960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47180b22-d7ac-4832-8a83-50e600cf1de4 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:48.843014 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 653/1302] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:45:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:45:48.851821 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d982c5-3728-4363-bcbf-321001bbb164 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:48.852268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d982c5-3728-4363-bcbf-321001bbb164 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:48.852472 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d982c5-3728-4363-bcbf-321001bbb164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:48.873165 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c8d982c5-3728-4363-bcbf-321001bbb164 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:45:48.874352 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c8d982c5-3728-4363-bcbf-321001bbb164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:45:48.946444 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 650/1303] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:45:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:45:48.982142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47180b22-d7ac-4832-8a83-50e600cf1de4 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:49.090790 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:49.098903 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47180b22-d7ac-4832-8a83-50e600cf1de4 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:49.134802 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681489b-1236-4f4a-9b2a-e1e34b8c984d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:49.135430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681489b-1236-4f4a-9b2a-e1e34b8c984d None admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:49.135704 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681489b-1236-4f4a-9b2a-e1e34b8c984d None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:49.135977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681489b-1236-4f4a-9b2a-e1e34b8c984d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:49.136615 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681489b-1236-4f4a-9b2a-e1e34b8c984d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:49.138006 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681489b-1236-4f4a-9b2a-e1e34b8c984d None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:49.147262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application [None req-9681489b-1236-4f4a-9b2a-e1e34b8c984d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:45:49.147262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:49.147262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:45:49.147262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:45:49.147262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:45:49.147262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:45:49.147262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:45:49.147262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:49.147262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:45:49.147262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:49.147262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:45:49.147262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:49.147262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:45:49.147262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:45:49.147262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:45:49.147262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:45:49.147262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:45:49.148482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:45:49.148482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:45:49.148482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:45:49.148482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:45:49.148482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:45:49.148482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:45:49.148482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:45:49.148482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:45:49.148482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:45:49.148482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:45:49.148482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:45:49.148482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:45:49.148482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:45:49.148482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:45:49.148482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:45:49.148482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:45:49.149688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:45:49.149688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application with Lock( Jul 28 17:45:49.149688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:45:49.149688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:45:49.149688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:45:49.149688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:45:49.149688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:45:49.149688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:45:49.149688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:45:49.149688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:45:49.149688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:45:49.149688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:45:49.149688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:45:49.149688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: ERROR keystone.server.flask.application Jul 28 17:45:49.149688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 654/1304] 10.222.0.96 () {56 vars in 1117 bytes} [Thu Jul 28 17:45:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:45:49.157672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d982c5-3728-4363-bcbf-321001bbb164 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:49.248159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:49.276859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d982c5-3728-4363-bcbf-321001bbb164 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:49.324663 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e971ac-d68a-4008-b52c-1831275bf3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:49.325293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e971ac-d68a-4008-b52c-1831275bf3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:49.325574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e971ac-d68a-4008-b52c-1831275bf3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:49.325845 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e971ac-d68a-4008-b52c-1831275bf3d4 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:49.326517 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e971ac-d68a-4008-b52c-1831275bf3d4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:45:49.326818 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e971ac-d68a-4008-b52c-1831275bf3d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:49.328188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e971ac-d68a-4008-b52c-1831275bf3d4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:49.334009 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 651/1305] 10.222.0.96 () {56 vars in 1116 bytes} [Thu Jul 28 17:45:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:45:49.343748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681489b-1236-4f4a-9b2a-e1e34b8c984d None admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:45:49.455688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681489b-1236-4f4a-9b2a-e1e34b8c984d None admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:45:49.491703 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef38ba-795e-415f-8817-72c88ed3ad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:45:49.492531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef38ba-795e-415f-8817-72c88ed3ad1a None admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:45:49.492815 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef38ba-795e-415f-8817-72c88ed3ad1a None admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:45:49.493098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef38ba-795e-415f-8817-72c88ed3ad1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:45:49.493824 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef38ba-795e-415f-8817-72c88ed3ad1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:45:49.495204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef38ba-795e-415f-8817-72c88ed3ad1a None admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:45:49.520571 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 655/1306] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:45:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:45:59.330618 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=30 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:45:59.513767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:53.350617 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca712ada-a799-4b0a-b362-c2b9c5641357 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:53.351166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca712ada-a799-4b0a-b362-c2b9c5641357 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:53.351166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca712ada-a799-4b0a-b362-c2b9c5641357 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:53.357830 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cd4e8-d20b-4479-b2b0-144b0497c07e None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:53.358310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cd4e8-d20b-4479-b2b0-144b0497c07e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:53.358395 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cd4e8-d20b-4479-b2b0-144b0497c07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:53.361313 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 652/1307] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:46:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:53.436716 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-bb7cd4e8-d20b-4479-b2b0-144b0497c07e None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:53.438046 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-bb7cd4e8-d20b-4479-b2b0-144b0497c07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:53.555312 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 656/1308] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:46:53.603890 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b63bf-12ea-4fd0-a16c-710e49ea21aa None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:53.604095 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b63bf-12ea-4fd0-a16c-710e49ea21aa None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:53.604462 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b63bf-12ea-4fd0-a16c-710e49ea21aa None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:53.606922 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 653/1309] 10.222.0.96 () {54 vars in 965 bytes} [Thu Jul 28 17:46:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:53.618159 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328401f1-d6b0-4ed9-b8ce-cd84bf04fa27 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:53.618636 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328401f1-d6b0-4ed9-b8ce-cd84bf04fa27 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:53.619165 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328401f1-d6b0-4ed9-b8ce-cd84bf04fa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:53.750127 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-328401f1-d6b0-4ed9-b8ce-cd84bf04fa27 None None] MFA Rules not processed for user `76add49d4be940ad846d32fa16431988`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:53.751456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-328401f1-d6b0-4ed9-b8ce-cd84bf04fa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:53.778752 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:53.844016 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 657/1310] 10.222.0.96 () {58 vars in 1062 bytes} [Thu Jul 28 17:46:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:46:53.853184 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b63bf-12ea-4fd0-a16c-710e49ea21aa None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:53.855224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-050b63bf-12ea-4fd0-a16c-710e49ea21aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:53.976453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b63bf-12ea-4fd0-a16c-710e49ea21aa None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:54.063934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b518f49-8c4d-4788-9d0b-8db058dd985d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:54.065266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b518f49-8c4d-4788-9d0b-8db058dd985d service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:54.065553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b518f49-8c4d-4788-9d0b-8db058dd985d service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:54.065828 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b518f49-8c4d-4788-9d0b-8db058dd985d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:54.067486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7b518f49-8c4d-4788-9d0b-8db058dd985d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:54.128365 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:54.196238 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b518f49-8c4d-4788-9d0b-8db058dd985d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:54.197791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b518f49-8c4d-4788-9d0b-8db058dd985d service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:54.218843 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 654/1311] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:46:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:46:56.578123 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82774b74-469f-4158-9144-c6e563767f70 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:56.578704 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82774b74-469f-4158-9144-c6e563767f70 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:56.578704 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82774b74-469f-4158-9144-c6e563767f70 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:56.580523 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 658/1312] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:56.585991 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf09122-ac4f-492e-885c-c4fea3586fa8 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:56.586462 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf09122-ac4f-492e-885c-c4fea3586fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:56.586551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf09122-ac4f-492e-885c-c4fea3586fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:56.671594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-2bf09122-ac4f-492e-885c-c4fea3586fa8 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:56.672816 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2bf09122-ac4f-492e-885c-c4fea3586fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:56.788287 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 655/1313] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:46:56.842177 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dbc56-ab56-48b6-86d9-f0d710df6aef None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:56.842388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dbc56-ab56-48b6-86d9-f0d710df6aef None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:56.842645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dbc56-ab56-48b6-86d9-f0d710df6aef None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:56.844026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 659/1314] 10.222.0.96 () {54 vars in 965 bytes} [Thu Jul 28 17:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:56.851243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62843d9b-e3b1-42b0-b95d-5c64bdb0c997 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:56.851243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62843d9b-e3b1-42b0-b95d-5c64bdb0c997 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:56.851243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62843d9b-e3b1-42b0-b95d-5c64bdb0c997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:56.863379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:56.929098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-62843d9b-e3b1-42b0-b95d-5c64bdb0c997 None None] MFA Rules not processed for user `76add49d4be940ad846d32fa16431988`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:56.930325 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-62843d9b-e3b1-42b0-b95d-5c64bdb0c997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:57.015316 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 656/1315] 10.222.0.96 () {58 vars in 1062 bytes} [Thu Jul 28 17:46:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:46:57.031894 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dbc56-ab56-48b6-86d9-f0d710df6aef None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:57.033593 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f48dbc56-ab56-48b6-86d9-f0d710df6aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:57.147642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dbc56-ab56-48b6-86d9-f0d710df6aef None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:57.228376 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:57.231880 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942cb99-9698-475a-a7b9-7f7f784223a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:57.232513 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942cb99-9698-475a-a7b9-7f7f784223a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:57.232804 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942cb99-9698-475a-a7b9-7f7f784223a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:57.233091 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942cb99-9698-475a-a7b9-7f7f784223a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:57.235665 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-d942cb99-9698-475a-a7b9-7f7f784223a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:57.351110 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942cb99-9698-475a-a7b9-7f7f784223a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:57.352581 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942cb99-9698-475a-a7b9-7f7f784223a1 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:57.372617 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 660/1316] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:46:59.998707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2bb6b-b9e6-4e55-8606-14d0db7ee4bb None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:59.999706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2bb6b-b9e6-4e55-8606-14d0db7ee4bb None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:59.999706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2bb6b-b9e6-4e55-8606-14d0db7ee4bb None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:00.001938 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 657/1317] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:46:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:00.008583 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac621e3a-bca0-49c0-9361-6c1ba1afd0aa None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:00.009337 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac621e3a-bca0-49c0-9361-6c1ba1afd0aa None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:00.009511 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac621e3a-bca0-49c0-9361-6c1ba1afd0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:00.084099 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-ac621e3a-bca0-49c0-9361-6c1ba1afd0aa None None] MFA Rules not processed for user `8f485e8f65e54640b471926b42d2c321`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:00.085378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ac621e3a-bca0-49c0-9361-6c1ba1afd0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:00.155302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:00.202962 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 661/1318] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:00 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:47:00.243018 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2bb6b-b9e6-4e55-8606-14d0db7ee4bb None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:00.244630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f4d2bb6b-b9e6-4e55-8606-14d0db7ee4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:00.381974 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2bb6b-b9e6-4e55-8606-14d0db7ee4bb None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:00.385101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:00.462787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc150e-5308-400f-a802-805756abbb2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:00.463652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc150e-5308-400f-a802-805756abbb2e service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:00.463912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc150e-5308-400f-a802-805756abbb2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:00.464205 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc150e-5308-400f-a802-805756abbb2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:00.465902 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-34fc150e-5308-400f-a802-805756abbb2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:00.605952 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc150e-5308-400f-a802-805756abbb2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:00.607463 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc150e-5308-400f-a802-805756abbb2e service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:00.628172 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 658/1319] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:47:00 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:47:03.233614 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f0b37-ec3b-49c6-88ac-0e5a93257798 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:03.234168 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f0b37-ec3b-49c6-88ac-0e5a93257798 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:03.234168 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f0b37-ec3b-49c6-88ac-0e5a93257798 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:03.235603 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 662/1320] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:03.241007 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50907f-e992-463a-86c0-98f12c1926ec None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:03.241460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50907f-e992-463a-86c0-98f12c1926ec None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:03.241549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50907f-e992-463a-86c0-98f12c1926ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:03.283729 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:03.312658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-cb50907f-e992-463a-86c0-98f12c1926ec None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:03.313924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-cb50907f-e992-463a-86c0-98f12c1926ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:03.418642 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 659/1321] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:47:03.460190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f0b37-ec3b-49c6-88ac-0e5a93257798 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:03.461799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-077f0b37-ec3b-49c6-88ac-0e5a93257798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:03.597097 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f0b37-ec3b-49c6-88ac-0e5a93257798 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:03.673247 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6149f-6651-4407-81c4-68643d507313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:03.673866 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6149f-6651-4407-81c4-68643d507313 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:03.674140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6149f-6651-4407-81c4-68643d507313 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:03.674408 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6149f-6651-4407-81c4-68643d507313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:03.676031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-fcf6149f-6651-4407-81c4-68643d507313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:03.683595 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:03.798017 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6149f-6651-4407-81c4-68643d507313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:03.799486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6149f-6651-4407-81c4-68643d507313 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:03.817613 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 663/1322] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:47:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:47:06.537097 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a97443-7a9d-411b-9067-d2e5851246da None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:06.537662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a97443-7a9d-411b-9067-d2e5851246da None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:06.537662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a97443-7a9d-411b-9067-d2e5851246da None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:06.539008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 660/1323] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:06.547518 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e0108-dcf2-43c0-999f-b7dae8275288 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:06.548028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e0108-dcf2-43c0-999f-b7dae8275288 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:06.548028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e0108-dcf2-43c0-999f-b7dae8275288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:06.624786 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-830e0108-dcf2-43c0-999f-b7dae8275288 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:06.626037 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-830e0108-dcf2-43c0-999f-b7dae8275288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:06.689929 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:06.740421 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 664/1324] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:47:06.781809 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a97443-7a9d-411b-9067-d2e5851246da None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:06.783790 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-63a97443-7a9d-411b-9067-d2e5851246da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:06.925524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a97443-7a9d-411b-9067-d2e5851246da None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:06.939435 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:07.011869 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f37be8-f853-486f-9517-2ae8518c9ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:07.012488 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f37be8-f853-486f-9517-2ae8518c9ccd service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:07.012766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f37be8-f853-486f-9517-2ae8518c9ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:07.013040 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f37be8-f853-486f-9517-2ae8518c9ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:07.014683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-32f37be8-f853-486f-9517-2ae8518c9ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:07.134212 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f37be8-f853-486f-9517-2ae8518c9ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:07.135776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f37be8-f853-486f-9517-2ae8518c9ccd service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:07.154237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 661/1325] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:47:09.225536 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e92fd-76a7-4e78-a4fc-50cad9da44f4 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:09.226182 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e92fd-76a7-4e78-a4fc-50cad9da44f4 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:09.226182 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e92fd-76a7-4e78-a4fc-50cad9da44f4 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:09.227462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 665/1326] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:09.232993 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b67a8-f849-4097-9964-8a3baac1b3d3 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:09.233463 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b67a8-f849-4097-9964-8a3baac1b3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:09.233565 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b67a8-f849-4097-9964-8a3baac1b3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:09.285369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:09.304751 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-247b67a8-f849-4097-9964-8a3baac1b3d3 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:09.306013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-247b67a8-f849-4097-9964-8a3baac1b3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:09.406789 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 662/1327] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:47:09.444182 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e92fd-76a7-4e78-a4fc-50cad9da44f4 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:09.445790 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-736e92fd-76a7-4e78-a4fc-50cad9da44f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:09.556445 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e92fd-76a7-4e78-a4fc-50cad9da44f4 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:09.636239 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64517a9f-dea9-4fb5-b5f9-1f5a7c869b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:09.636872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64517a9f-dea9-4fb5-b5f9-1f5a7c869b4c service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:09.637184 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64517a9f-dea9-4fb5-b5f9-1f5a7c869b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:09.637462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64517a9f-dea9-4fb5-b5f9-1f5a7c869b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:09.639103 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-64517a9f-dea9-4fb5-b5f9-1f5a7c869b4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:09.656875 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:09.761090 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64517a9f-dea9-4fb5-b5f9-1f5a7c869b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:09.762551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64517a9f-dea9-4fb5-b5f9-1f5a7c869b4c service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:09.780942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 666/1328] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:47:11.895422 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed7f8f-989f-4ca3-956b-182fe8f1505b None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:11.895963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed7f8f-989f-4ca3-956b-182fe8f1505b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:11.895963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed7f8f-989f-4ca3-956b-182fe8f1505b None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:11.897338 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 663/1329] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:11.903023 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dabb23-cb13-476e-9856-49cc295b5cb2 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:11.903483 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dabb23-cb13-476e-9856-49cc295b5cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:11.903587 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dabb23-cb13-476e-9856-49cc295b5cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:11.973243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-f1dabb23-cb13-476e-9856-49cc295b5cb2 None None] MFA Rules not processed for user `8f485e8f65e54640b471926b42d2c321`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:11.974484 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f1dabb23-cb13-476e-9856-49cc295b5cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:12.046563 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:12.081912 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 667/1330] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:11 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:47:12.120222 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed7f8f-989f-4ca3-956b-182fe8f1505b None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:12.121782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-13ed7f8f-989f-4ca3-956b-182fe8f1505b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:12.230852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed7f8f-989f-4ca3-956b-182fe8f1505b None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:12.251817 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:12.317496 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab7f8d-05de-468b-a022-82d4b70dfda8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:12.318117 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab7f8d-05de-468b-a022-82d4b70dfda8 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:12.318388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab7f8d-05de-468b-a022-82d4b70dfda8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:12.318653 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab7f8d-05de-468b-a022-82d4b70dfda8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:12.320297 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-46ab7f8d-05de-468b-a022-82d4b70dfda8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:12.440516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab7f8d-05de-468b-a022-82d4b70dfda8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:12.442024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab7f8d-05de-468b-a022-82d4b70dfda8 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:12.461219 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 664/1331] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:47:12 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:47:14.970603 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2c74f-47a6-4b9e-ab41-d6fb57b98946 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:14.971212 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2c74f-47a6-4b9e-ab41-d6fb57b98946 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:14.971212 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2c74f-47a6-4b9e-ab41-d6fb57b98946 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:14.972669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 668/1332] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:14.978697 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad5693-6c74-441e-a2a1-8be386096cbb None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:14.979277 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad5693-6c74-441e-a2a1-8be386096cbb None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:14.979578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad5693-6c74-441e-a2a1-8be386096cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:15.052305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:15.055227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-43ad5693-6c74-441e-a2a1-8be386096cbb None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:15.057245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-43ad5693-6c74-441e-a2a1-8be386096cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:15.162486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 665/1333] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:47:15.199084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2c74f-47a6-4b9e-ab41-d6fb57b98946 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:15.200747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-79c2c74f-47a6-4b9e-ab41-d6fb57b98946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:15.311943 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2c74f-47a6-4b9e-ab41-d6fb57b98946 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:15.406919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482e490-eb41-405c-b8bd-6597a7fcedff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:15.407561 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482e490-eb41-405c-b8bd-6597a7fcedff service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:15.407838 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482e490-eb41-405c-b8bd-6597a7fcedff service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:15.408109 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482e490-eb41-405c-b8bd-6597a7fcedff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:15.409796 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6482e490-eb41-405c-b8bd-6597a7fcedff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:15.438457 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:15.527522 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482e490-eb41-405c-b8bd-6597a7fcedff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:15.529003 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482e490-eb41-405c-b8bd-6597a7fcedff service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:15.548298 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 669/1334] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:47:17.630355 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed08cbf-8409-422f-90f0-2e53591dd935 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:17.631215 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed08cbf-8409-422f-90f0-2e53591dd935 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:17.631215 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed08cbf-8409-422f-90f0-2e53591dd935 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:17.633343 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 666/1335] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:47:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:17.642203 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f9fd6-51a9-4a48-b49c-de9984a22f98 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:17.642924 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f9fd6-51a9-4a48-b49c-de9984a22f98 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:17.643348 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f9fd6-51a9-4a48-b49c-de9984a22f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:17.713553 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-889f9fd6-51a9-4a48-b49c-de9984a22f98 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:17.714757 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-889f9fd6-51a9-4a48-b49c-de9984a22f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:17.809619 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:17.833013 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 670/1336] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:47:17.876455 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed08cbf-8409-422f-90f0-2e53591dd935 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:17.878960 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-eed08cbf-8409-422f-90f0-2e53591dd935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:17.998469 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed08cbf-8409-422f-90f0-2e53591dd935 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:18.032440 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:18.087048 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bb00b-2430-4b7e-a363-4240ca973d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:18.087839 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bb00b-2430-4b7e-a363-4240ca973d14 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:18.088128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bb00b-2430-4b7e-a363-4240ca973d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:18.088390 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bb00b-2430-4b7e-a363-4240ca973d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:18.090085 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6b7bb00b-2430-4b7e-a363-4240ca973d14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:18.219164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bb00b-2430-4b7e-a363-4240ca973d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:18.220614 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bb00b-2430-4b7e-a363-4240ca973d14 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:18.240166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 667/1337] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:47:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:47:20.613876 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a2c44-88d5-4606-9f38-4c1f1de28359 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:20.614466 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a2c44-88d5-4606-9f38-4c1f1de28359 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:20.614466 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a2c44-88d5-4606-9f38-4c1f1de28359 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:20.615734 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 671/1338] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:20.622529 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7525956-6d0a-45a5-9ea6-8fd9c214c4f9 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:20.623298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7525956-6d0a-45a5-9ea6-8fd9c214c4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:20.623433 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7525956-6d0a-45a5-9ea6-8fd9c214c4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:20.702763 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c7525956-6d0a-45a5-9ea6-8fd9c214c4f9 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:20.703983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c7525956-6d0a-45a5-9ea6-8fd9c214c4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:20.713331 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:20.823583 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 668/1339] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:47:20.871883 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a2c44-88d5-4606-9f38-4c1f1de28359 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:20.873480 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-711a2c44-88d5-4606-9f38-4c1f1de28359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:20.992396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a2c44-88d5-4606-9f38-4c1f1de28359 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:21.075603 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5769c86-1bff-4b19-a6bf-d6341b7a7766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:21.076232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5769c86-1bff-4b19-a6bf-d6341b7a7766 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:21.076510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5769c86-1bff-4b19-a6bf-d6341b7a7766 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:21.076784 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5769c86-1bff-4b19-a6bf-d6341b7a7766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:21.078480 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f5769c86-1bff-4b19-a6bf-d6341b7a7766 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:21.119809 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:21.203014 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5769c86-1bff-4b19-a6bf-d6341b7a7766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:21.204444 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5769c86-1bff-4b19-a6bf-d6341b7a7766 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:21.223804 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 672/1340] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:47:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:47:25.300841 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5ce0d-25e7-4091-992c-076b8113540a None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:25.301410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5ce0d-25e7-4091-992c-076b8113540a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:25.301410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5ce0d-25e7-4091-992c-076b8113540a None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:25.302756 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 669/1341] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:25.308195 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19865d3-6e96-4768-8053-36b44367ecb1 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:25.308909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19865d3-6e96-4768-8053-36b44367ecb1 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:25.308909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19865d3-6e96-4768-8053-36b44367ecb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:25.378850 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-b19865d3-6e96-4768-8053-36b44367ecb1 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:25.380078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b19865d3-6e96-4768-8053-36b44367ecb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:25.472618 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:25.487283 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 673/1342] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:47:25.529027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5ce0d-25e7-4091-992c-076b8113540a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:25.530598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1db5ce0d-25e7-4091-992c-076b8113540a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:25.640173 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5ce0d-25e7-4091-992c-076b8113540a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:25.678850 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:25.718383 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ff2f0-c21f-4488-a53f-8e007beff4f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:25.719010 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ff2f0-c21f-4488-a53f-8e007beff4f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:25.719293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ff2f0-c21f-4488-a53f-8e007beff4f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:25.719569 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ff2f0-c21f-4488-a53f-8e007beff4f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:25.721213 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d16ff2f0-c21f-4488-a53f-8e007beff4f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:25.834665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ff2f0-c21f-4488-a53f-8e007beff4f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:25.836100 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ff2f0-c21f-4488-a53f-8e007beff4f5 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:25.854587 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 670/1343] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:47:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:47:28.507839 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f7eb4-dd74-4e8c-8d95-301b4cb84139 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:28.508461 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f7eb4-dd74-4e8c-8d95-301b4cb84139 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:28.509012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f7eb4-dd74-4e8c-8d95-301b4cb84139 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:28.510551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 674/1344] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:47:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:28.516588 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e207a8d-4eec-4270-8d8d-b74e5c81e6a9 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:28.517146 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e207a8d-4eec-4270-8d8d-b74e5c81e6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:28.517146 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e207a8d-4eec-4270-8d8d-b74e5c81e6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:28.591229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7e207a8d-4eec-4270-8d8d-b74e5c81e6a9 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:28.592243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7e207a8d-4eec-4270-8d8d-b74e5c81e6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:28.611124 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:28.694447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 671/1345] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:47:28.731792 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f7eb4-dd74-4e8c-8d95-301b4cb84139 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:28.733533 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-c80f7eb4-dd74-4e8c-8d95-301b4cb84139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:28.848051 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f7eb4-dd74-4e8c-8d95-301b4cb84139 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:28.935196 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea44a8-d481-4e11-bb78-57cf2a454dd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:28.935852 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea44a8-d481-4e11-bb78-57cf2a454dd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:28.936125 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea44a8-d481-4e11-bb78-57cf2a454dd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:28.936391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea44a8-d481-4e11-bb78-57cf2a454dd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:28.938066 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-99ea44a8-d481-4e11-bb78-57cf2a454dd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:28.982623 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:29.051402 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea44a8-d481-4e11-bb78-57cf2a454dd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:29.052828 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea44a8-d481-4e11-bb78-57cf2a454dd8 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:29.071480 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 675/1346] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:47:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:47:33.474639 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076fbfd-10b9-4bb6-8547-fcf7d4a927c5 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:33.475176 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076fbfd-10b9-4bb6-8547-fcf7d4a927c5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:33.475176 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076fbfd-10b9-4bb6-8547-fcf7d4a927c5 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:33.476724 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 672/1347] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:33.483857 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8c42f-070c-45da-a8df-ebee2ac8926f None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:33.484370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8c42f-070c-45da-a8df-ebee2ac8926f None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:33.484370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8c42f-070c-45da-a8df-ebee2ac8926f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:33.554189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-29e8c42f-070c-45da-a8df-ebee2ac8926f None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:33.555406 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-29e8c42f-070c-45da-a8df-ebee2ac8926f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:33.653998 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:33.661220 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 676/1348] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:47:33.695635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076fbfd-10b9-4bb6-8547-fcf7d4a927c5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:33.697249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4076fbfd-10b9-4bb6-8547-fcf7d4a927c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:33.815449 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076fbfd-10b9-4bb6-8547-fcf7d4a927c5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:33.867753 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:33.895961 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166d838-4e23-4ae2-888f-78828d1e88c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:33.896589 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166d838-4e23-4ae2-888f-78828d1e88c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:33.896865 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166d838-4e23-4ae2-888f-78828d1e88c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:33.897166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166d838-4e23-4ae2-888f-78828d1e88c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:33.898790 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b166d838-4e23-4ae2-888f-78828d1e88c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:34.025693 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166d838-4e23-4ae2-888f-78828d1e88c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:34.027313 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166d838-4e23-4ae2-888f-78828d1e88c3 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:34.046808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 673/1349] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:47:38.966783 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b04e0-4011-41d2-a7e0-9b9dec73e841 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:38.967348 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b04e0-4011-41d2-a7e0-9b9dec73e841 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:38.967439 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b04e0-4011-41d2-a7e0-9b9dec73e841 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:38.969162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 677/1350] 10.222.0.96 () {54 vars in 921 bytes} [Thu Jul 28 17:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:38.981457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83901c3c-e582-4bfd-acb3-fbf4ff57922e None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:38.982508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83901c3c-e582-4bfd-acb3-fbf4ff57922e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:38.982508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83901c3c-e582-4bfd-acb3-fbf4ff57922e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:39.124455 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-83901c3c-e582-4bfd-acb3-fbf4ff57922e None None] MFA Rules not processed for user `38257735924d44488e1407fefb886324`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:39.125951 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-83901c3c-e582-4bfd-acb3-fbf4ff57922e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:39.147413 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:39.271552 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 674/1351] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Jul 28 17:47:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:47:43.240426 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84609ecc-955d-4a1f-ae56-f975a25a2f30 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:43.241009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84609ecc-955d-4a1f-ae56-f975a25a2f30 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:43.241009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84609ecc-955d-4a1f-ae56-f975a25a2f30 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:43.242455 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 678/1352] 10.222.0.96 () {54 vars in 921 bytes} [Thu Jul 28 17:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:43.247796 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b3597-a4a4-41dd-8b7a-20227c21fd88 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:43.248210 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b3597-a4a4-41dd-8b7a-20227c21fd88 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:43.248342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b3597-a4a4-41dd-8b7a-20227c21fd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:43.333203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-6f1b3597-a4a4-41dd-8b7a-20227c21fd88 None None] MFA Rules not processed for user `38257735924d44488e1407fefb886324`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:43.334556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6f1b3597-a4a4-41dd-8b7a-20227c21fd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:43.413380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:43.456001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 675/1353] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Jul 28 17:47:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:47:44.836231 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab4173-3259-40b8-b9fa-4ed683ed6170 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:44.836965 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab4173-3259-40b8-b9fa-4ed683ed6170 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:44.836965 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab4173-3259-40b8-b9fa-4ed683ed6170 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:44.838178 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 679/1354] 10.222.0.96 () {54 vars in 921 bytes} [Thu Jul 28 17:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:44.844398 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbe54d-3d6f-414d-8f7f-c07aaa585a7f None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:44.845231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbe54d-3d6f-414d-8f7f-c07aaa585a7f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:44.845560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbe54d-3d6f-414d-8f7f-c07aaa585a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:44.933791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-8dfbe54d-3d6f-414d-8f7f-c07aaa585a7f None None] MFA Rules not processed for user `38257735924d44488e1407fefb886324`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:44.935259 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8dfbe54d-3d6f-414d-8f7f-c07aaa585a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:45.053672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 676/1355] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Jul 28 17:47:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:47:48.521644 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a81572-2b72-4fb9-9b6c-7a6db25db578 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:48.522619 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a81572-2b72-4fb9-9b6c-7a6db25db578 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:48.522954 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a81572-2b72-4fb9-9b6c-7a6db25db578 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:48.525103 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 680/1356] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:47:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:48.529883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdee088-6c29-4547-a8c7-6cddec165ee7 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:48.530702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdee088-6c29-4547-a8c7-6cddec165ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:48.531190 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdee088-6c29-4547-a8c7-6cddec165ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:48.573834 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:48.609923 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-0bdee088-6c29-4547-a8c7-6cddec165ee7 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:48.611433 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0bdee088-6c29-4547-a8c7-6cddec165ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:48.718499 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 677/1357] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:47:48.779650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa273ccc-dc08-4d7e-8c14-e4d6930c8f27 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:48.780231 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa273ccc-dc08-4d7e-8c14-e4d6930c8f27 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:48.780756 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa273ccc-dc08-4d7e-8c14-e4d6930c8f27 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:48.782731 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 681/1358] 10.222.0.96 () {54 vars in 962 bytes} [Thu Jul 28 17:47:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:48.793548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da25d55-12ec-4456-b4d2-7e83c1abcad6 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:48.797524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da25d55-12ec-4456-b4d2-7e83c1abcad6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:48.798036 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da25d55-12ec-4456-b4d2-7e83c1abcad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:48.884524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-9da25d55-12ec-4456-b4d2-7e83c1abcad6 None None] MFA Rules not processed for user `5ac367247aa54671ae5c33d251017470`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:48.885756 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9da25d55-12ec-4456-b4d2-7e83c1abcad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:48.939122 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:49.027806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 678/1359] 10.222.0.96 () {58 vars in 1059 bytes} [Thu Jul 28 17:47:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:47:49.029545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa273ccc-dc08-4d7e-8c14-e4d6930c8f27 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:49.031073 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-fa273ccc-dc08-4d7e-8c14-e4d6930c8f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:49.182717 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa273ccc-dc08-4d7e-8c14-e4d6930c8f27 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:49.265280 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:49.316265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6dc8b-787b-4c4e-8664-7681941c25fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:49.317362 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6dc8b-787b-4c4e-8664-7681941c25fb service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:49.317842 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6dc8b-787b-4c4e-8664-7681941c25fb service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:49.318266 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6dc8b-787b-4c4e-8664-7681941c25fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:49.320049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-beb6dc8b-787b-4c4e-8664-7681941c25fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:49.421714 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6dc8b-787b-4c4e-8664-7681941c25fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:49.423490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6dc8b-787b-4c4e-8664-7681941c25fb service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:49.442453 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 682/1360] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:47:51.676034 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e1490-2fc6-4652-b5e7-07d6b5aeb384 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:51.676577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e1490-2fc6-4652-b5e7-07d6b5aeb384 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:51.676812 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e1490-2fc6-4652-b5e7-07d6b5aeb384 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:51.678373 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 679/1361] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:51.683802 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54305e3f-8748-4fce-9b3a-4729a24177c8 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:51.684290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54305e3f-8748-4fce-9b3a-4729a24177c8 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:51.684290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54305e3f-8748-4fce-9b3a-4729a24177c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:51.756114 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-54305e3f-8748-4fce-9b3a-4729a24177c8 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:51.757374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-54305e3f-8748-4fce-9b3a-4729a24177c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:51.796998 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:51.863844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 683/1362] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:47:51.908755 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e1490-2fc6-4652-b5e7-07d6b5aeb384 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:51.910401 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-aa3e1490-2fc6-4652-b5e7-07d6b5aeb384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:52.090164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e1490-2fc6-4652-b5e7-07d6b5aeb384 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:52.127409 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:52.231950 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95d45d-4751-4652-92b4-23161d8cb2b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:52.232715 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95d45d-4751-4652-92b4-23161d8cb2b7 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:52.233111 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95d45d-4751-4652-92b4-23161d8cb2b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:52.233503 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95d45d-4751-4652-92b4-23161d8cb2b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:52.235236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fc95d45d-4751-4652-92b4-23161d8cb2b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:52.328744 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95d45d-4751-4652-92b4-23161d8cb2b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:52.330559 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95d45d-4751-4652-92b4-23161d8cb2b7 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:52.354039 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 680/1363] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:47:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:47:54.724035 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03005993-9d5a-43f5-a041-7cdf4ef63ea6 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:54.724616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03005993-9d5a-43f5-a041-7cdf4ef63ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:54.724616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03005993-9d5a-43f5-a041-7cdf4ef63ea6 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:54.725957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 684/1364] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:54.735012 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e191b6-dac3-4367-a797-687326427903 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:54.735586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e191b6-dac3-4367-a797-687326427903 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:54.735586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e191b6-dac3-4367-a797-687326427903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:54.752545 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:54.822519 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-06e191b6-dac3-4367-a797-687326427903 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:54.823744 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-06e191b6-dac3-4367-a797-687326427903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:54.929098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 681/1365] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:47:54.974466 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc93d8-be81-40dd-b99f-c2544e92345b None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:54.974636 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc93d8-be81-40dd-b99f-c2544e92345b None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:54.974926 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc93d8-be81-40dd-b99f-c2544e92345b None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:54.976269 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 685/1366] 10.222.0.96 () {54 vars in 962 bytes} [Thu Jul 28 17:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:54.982792 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baf0d1-ec12-424e-a34c-0893d5dff6c9 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:54.983051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baf0d1-ec12-424e-a34c-0893d5dff6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:54.983345 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baf0d1-ec12-424e-a34c-0893d5dff6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:55.071465 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-29baf0d1-ec12-424e-a34c-0893d5dff6c9 None None] MFA Rules not processed for user `5ac367247aa54671ae5c33d251017470`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:55.072841 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-29baf0d1-ec12-424e-a34c-0893d5dff6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:55.109558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:55.198440 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 682/1367] 10.222.0.96 () {58 vars in 1059 bytes} [Thu Jul 28 17:47:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:47:55.207337 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc93d8-be81-40dd-b99f-c2544e92345b None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:55.210172 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-69cc93d8-be81-40dd-b99f-c2544e92345b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:55.373996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc93d8-be81-40dd-b99f-c2544e92345b None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:55.396067 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:55.493330 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdfa08-fc83-49ba-947e-e9cf5dd34a18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:55.493961 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdfa08-fc83-49ba-947e-e9cf5dd34a18 service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:55.494242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdfa08-fc83-49ba-947e-e9cf5dd34a18 service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:55.494515 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdfa08-fc83-49ba-947e-e9cf5dd34a18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:55.496148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6dfdfa08-fc83-49ba-947e-e9cf5dd34a18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:55.594194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdfa08-fc83-49ba-947e-e9cf5dd34a18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:55.595720 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdfa08-fc83-49ba-947e-e9cf5dd34a18 service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:55.615076 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 686/1368] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:47:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:47:56.592556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300ca20-11c9-409b-bae2-65cd6d6d0fc3 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:56.593209 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300ca20-11c9-409b-bae2-65cd6d6d0fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:56.593542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300ca20-11c9-409b-bae2-65cd6d6d0fc3 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:56.595279 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 683/1369] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:47:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:56.600765 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f97f7-3d2f-4a8e-a559-111bfd123272 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:56.601262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f97f7-3d2f-4a8e-a559-111bfd123272 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:56.601371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f97f7-3d2f-4a8e-a559-111bfd123272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:56.637338 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:56.676857 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-628f97f7-3d2f-4a8e-a559-111bfd123272 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:56.678272 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-628f97f7-3d2f-4a8e-a559-111bfd123272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:56.791087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 687/1370] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:47:57.140885 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a08774-2659-4d39-b4c9-15a06460e4d4 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:57.141252 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a08774-2659-4d39-b4c9-15a06460e4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:57.141448 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a08774-2659-4d39-b4c9-15a06460e4d4 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:57.143087 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 684/1371] 10.222.0.96 () {54 vars in 964 bytes} [Thu Jul 28 17:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:57.148310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8729f-ea12-4639-aadb-8eab8f6949d7 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:57.148600 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8729f-ea12-4639-aadb-8eab8f6949d7 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:57.148901 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8729f-ea12-4639-aadb-8eab8f6949d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:57.229435 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-6bf8729f-ea12-4639-aadb-8eab8f6949d7 None None] MFA Rules not processed for user `e6d20d753e37498e8664f983b0988e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:57.230632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6bf8729f-ea12-4639-aadb-8eab8f6949d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:57.280957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:57.313722 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 688/1372] 10.222.0.96 () {58 vars in 1061 bytes} [Thu Jul 28 17:47:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:47:57.321201 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a08774-2659-4d39-b4c9-15a06460e4d4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:57.322694 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c4a08774-2659-4d39-b4c9-15a06460e4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:57.435688 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a08774-2659-4d39-b4c9-15a06460e4d4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:57.477674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:57.514565 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae07252-7809-4901-8328-b4188a22587e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:57.515191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae07252-7809-4901-8328-b4188a22587e service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:57.515470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae07252-7809-4901-8328-b4188a22587e service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:57.515744 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae07252-7809-4901-8328-b4188a22587e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:57.517412 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-dae07252-7809-4901-8328-b4188a22587e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:57.640220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae07252-7809-4901-8328-b4188a22587e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:57.641675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae07252-7809-4901-8328-b4188a22587e service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:57.661464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 685/1373] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:47:57.727836 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c1e04-dfde-4bfb-8241-4668c19c2561 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:57.728336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c1e04-dfde-4bfb-8241-4668c19c2561 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:57.728687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c1e04-dfde-4bfb-8241-4668c19c2561 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:57.731498 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 689/1374] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:47:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:57.737850 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d107960-b5f5-4351-b955-a9d4bb8ec004 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:57.738191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d107960-b5f5-4351-b955-a9d4bb8ec004 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:57.738474 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d107960-b5f5-4351-b955-a9d4bb8ec004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:57.815222 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-5d107960-b5f5-4351-b955-a9d4bb8ec004 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:57.816398 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5d107960-b5f5-4351-b955-a9d4bb8ec004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:57.838555 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:57.926517 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 686/1375] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:47:57.969020 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c1e04-dfde-4bfb-8241-4668c19c2561 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:57.970726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-7e8c1e04-dfde-4bfb-8241-4668c19c2561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:58.126234 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c1e04-dfde-4bfb-8241-4668c19c2561 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:58.178308 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:58.241589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04feef1e-1726-4a4d-93fd-e2622f967f51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:58.242213 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04feef1e-1726-4a4d-93fd-e2622f967f51 service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:58.242488 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04feef1e-1726-4a4d-93fd-e2622f967f51 service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:58.242759 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04feef1e-1726-4a4d-93fd-e2622f967f51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:58.244385 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-04feef1e-1726-4a4d-93fd-e2622f967f51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:58.333578 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04feef1e-1726-4a4d-93fd-e2622f967f51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:58.335202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04feef1e-1726-4a4d-93fd-e2622f967f51 service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:58.353716 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 690/1376] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:48:00.365614 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f028c-344e-45f2-8a09-ca241f6e573a None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:00.366168 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f028c-344e-45f2-8a09-ca241f6e573a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:00.366276 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f028c-344e-45f2-8a09-ca241f6e573a None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:00.367576 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 687/1377] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:00.373711 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c3f16-31a5-4159-8567-9c612dc693d8 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:00.374129 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c3f16-31a5-4159-8567-9c612dc693d8 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:00.374271 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c3f16-31a5-4159-8567-9c612dc693d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:00.445944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-5e6c3f16-31a5-4159-8567-9c612dc693d8 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:00.447181 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-5e6c3f16-31a5-4159-8567-9c612dc693d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:00.454310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:00.560861 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 691/1378] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:00.600926 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f028c-344e-45f2-8a09-ca241f6e573a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:00.602604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-239f028c-344e-45f2-8a09-ca241f6e573a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:00.760581 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f028c-344e-45f2-8a09-ca241f6e573a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:00.764321 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:00.877878 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d541c8-ebb9-42da-976d-86f39426dbd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:00.878518 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d541c8-ebb9-42da-976d-86f39426dbd1 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:00.878795 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d541c8-ebb9-42da-976d-86f39426dbd1 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:00.879070 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d541c8-ebb9-42da-976d-86f39426dbd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:00.881029 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f6d541c8-ebb9-42da-976d-86f39426dbd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:00.984922 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d541c8-ebb9-42da-976d-86f39426dbd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:00.986567 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d541c8-ebb9-42da-976d-86f39426dbd1 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:01.005515 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 688/1379] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:48:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:48:03.103920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223acc85-d6e7-4441-83e1-db0096cabf18 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:03.104477 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223acc85-d6e7-4441-83e1-db0096cabf18 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:03.104477 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223acc85-d6e7-4441-83e1-db0096cabf18 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:03.106059 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 692/1380] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:03.111615 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb5ad4-7694-4a29-bbe3-0c58a846be43 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:03.112091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb5ad4-7694-4a29-bbe3-0c58a846be43 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:03.112188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb5ad4-7694-4a29-bbe3-0c58a846be43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:03.124072 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:03.197924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-1bcb5ad4-7694-4a29-bbe3-0c58a846be43 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:03.199147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1bcb5ad4-7694-4a29-bbe3-0c58a846be43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:03.301997 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 689/1381] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:03.347364 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223acc85-d6e7-4441-83e1-db0096cabf18 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:03.349016 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-223acc85-d6e7-4441-83e1-db0096cabf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:03.501955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:03.514651 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223acc85-d6e7-4441-83e1-db0096cabf18 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:03.632383 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f379e09-d808-4698-94da-c9749533d811 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:03.633210 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f379e09-d808-4698-94da-c9749533d811 service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:03.633474 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f379e09-d808-4698-94da-c9749533d811 service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:03.633755 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f379e09-d808-4698-94da-c9749533d811 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:03.635351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9f379e09-d808-4698-94da-c9749533d811 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:03.729842 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f379e09-d808-4698-94da-c9749533d811 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:03.731560 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f379e09-d808-4698-94da-c9749533d811 service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:03.744452 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:03.753479 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 693/1382] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:48:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:48:05.794586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888ee94-0da4-4938-bc88-b85c3f3c7edb None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:05.795212 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888ee94-0da4-4938-bc88-b85c3f3c7edb None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:05.795881 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888ee94-0da4-4938-bc88-b85c3f3c7edb None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:05.799883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 690/1383] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:48:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:05.805555 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296403f-abf5-44d2-8c3e-0ed9578ec0ab None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:05.806018 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296403f-abf5-44d2-8c3e-0ed9578ec0ab None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:05.806236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296403f-abf5-44d2-8c3e-0ed9578ec0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:05.878625 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-1296403f-abf5-44d2-8c3e-0ed9578ec0ab None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:05.880224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1296403f-abf5-44d2-8c3e-0ed9578ec0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:05.981834 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 694/1384] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:06.048397 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888ee94-0da4-4938-bc88-b85c3f3c7edb None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:06.052033 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5888ee94-0da4-4938-bc88-b85c3f3c7edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:06.183192 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:06.272533 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888ee94-0da4-4938-bc88-b85c3f3c7edb None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:06.451286 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a11441-3225-47e1-b02f-8d2802e6702e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:06.452158 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a11441-3225-47e1-b02f-8d2802e6702e service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:06.452567 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a11441-3225-47e1-b02f-8d2802e6702e service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:06.452936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a11441-3225-47e1-b02f-8d2802e6702e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:06.455163 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-84a11441-3225-47e1-b02f-8d2802e6702e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:06.529893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:06.580435 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a11441-3225-47e1-b02f-8d2802e6702e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:06.582145 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a11441-3225-47e1-b02f-8d2802e6702e service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:06.603621 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 691/1385] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:48:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:48:08.701010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d967869-19de-4125-b5b8-77e6d69dfc7a None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:08.701642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d967869-19de-4125-b5b8-77e6d69dfc7a None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:08.701642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d967869-19de-4125-b5b8-77e6d69dfc7a None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:08.703044 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 695/1386] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:48:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:08.709347 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2cf8e-c8df-46b5-8d70-134d38541d22 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:08.709764 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2cf8e-c8df-46b5-8d70-134d38541d22 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:08.710039 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2cf8e-c8df-46b5-8d70-134d38541d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:08.795558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-09e2cf8e-c8df-46b5-8d70-134d38541d22 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:08.796827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-09e2cf8e-c8df-46b5-8d70-134d38541d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:08.903211 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 692/1387] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:08.950299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d967869-19de-4125-b5b8-77e6d69dfc7a None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:08.952095 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1d967869-19de-4125-b5b8-77e6d69dfc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:09.049252 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:09.128514 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d967869-19de-4125-b5b8-77e6d69dfc7a None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:09.261417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4956a6-29bb-4e5f-b139-aff276563c93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:09.262101 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4956a6-29bb-4e5f-b139-aff276563c93 service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:09.262753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4956a6-29bb-4e5f-b139-aff276563c93 service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:09.263141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4956a6-29bb-4e5f-b139-aff276563c93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:09.265387 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6c4956a6-29bb-4e5f-b139-aff276563c93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:09.312634 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:09.369846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4956a6-29bb-4e5f-b139-aff276563c93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:09.371693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4956a6-29bb-4e5f-b139-aff276563c93 service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:09.391427 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 696/1388] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:48:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:48:11.422465 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7c347-e086-4379-8f4f-3016f38ba18e None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:11.423061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7c347-e086-4379-8f4f-3016f38ba18e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:11.423061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7c347-e086-4379-8f4f-3016f38ba18e None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:11.424369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 693/1389] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:11.432714 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899af49a-1177-4f3d-b73e-71ddd063f98e None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:11.433260 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899af49a-1177-4f3d-b73e-71ddd063f98e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:11.433818 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899af49a-1177-4f3d-b73e-71ddd063f98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:11.505459 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-899af49a-1177-4f3d-b73e-71ddd063f98e None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:11.506639 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-899af49a-1177-4f3d-b73e-71ddd063f98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:11.602683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 697/1390] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:11.647895 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7c347-e086-4379-8f4f-3016f38ba18e None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:11.649445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c6e7c347-e086-4379-8f4f-3016f38ba18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:11.681411 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:11.804319 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7c347-e086-4379-8f4f-3016f38ba18e None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:11.909942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:11.922417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61719706-4885-4809-a48a-7fa4f97c6cf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:11.923042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61719706-4885-4809-a48a-7fa4f97c6cf4 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:11.923320 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61719706-4885-4809-a48a-7fa4f97c6cf4 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:11.923597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61719706-4885-4809-a48a-7fa4f97c6cf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:11.925274 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-61719706-4885-4809-a48a-7fa4f97c6cf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:12.023489 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61719706-4885-4809-a48a-7fa4f97c6cf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:12.025123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61719706-4885-4809-a48a-7fa4f97c6cf4 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:12.044864 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 694/1391] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:48:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:48:12.682883 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b39806-1697-4680-bc03-2331e86ca8a4 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:12.683503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b39806-1697-4680-bc03-2331e86ca8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:12.683503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b39806-1697-4680-bc03-2331e86ca8a4 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:12.685015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 698/1392] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:12.690157 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbed6a3-3d75-41bc-913e-408088e6de70 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:12.690641 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbed6a3-3d75-41bc-913e-408088e6de70 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:12.690741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbed6a3-3d75-41bc-913e-408088e6de70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:12.761317 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-fbbed6a3-3d75-41bc-913e-408088e6de70 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:12.762829 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fbbed6a3-3d75-41bc-913e-408088e6de70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:12.947403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:12.987335 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 695/1393] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:13.046915 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d9362-2a0c-41da-b674-a93d145c5406 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:13.047202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d9362-2a0c-41da-b674-a93d145c5406 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:13.047448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d9362-2a0c-41da-b674-a93d145c5406 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:13.048832 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 699/1394] 10.222.0.96 () {54 vars in 966 bytes} [Thu Jul 28 17:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:13.054117 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5cee9-f091-4813-b875-33da87be7bd4 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:13.054402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5cee9-f091-4813-b875-33da87be7bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:13.054674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5cee9-f091-4813-b875-33da87be7bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:13.134102 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-06e5cee9-f091-4813-b875-33da87be7bd4 None None] MFA Rules not processed for user `98465c2d73e540b5bf506f5a7423e035`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:13.135393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-06e5cee9-f091-4813-b875-33da87be7bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:13.217498 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 696/1395] 10.222.0.96 () {58 vars in 1063 bytes} [Thu Jul 28 17:48:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:13.225011 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d9362-2a0c-41da-b674-a93d145c5406 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:13.226789 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-d04d9362-2a0c-41da-b674-a93d145c5406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:13.240412 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:13.334120 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d9362-2a0c-41da-b674-a93d145c5406 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:13.411195 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13098114-da6b-4e20-b101-c5aa61194785 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98465c2d73e540b5bf506f5a7423e035', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:13.411812 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13098114-da6b-4e20-b101-c5aa61194785 service glance] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:13.412090 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13098114-da6b-4e20-b101-c5aa61194785 service glance] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:13.412375 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13098114-da6b-4e20-b101-c5aa61194785 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:13.414033 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-13098114-da6b-4e20-b101-c5aa61194785 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:13.484747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:13.529094 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13098114-da6b-4e20-b101-c5aa61194785 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:13.530671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13098114-da6b-4e20-b101-c5aa61194785 service glance] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:13.548963 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 700/1396] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:48:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:48:14.086546 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce51081-d716-4840-b0a4-499ff08f814e None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:14.087053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce51081-d716-4840-b0a4-499ff08f814e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:14.087177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce51081-d716-4840-b0a4-499ff08f814e None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:14.088525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 697/1397] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:48:14.094654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b040e1-2d82-417e-8d9b-88e12433b4ff None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:14.095119 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b040e1-2d82-417e-8d9b-88e12433b4ff None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:14.095222 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b040e1-2d82-417e-8d9b-88e12433b4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:14.173758 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-14b040e1-2d82-417e-8d9b-88e12433b4ff None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:14.174949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-14b040e1-2d82-417e-8d9b-88e12433b4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:14.279129 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 701/1398] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:14.295693 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576ed47-e99e-402b-b4f5-4acbbc2eebd9 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:14.295985 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576ed47-e99e-402b-b4f5-4acbbc2eebd9 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:14.296261 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576ed47-e99e-402b-b4f5-4acbbc2eebd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:14.330337 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b040e1-2d82-417e-8d9b-88e12433b4ff None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:14.331646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-14b040e1-2d82-417e-8d9b-88e12433b4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:14.359511 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:14.366876 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-6576ed47-e99e-402b-b4f5-4acbbc2eebd9 None None] MFA Rules not processed for user `a1936a2649c349d481f56304b3ee55b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:14.368101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6576ed47-e99e-402b-b4f5-4acbbc2eebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:14.376920 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:14.448862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b040e1-2d82-417e-8d9b-88e12433b4ff None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:14.455965 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 698/1399] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Jul 28 17:48:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:14.505652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088440d-071b-46a3-be39-0dbc10522eef None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:14.505934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088440d-071b-46a3-be39-0dbc10522eef None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:14.506175 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088440d-071b-46a3-be39-0dbc10522eef None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:14.507557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 699/1400] 10.222.0.96 () {54 vars in 943 bytes} [Thu Jul 28 17:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:48:14.513569 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9123f-495f-4820-9925-f176d133e4ca None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:14.513849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9123f-495f-4820-9925-f176d133e4ca None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:14.514130 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9123f-495f-4820-9925-f176d133e4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:14.570414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598105e7-d1e1-4fea-8415-cb87e3229829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:14.571066 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598105e7-d1e1-4fea-8415-cb87e3229829 service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:14.571337 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598105e7-d1e1-4fea-8415-cb87e3229829 service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:14.571617 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598105e7-d1e1-4fea-8415-cb87e3229829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:14.573346 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-598105e7-d1e1-4fea-8415-cb87e3229829 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:14.591196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-56e9123f-495f-4820-9925-f176d133e4ca None None] MFA Rules not processed for user `4ea1a9023eaf427f96f86af909a803fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:14.591497 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:14.592640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-56e9123f-495f-4820-9925-f176d133e4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:14.669123 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598105e7-d1e1-4fea-8415-cb87e3229829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:14.670977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598105e7-d1e1-4fea-8415-cb87e3229829 service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:14.678384 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:14.691102 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 702/1401] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:48:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:48:14.712643 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 700/1402] 10.222.0.96 () {58 vars in 1040 bytes} [Thu Jul 28 17:48:14 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:48:14.722874 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598105e7-d1e1-4fea-8415-cb87e3229829 service nova] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:14.724419 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-598105e7-d1e1-4fea-8415-cb87e3229829 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:14.820762 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598105e7-d1e1-4fea-8415-cb87e3229829 service nova] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:14.883523 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:14.936926 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194ccf3-760a-4ba0-ac7f-84d861e471a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ea1a9023eaf427f96f86af909a803fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:14.937601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194ccf3-760a-4ba0-ac7f-84d861e471a0 service swift] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:14.937875 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194ccf3-760a-4ba0-ac7f-84d861e471a0 service swift] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:14.938116 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194ccf3-760a-4ba0-ac7f-84d861e471a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:14.939812 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-3194ccf3-760a-4ba0-ac7f-84d861e471a0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:15.027150 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194ccf3-760a-4ba0-ac7f-84d861e471a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:15.029292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194ccf3-760a-4ba0-ac7f-84d861e471a0 service swift] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:15.038137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 703/1403] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Jul 28 17:48:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 17:48:16.764753 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f9f9-1ab3-48b4-8612-3aa3e6b80819 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:16.765436 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f9f9-1ab3-48b4-8612-3aa3e6b80819 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:16.765436 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f9f9-1ab3-48b4-8612-3aa3e6b80819 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:16.766955 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 701/1404] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:16.772774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aa4dc-76f2-496c-9913-cd25eb1cd869 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:16.773312 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aa4dc-76f2-496c-9913-cd25eb1cd869 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:16.773515 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aa4dc-76f2-496c-9913-cd25eb1cd869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:16.844581 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-c18aa4dc-76f2-496c-9913-cd25eb1cd869 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:16.845796 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-c18aa4dc-76f2-496c-9913-cd25eb1cd869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:16.887874 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:16.952796 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 704/1405] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:16.998601 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1f9f9-1ab3-48b4-8612-3aa3e6b80819 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:17.000124 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-91d1f9f9-1ab3-48b4-8612-3aa3e6b80819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:17.175530 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1f9f9-1ab3-48b4-8612-3aa3e6b80819 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:17.239567 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:17.306894 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d94ea1-b468-4b66-a748-1fb7ee031051 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:17.307824 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d94ea1-b468-4b66-a748-1fb7ee031051 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:17.308086 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d94ea1-b468-4b66-a748-1fb7ee031051 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:17.308358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d94ea1-b468-4b66-a748-1fb7ee031051 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:17.310380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-34d94ea1-b468-4b66-a748-1fb7ee031051 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:17.412513 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d94ea1-b468-4b66-a748-1fb7ee031051 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:17.414160 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d94ea1-b468-4b66-a748-1fb7ee031051 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:17.436961 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 702/1406] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:48:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:48:19.500056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23817cee-1430-44fb-85d9-c4c60266d3e0 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:19.500619 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23817cee-1430-44fb-85d9-c4c60266d3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:19.500619 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23817cee-1430-44fb-85d9-c4c60266d3e0 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:19.505419 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 705/1407] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:48:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:19.507599 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa193b-cdd5-4f9e-904f-da8741ffc876 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:19.508010 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa193b-cdd5-4f9e-904f-da8741ffc876 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:19.508111 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa193b-cdd5-4f9e-904f-da8741ffc876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:19.590150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-13fa193b-cdd5-4f9e-904f-da8741ffc876 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:19.591693 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-13fa193b-cdd5-4f9e-904f-da8741ffc876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:19.613706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:19.707076 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 703/1408] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:19.754402 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23817cee-1430-44fb-85d9-c4c60266d3e0 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:19.755953 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-23817cee-1430-44fb-85d9-c4c60266d3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:19.972420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23817cee-1430-44fb-85d9-c4c60266d3e0 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:20.016009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:20.138590 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3372ec-e8ef-4333-a211-f25de9681369 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:20.138590 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3372ec-e8ef-4333-a211-f25de9681369 service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:20.138590 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3372ec-e8ef-4333-a211-f25de9681369 service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:20.138590 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3372ec-e8ef-4333-a211-f25de9681369 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:20.139950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9d3372ec-e8ef-4333-a211-f25de9681369 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:20.235505 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3372ec-e8ef-4333-a211-f25de9681369 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:20.237157 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3372ec-e8ef-4333-a211-f25de9681369 service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:20.256161 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 706/1409] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:48:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:48:29.705113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=35 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:30.254789 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=87 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:37.204665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef2efc-3fe2-4e90-8c51-1063df6a4b39 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.205634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef2efc-3fe2-4e90-8c51-1063df6a4b39 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.205634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef2efc-3fe2-4e90-8c51-1063df6a4b39 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:37.207748 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 704/1410] 10.222.0.96 () {54 vars in 918 bytes} [Thu Jul 28 17:48:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:37.215784 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb73718-f3f4-4ea0-86ad-956ac7cbd39a None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.216437 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb73718-f3f4-4ea0-86ad-956ac7cbd39a None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.216437 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb73718-f3f4-4ea0-86ad-956ac7cbd39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:37.300880 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-dfb73718-f3f4-4ea0-86ad-956ac7cbd39a None None] MFA Rules not processed for user `38257735924d44488e1407fefb886324`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:37.302422 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-dfb73718-f3f4-4ea0-86ad-956ac7cbd39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:37.427650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 707/1411] 10.222.0.96 () {58 vars in 1015 bytes} [Thu Jul 28 17:48:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:37.448330 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca1bc-57c3-4de0-8c88-6ca2dc12e9a2 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.448728 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca1bc-57c3-4de0-8c88-6ca2dc12e9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.449174 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca1bc-57c3-4de0-8c88-6ca2dc12e9a2 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:37.450969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 705/1412] 10.222.0.96 () {54 vars in 918 bytes} [Thu Jul 28 17:48:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:37.456696 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11892885-6786-481a-be95-208b9223ae24 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.456985 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11892885-6786-481a-be95-208b9223ae24 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.457309 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11892885-6786-481a-be95-208b9223ae24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:37.541086 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:37.544589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-11892885-6786-481a-be95-208b9223ae24 None None] MFA Rules not processed for user `5ac367247aa54671ae5c33d251017470`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:37.546685 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-11892885-6786-481a-be95-208b9223ae24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:37.673025 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 708/1413] 10.222.0.96 () {58 vars in 1015 bytes} [Thu Jul 28 17:48:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:40.221836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7098e-4f49-41f4-8289-8a41ad518393 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:40.222723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7098e-4f49-41f4-8289-8a41ad518393 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:40.222723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7098e-4f49-41f4-8289-8a41ad518393 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:40.224844 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:48:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:40.233789 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164efebe-ad45-4b9a-8691-93367d52a4b3 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:40.234238 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164efebe-ad45-4b9a-8691-93367d52a4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:40.234342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164efebe-ad45-4b9a-8691-93367d52a4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:40.317108 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-164efebe-ad45-4b9a-8691-93367d52a4b3 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:40.318395 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-164efebe-ad45-4b9a-8691-93367d52a4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:40.377842 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:40.424795 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:40.467870 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7098e-4f49-41f4-8289-8a41ad518393 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:40.469446 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-27c7098e-4f49-41f4-8289-8a41ad518393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:40.629656 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7098e-4f49-41f4-8289-8a41ad518393 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:40.714010 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:40.758395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838af63-db40-4c74-89a5-d57da22969f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:40.759273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838af63-db40-4c74-89a5-d57da22969f0 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:40.759594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838af63-db40-4c74-89a5-d57da22969f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:40.759960 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838af63-db40-4c74-89a5-d57da22969f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:40.762833 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2838af63-db40-4c74-89a5-d57da22969f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:40.868467 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838af63-db40-4c74-89a5-d57da22969f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:40.870099 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838af63-db40-4c74-89a5-d57da22969f0 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:40.890149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 707/1416] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:48:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:48:41.795360 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455f4f7-d0ac-44ac-921c-510ffb8995c4 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:41.795971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455f4f7-d0ac-44ac-921c-510ffb8995c4 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:41.795971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455f4f7-d0ac-44ac-921c-510ffb8995c4 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:41.797285 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 17:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:41.803367 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d3aac-ae7e-44ea-9c33-a66229bd5376 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:41.803982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d3aac-ae7e-44ea-9c33-a66229bd5376 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:41.804140 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d3aac-ae7e-44ea-9c33-a66229bd5376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:41.894798 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-cd4d3aac-ae7e-44ea-9c33-a66229bd5376 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:41.896007 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-cd4d3aac-ae7e-44ea-9c33-a66229bd5376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:41.926965 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:42.010300 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 17:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:42.160310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455f4f7-d0ac-44ac-921c-510ffb8995c4 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:42.161856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6455f4f7-d0ac-44ac-921c-510ffb8995c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:42.331907 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455f4f7-d0ac-44ac-921c-510ffb8995c4 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:42.374533 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:42.452399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7e427-1a64-41a2-a98f-2a2c11c1f8fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:42.452924 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7e427-1a64-41a2-a98f-2a2c11c1f8fd service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:42.453224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7e427-1a64-41a2-a98f-2a2c11c1f8fd service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:42.453492 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7e427-1a64-41a2-a98f-2a2c11c1f8fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:42.455101 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-35d7e427-1a64-41a2-a98f-2a2c11c1f8fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:42.561836 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7e427-1a64-41a2-a98f-2a2c11c1f8fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:42.563474 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7e427-1a64-41a2-a98f-2a2c11c1f8fd service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:42.583069 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 711/1419] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:48:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:48:43.472009 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a2256-dc76-47b1-a79e-41e2ba125af2 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:43.472904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a2256-dc76-47b1-a79e-41e2ba125af2 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:43.472904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a2256-dc76-47b1-a79e-41e2ba125af2 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:43.475103 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 17:48:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:43.481009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff54b5-02bc-4146-b6e3-788b89704bb5 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:43.481583 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff54b5-02bc-4146-b6e3-788b89704bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:43.481676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff54b5-02bc-4146-b6e3-788b89704bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:43.538003 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:43.569981 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-38ff54b5-02bc-4146-b6e3-788b89704bb5 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:43.571216 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-38ff54b5-02bc-4146-b6e3-788b89704bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:43.678269 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 17:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:43.838780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a2256-dc76-47b1-a79e-41e2ba125af2 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:43.841463 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-473a2256-dc76-47b1-a79e-41e2ba125af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:43.997366 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a2256-dc76-47b1-a79e-41e2ba125af2 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:44.011058 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:44.120034 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e36c4-45ca-4b01-ad48-252c2ba16926 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:44.120663 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e36c4-45ca-4b01-ad48-252c2ba16926 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:44.121119 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e36c4-45ca-4b01-ad48-252c2ba16926 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:44.121420 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e36c4-45ca-4b01-ad48-252c2ba16926 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:44.123475 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6c6e36c4-45ca-4b01-ad48-252c2ba16926 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:44.215123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e36c4-45ca-4b01-ad48-252c2ba16926 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:44.216969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e36c4-45ca-4b01-ad48-252c2ba16926 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:44.240761 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 710/1422] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:48:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:48:45.113415 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef437b22-5c43-4511-83a7-e1aaac36f171 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:45.114265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef437b22-5c43-4511-83a7-e1aaac36f171 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:45.114265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef437b22-5c43-4511-83a7-e1aaac36f171 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:45.116519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 17:48:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:45.122470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab2263-90ef-4e9f-ac75-2a7f60865e8b None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:45.122924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab2263-90ef-4e9f-ac75-2a7f60865e8b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:45.123040 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab2263-90ef-4e9f-ac75-2a7f60865e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:45.144065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:45.204864 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b0ab2263-90ef-4e9f-ac75-2a7f60865e8b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:45.206105 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b0ab2263-90ef-4e9f-ac75-2a7f60865e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:45.321404 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 17:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:45.477304 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef437b22-5c43-4511-83a7-e1aaac36f171 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:45.479864 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ef437b22-5c43-4511-83a7-e1aaac36f171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:45.596101 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:45.635046 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef437b22-5c43-4511-83a7-e1aaac36f171 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:45.761461 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47be5ed-8526-4d4d-b268-b7d3e13fcf36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:45.762546 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47be5ed-8526-4d4d-b268-b7d3e13fcf36 service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:45.763033 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47be5ed-8526-4d4d-b268-b7d3e13fcf36 service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:45.763405 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47be5ed-8526-4d4d-b268-b7d3e13fcf36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:45.765104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-a47be5ed-8526-4d4d-b268-b7d3e13fcf36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:45.846789 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:45.861412 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47be5ed-8526-4d4d-b268-b7d3e13fcf36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:45.863034 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47be5ed-8526-4d4d-b268-b7d3e13fcf36 service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:45.881863 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 714/1425] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:48:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:48:46.756427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373e794-1e08-4748-a26e-059d794d7114 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:46.757021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373e794-1e08-4748-a26e-059d794d7114 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:46.757021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373e794-1e08-4748-a26e-059d794d7114 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:46.759075 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 17:48:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:46.767575 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48ae68-c914-4f6b-afd2-1dc5b1218b31 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:46.767992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48ae68-c914-4f6b-afd2-1dc5b1218b31 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:46.768133 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48ae68-c914-4f6b-afd2-1dc5b1218b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:46.866053 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-db48ae68-c914-4f6b-afd2-1dc5b1218b31 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:46.867275 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-db48ae68-c914-4f6b-afd2-1dc5b1218b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:46.966326 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 17:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:47.120200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373e794-1e08-4748-a26e-059d794d7114 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:47.121912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6373e794-1e08-4748-a26e-059d794d7114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:47.214416 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:47.283710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373e794-1e08-4748-a26e-059d794d7114 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:47.408642 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebcf8b-9460-4d26-9562-a1378859d083 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:47.409298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebcf8b-9460-4d26-9562-a1378859d083 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:47.409575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebcf8b-9460-4d26-9562-a1378859d083 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:47.409854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebcf8b-9460-4d26-9562-a1378859d083 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:47.411487 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-bfebcf8b-9460-4d26-9562-a1378859d083 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:47.467948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:47.523179 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebcf8b-9460-4d26-9562-a1378859d083 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:47.524827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebcf8b-9460-4d26-9562-a1378859d083 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:47.544138 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 713/1428] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:48:48.385501 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a521201-c9e1-4a4c-b0b3-976ffc1f4912 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:48.386103 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a521201-c9e1-4a4c-b0b3-976ffc1f4912 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:48.386103 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a521201-c9e1-4a4c-b0b3-976ffc1f4912 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:48.387470 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 17:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:48.393614 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffa937-a670-4cda-9e69-946c4bb760d0 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:48.394353 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffa937-a670-4cda-9e69-946c4bb760d0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:48.394470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffa937-a670-4cda-9e69-946c4bb760d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:48.488018 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f0ffa937-a670-4cda-9e69-946c4bb760d0 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:48.489305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f0ffa937-a670-4cda-9e69-946c4bb760d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:48.599535 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 17:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:48.754089 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a521201-c9e1-4a4c-b0b3-976ffc1f4912 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:48.756437 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-7a521201-c9e1-4a4c-b0b3-976ffc1f4912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:48.815978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:48.919061 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a521201-c9e1-4a4c-b0b3-976ffc1f4912 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:49.037117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d1364-6c06-450a-81f1-e6ad94febc16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:49.037763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d1364-6c06-450a-81f1-e6ad94febc16 service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:49.038034 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d1364-6c06-450a-81f1-e6ad94febc16 service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:49.038302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d1364-6c06-450a-81f1-e6ad94febc16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:49.039955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9b3d1364-6c06-450a-81f1-e6ad94febc16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:49.046901 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:49.137944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d1364-6c06-450a-81f1-e6ad94febc16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:49.139533 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d1364-6c06-450a-81f1-e6ad94febc16 service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:49.157835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 717/1431] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:48:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:48:49.985295 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b85bd3-5c6a-4140-8f8d-507da4567b94 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:49.985901 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b85bd3-5c6a-4140-8f8d-507da4567b94 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:49.985901 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b85bd3-5c6a-4140-8f8d-507da4567b94 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:49.988181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 17:48:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:49.996867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795f595-c4ab-4878-be6a-a8e9c1900c76 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:49.997561 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795f595-c4ab-4878-be6a-a8e9c1900c76 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:49.997561 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795f595-c4ab-4878-be6a-a8e9c1900c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:50.085538 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-8795f595-c4ab-4878-be6a-a8e9c1900c76 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:50.086750 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-8795f595-c4ab-4878-be6a-a8e9c1900c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:50.158913 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:50.192320 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 17:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:50.344921 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b85bd3-5c6a-4140-8f8d-507da4567b94 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:50.346391 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-28b85bd3-5c6a-4140-8f8d-507da4567b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:50.367112 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:50.508989 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b85bd3-5c6a-4140-8f8d-507da4567b94 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:50.609946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:50.641194 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990b8ef-f773-4f0d-89c6-e762141e42d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:50.641834 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990b8ef-f773-4f0d-89c6-e762141e42d1 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:50.642106 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990b8ef-f773-4f0d-89c6-e762141e42d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:50.642377 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990b8ef-f773-4f0d-89c6-e762141e42d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:50.643997 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7990b8ef-f773-4f0d-89c6-e762141e42d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:50.739930 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990b8ef-f773-4f0d-89c6-e762141e42d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:50.741593 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990b8ef-f773-4f0d-89c6-e762141e42d1 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:50.761676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 716/1434] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:48:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:48:51.585421 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029a5d6-5db3-45f4-9f59-0ffd6503ae9f None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:51.586416 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029a5d6-5db3-45f4-9f59-0ffd6503ae9f None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:51.586416 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029a5d6-5db3-45f4-9f59-0ffd6503ae9f None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:51.588481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 17:48:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:51.594402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef31efd-9698-40bb-a913-91d277767f5e None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:51.595558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef31efd-9698-40bb-a913-91d277767f5e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:51.596053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef31efd-9698-40bb-a913-91d277767f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:51.684704 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-aef31efd-9698-40bb-a913-91d277767f5e None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:51.686013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-aef31efd-9698-40bb-a913-91d277767f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:51.730302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:51.789319 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 17:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:51.946086 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029a5d6-5db3-45f4-9f59-0ffd6503ae9f None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:51.948713 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-a029a5d6-5db3-45f4-9f59-0ffd6503ae9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:52.125474 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029a5d6-5db3-45f4-9f59-0ffd6503ae9f None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:52.182586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:52.241326 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e7c97-5c60-48f6-bfcb-b5a60c2ff96f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:52.241950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e7c97-5c60-48f6-bfcb-b5a60c2ff96f service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:52.242225 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e7c97-5c60-48f6-bfcb-b5a60c2ff96f service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:52.242502 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e7c97-5c60-48f6-bfcb-b5a60c2ff96f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:52.244197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-aa0e7c97-5c60-48f6-bfcb-b5a60c2ff96f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:52.345535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e7c97-5c60-48f6-bfcb-b5a60c2ff96f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:52.347175 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e7c97-5c60-48f6-bfcb-b5a60c2ff96f service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:52.367687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 720/1437] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:48:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:48:53.182282 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe5b70-0060-42e1-b606-8ede64a2d3f1 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:53.182778 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe5b70-0060-42e1-b606-8ede64a2d3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:53.182778 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe5b70-0060-42e1-b606-8ede64a2d3f1 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:53.184228 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 17:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:53.190412 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2887a-042c-4ff3-bf3c-461d05d530e2 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:53.191147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2887a-042c-4ff3-bf3c-461d05d530e2 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:53.191395 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2887a-042c-4ff3-bf3c-461d05d530e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:53.403736 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-07e2887a-042c-4ff3-bf3c-461d05d530e2 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:53.404989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-07e2887a-042c-4ff3-bf3c-461d05d530e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:53.407182 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:53.506973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 17:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:53.665496 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe5b70-0060-42e1-b606-8ede64a2d3f1 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:53.666963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c1fe5b70-0060-42e1-b606-8ede64a2d3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:53.836721 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe5b70-0060-42e1-b606-8ede64a2d3f1 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:53.864895 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:53.983354 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d5cbd-6329-4846-b23d-608867640206 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:53.983892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d5cbd-6329-4846-b23d-608867640206 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:53.984176 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d5cbd-6329-4846-b23d-608867640206 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:53.984445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d5cbd-6329-4846-b23d-608867640206 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:53.986194 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-de3d5cbd-6329-4846-b23d-608867640206 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:54.101987 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d5cbd-6329-4846-b23d-608867640206 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:54.105805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d5cbd-6329-4846-b23d-608867640206 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:54.127782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 719/1440] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:48:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:48:56.057632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8304a3-a3f0-42bc-8d7c-2c52349e8d88 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:56.058176 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8304a3-a3f0-42bc-8d7c-2c52349e8d88 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:56.058176 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8304a3-a3f0-42bc-8d7c-2c52349e8d88 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:56.059587 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:56.065185 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182c898-41c1-44c3-b725-49f369f79cab None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:56.065621 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182c898-41c1-44c3-b725-49f369f79cab None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:56.065735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182c898-41c1-44c3-b725-49f369f79cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:56.108362 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:56.137477 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f182c898-41c1-44c3-b725-49f369f79cab None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:56.138723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f182c898-41c1-44c3-b725-49f369f79cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:56.261725 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:56.304528 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8304a3-a3f0-42bc-8d7c-2c52349e8d88 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:56.306104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9d8304a3-a3f0-42bc-8d7c-2c52349e8d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:56.426637 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8304a3-a3f0-42bc-8d7c-2c52349e8d88 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:56.467829 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:56.513683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928ed66-9996-41e4-8abc-9075ed16e319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:56.514300 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928ed66-9996-41e4-8abc-9075ed16e319 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:56.514572 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928ed66-9996-41e4-8abc-9075ed16e319 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:56.514842 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928ed66-9996-41e4-8abc-9075ed16e319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:56.516468 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-c928ed66-9996-41e4-8abc-9075ed16e319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:56.627066 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928ed66-9996-41e4-8abc-9075ed16e319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:56.628520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928ed66-9996-41e4-8abc-9075ed16e319 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:56.646966 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 723/1443] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:48:58.815149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9fb79-0cfe-4fc5-9dd4-d7fcc858a9e4 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:58.816116 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9fb79-0cfe-4fc5-9dd4-d7fcc858a9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:58.816116 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9fb79-0cfe-4fc5-9dd4-d7fcc858a9e4 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:58.818280 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:48:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:58.824537 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8f1df-b26d-47b2-83b6-df122d6c0cfa None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:58.825052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8f1df-b26d-47b2-83b6-df122d6c0cfa None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:58.825252 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8f1df-b26d-47b2-83b6-df122d6c0cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:58.897457 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-c0b8f1df-b26d-47b2-83b6-df122d6c0cfa None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:58.898671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-c0b8f1df-b26d-47b2-83b6-df122d6c0cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:58.912241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:59.002169 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:48:59.041432 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9fb79-0cfe-4fc5-9dd4-d7fcc858a9e4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:59.042978 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-44a9fb79-0cfe-4fc5-9dd4-d7fcc858a9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:59.156514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9fb79-0cfe-4fc5-9dd4-d7fcc858a9e4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:59.169487 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:59.236083 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a1d15-7822-4174-b5d0-1018da8fbc85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:59.236698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a1d15-7822-4174-b5d0-1018da8fbc85 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:59.236974 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a1d15-7822-4174-b5d0-1018da8fbc85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:59.237289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a1d15-7822-4174-b5d0-1018da8fbc85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:59.238927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-975a1d15-7822-4174-b5d0-1018da8fbc85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:59.357479 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a1d15-7822-4174-b5d0-1018da8fbc85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:59.358915 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a1d15-7822-4174-b5d0-1018da8fbc85 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:59.378221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 722/1446] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:48:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:49:01.716959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720749cb-70fc-4d50-9c2e-8f8b9d6cfffd None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:01.717560 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720749cb-70fc-4d50-9c2e-8f8b9d6cfffd None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:01.717560 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720749cb-70fc-4d50-9c2e-8f8b9d6cfffd None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:01.718875 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:01.728015 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5990a-a6e4-47c1-ad80-5406f3a8dc11 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:01.728715 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5990a-a6e4-47c1-ad80-5406f3a8dc11 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:01.728944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5990a-a6e4-47c1-ad80-5406f3a8dc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:01.787522 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:01.814370 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b3b5990a-a6e4-47c1-ad80-5406f3a8dc11 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:01.815618 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b3b5990a-a6e4-47c1-ad80-5406f3a8dc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:01.923170 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:49:01.973036 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720749cb-70fc-4d50-9c2e-8f8b9d6cfffd None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:01.975313 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-720749cb-70fc-4d50-9c2e-8f8b9d6cfffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:02.100117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720749cb-70fc-4d50-9c2e-8f8b9d6cfffd None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:02.143202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:02.185002 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf9632-d782-4a5c-8a84-4a067c9ed883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:02.185655 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf9632-d782-4a5c-8a84-4a067c9ed883 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:02.185936 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf9632-d782-4a5c-8a84-4a067c9ed883 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:02.186215 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf9632-d782-4a5c-8a84-4a067c9ed883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:02.187848 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-4eaf9632-d782-4a5c-8a84-4a067c9ed883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:02.315699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf9632-d782-4a5c-8a84-4a067c9ed883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:02.317096 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf9632-d782-4a5c-8a84-4a067c9ed883 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:02.335185 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 726/1449] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:49:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:49:04.499931 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ee9c4-6564-40aa-b78f-4af493641bdb None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:04.500800 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ee9c4-6564-40aa-b78f-4af493641bdb None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:04.500800 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ee9c4-6564-40aa-b78f-4af493641bdb None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:04.503008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:49:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:04.512602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955133c-5c14-4b8e-ba95-e1aecbc5177d None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:04.513106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955133c-5c14-4b8e-ba95-e1aecbc5177d None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:04.513256 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955133c-5c14-4b8e-ba95-e1aecbc5177d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:04.585493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-3955133c-5c14-4b8e-ba95-e1aecbc5177d None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:04.587495 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-3955133c-5c14-4b8e-ba95-e1aecbc5177d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:04.622602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:04.703958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:49:04.743345 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ee9c4-6564-40aa-b78f-4af493641bdb None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:04.744959 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-dd6ee9c4-6564-40aa-b78f-4af493641bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:04.850538 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ee9c4-6564-40aa-b78f-4af493641bdb None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:04.880366 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:04.936769 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04298f6a-c649-4bdb-a1a0-3fd329e33f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:04.937424 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04298f6a-c649-4bdb-a1a0-3fd329e33f87 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:04.937699 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04298f6a-c649-4bdb-a1a0-3fd329e33f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:04.937970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04298f6a-c649-4bdb-a1a0-3fd329e33f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:04.939583 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-04298f6a-c649-4bdb-a1a0-3fd329e33f87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:05.057786 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04298f6a-c649-4bdb-a1a0-3fd329e33f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:05.059247 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04298f6a-c649-4bdb-a1a0-3fd329e33f87 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:05.077930 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 725/1452] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:49:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:49:07.122930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366b0e0-b0b8-4f40-9850-8aa4f076e167 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:07.123790 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366b0e0-b0b8-4f40-9850-8aa4f076e167 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:07.123790 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366b0e0-b0b8-4f40-9850-8aa4f076e167 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:07.126147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:49:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:07.132934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a1d4-2455-4988-ac63-0f869aa0be6d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:07.133399 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a1d4-2455-4988-ac63-0f869aa0be6d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:07.133519 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a1d4-2455-4988-ac63-0f869aa0be6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:07.206413 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:07.209610 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-9543a1d4-2455-4988-ac63-0f869aa0be6d None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:07.211622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9543a1d4-2455-4988-ac63-0f869aa0be6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:07.323196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:49:07.361514 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366b0e0-b0b8-4f40-9850-8aa4f076e167 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:07.363892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-a366b0e0-b0b8-4f40-9850-8aa4f076e167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:07.485255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366b0e0-b0b8-4f40-9850-8aa4f076e167 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:07.546811 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:07.574741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80483b-324a-45b0-9dc8-d6df4911c782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:07.575417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80483b-324a-45b0-9dc8-d6df4911c782 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:07.575695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80483b-324a-45b0-9dc8-d6df4911c782 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:07.575960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80483b-324a-45b0-9dc8-d6df4911c782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:07.577636 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ac80483b-324a-45b0-9dc8-d6df4911c782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:07.700929 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80483b-324a-45b0-9dc8-d6df4911c782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:07.702406 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80483b-324a-45b0-9dc8-d6df4911c782 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:07.722468 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 729/1455] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:49:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:49:09.866170 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfd269-19ce-4536-868f-c9149a15b479 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:09.866986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfd269-19ce-4536-868f-c9149a15b479 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:09.866986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfd269-19ce-4536-868f-c9149a15b479 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:09.868954 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:49:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:09.874641 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e048b-d890-41f8-a465-9dbc4246c3bf None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:09.875099 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e048b-d890-41f8-a465-9dbc4246c3bf None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:09.875195 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e048b-d890-41f8-a465-9dbc4246c3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:09.946060 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-e31e048b-d890-41f8-a465-9dbc4246c3bf None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:09.947931 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e31e048b-d890-41f8-a465-9dbc4246c3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:09.986074 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:10.056078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:49:10.094804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfd269-19ce-4536-868f-c9149a15b479 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:10.097153 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ddcfd269-19ce-4536-868f-c9149a15b479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:10.218544 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfd269-19ce-4536-868f-c9149a15b479 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:10.249046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:10.298600 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f63f3e-cb2a-496d-ae70-79937e0c16e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:10.299235 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f63f3e-cb2a-496d-ae70-79937e0c16e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:10.299511 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f63f3e-cb2a-496d-ae70-79937e0c16e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:10.299788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f63f3e-cb2a-496d-ae70-79937e0c16e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:10.301482 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f2f63f3e-cb2a-496d-ae70-79937e0c16e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:10.425803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f63f3e-cb2a-496d-ae70-79937e0c16e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:10.427227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f63f3e-cb2a-496d-ae70-79937e0c16e8 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:10.446601 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 728/1458] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:49:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:49:12.512410 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e299974-2560-4c76-babd-6b9bd0a3732f None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:12.513020 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e299974-2560-4c76-babd-6b9bd0a3732f None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:12.513020 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e299974-2560-4c76-babd-6b9bd0a3732f None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:12.514346 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:49:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:12.521035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c3c26-9eae-4ed5-8f03-4a2e375a2176 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:12.521479 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c3c26-9eae-4ed5-8f03-4a2e375a2176 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:12.521689 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c3c26-9eae-4ed5-8f03-4a2e375a2176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:12.599898 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-408c3c26-9eae-4ed5-8f03-4a2e375a2176 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:12.601174 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-408c3c26-9eae-4ed5-8f03-4a2e375a2176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:12.609882 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:12.707528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:49:12.751618 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e299974-2560-4c76-babd-6b9bd0a3732f None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:12.754501 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1e299974-2560-4c76-babd-6b9bd0a3732f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:12.862309 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e299974-2560-4c76-babd-6b9bd0a3732f None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:12.929073 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:12.948261 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8065e3-6f3c-4ae9-a56d-8c84252d1780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:12.948911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8065e3-6f3c-4ae9-a56d-8c84252d1780 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:12.949195 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8065e3-6f3c-4ae9-a56d-8c84252d1780 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:12.949470 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8065e3-6f3c-4ae9-a56d-8c84252d1780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:12.951163 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1d8065e3-6f3c-4ae9-a56d-8c84252d1780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:13.069817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8065e3-6f3c-4ae9-a56d-8c84252d1780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:13.071252 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8065e3-6f3c-4ae9-a56d-8c84252d1780 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:13.089354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 732/1461] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:49:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:49:15.183441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971b0cf-d548-47f3-9db7-06c69800dbfb None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:15.183894 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971b0cf-d548-47f3-9db7-06c69800dbfb None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:15.184164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971b0cf-d548-47f3-9db7-06c69800dbfb None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:15.185698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:15.191848 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41aa82-a273-4b06-957b-bdd0ffc3e16f None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:15.192290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41aa82-a273-4b06-957b-bdd0ffc3e16f None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:15.192394 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41aa82-a273-4b06-957b-bdd0ffc3e16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:15.268000 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-aa41aa82-a273-4b06-957b-bdd0ffc3e16f None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:15.269244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-aa41aa82-a273-4b06-957b-bdd0ffc3e16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:15.313393 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:15.380280 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:49:15.419159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971b0cf-d548-47f3-9db7-06c69800dbfb None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:15.420725 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6971b0cf-d548-47f3-9db7-06c69800dbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:15.533049 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971b0cf-d548-47f3-9db7-06c69800dbfb None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:15.572018 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:15.613484 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b04d2-e7e4-4703-8688-5e11ac1e0124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:15.614108 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b04d2-e7e4-4703-8688-5e11ac1e0124 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:15.614383 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b04d2-e7e4-4703-8688-5e11ac1e0124 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:15.614664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b04d2-e7e4-4703-8688-5e11ac1e0124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:15.616302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-cc8b04d2-e7e4-4703-8688-5e11ac1e0124 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:15.732797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b04d2-e7e4-4703-8688-5e11ac1e0124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:15.734271 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b04d2-e7e4-4703-8688-5e11ac1e0124 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:15.761343 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 731/1464] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:49:17.854569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a5a63-ee0d-43c5-8b31-14977ea7c4bc None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:17.855170 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a5a63-ee0d-43c5-8b31-14977ea7c4bc None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:17.855170 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a5a63-ee0d-43c5-8b31-14977ea7c4bc None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:17.856890 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:17.862788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ba8a9-7100-42d4-a44c-2524b9a1a636 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:17.863275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ba8a9-7100-42d4-a44c-2524b9a1a636 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:17.863275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ba8a9-7100-42d4-a44c-2524b9a1a636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:17.934942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-6a4ba8a9-7100-42d4-a44c-2524b9a1a636 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:17.936160 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6a4ba8a9-7100-42d4-a44c-2524b9a1a636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:17.956407 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:18.042600 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:49:18.079773 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a5a63-ee0d-43c5-8b31-14977ea7c4bc None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:18.081389 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-391a5a63-ee0d-43c5-8b31-14977ea7c4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:18.203315 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a5a63-ee0d-43c5-8b31-14977ea7c4bc None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:18.294915 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:18.302752 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361aa216-cd77-407d-a2dd-9a9ad3a693d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:18.303386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361aa216-cd77-407d-a2dd-9a9ad3a693d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:18.303661 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361aa216-cd77-407d-a2dd-9a9ad3a693d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:18.303933 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361aa216-cd77-407d-a2dd-9a9ad3a693d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:18.305699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-361aa216-cd77-407d-a2dd-9a9ad3a693d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:18.443125 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361aa216-cd77-407d-a2dd-9a9ad3a693d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:18.445295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361aa216-cd77-407d-a2dd-9a9ad3a693d5 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:18.466568 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 735/1467] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:49:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:49:20.509313 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0d776-20f6-4366-87bc-9901000c92dd None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:20.509936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0d776-20f6-4366-87bc-9901000c92dd None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:20.509936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0d776-20f6-4366-87bc-9901000c92dd None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:20.514838 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:49:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:20.523942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f6da5-fccb-44ef-a6da-1ef8755a9724 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:20.524381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f6da5-fccb-44ef-a6da-1ef8755a9724 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:20.524513 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f6da5-fccb-44ef-a6da-1ef8755a9724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:20.595202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-1a1f6da5-fccb-44ef-a6da-1ef8755a9724 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:20.596451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1a1f6da5-fccb-44ef-a6da-1ef8755a9724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:20.650081 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:20.700718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:49:20.740799 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0d776-20f6-4366-87bc-9901000c92dd None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:20.742812 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-39e0d776-20f6-4366-87bc-9901000c92dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:20.856044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0d776-20f6-4366-87bc-9901000c92dd None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:20.909650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:20.940357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56685be5-ffd3-44ef-9564-58413b19d900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:20.940985 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56685be5-ffd3-44ef-9564-58413b19d900 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:20.941296 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56685be5-ffd3-44ef-9564-58413b19d900 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:20.941570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56685be5-ffd3-44ef-9564-58413b19d900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:20.943206 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-56685be5-ffd3-44ef-9564-58413b19d900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:21.060621 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56685be5-ffd3-44ef-9564-58413b19d900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:21.062113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56685be5-ffd3-44ef-9564-58413b19d900 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:21.082400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 734/1470] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:49:30.698302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=22 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:31.079672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=66 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:40.771650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337deb8-53a2-4ba6-816c-ccc28ac0ca64 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:40.772529 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337deb8-53a2-4ba6-816c-ccc28ac0ca64 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:40.772529 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337deb8-53a2-4ba6-816c-ccc28ac0ca64 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:40.774691 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 737/1471] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:49:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:40.782126 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e073bc-19eb-46ef-af07-b6c5df41639a None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:40.782561 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e073bc-19eb-46ef-af07-b6c5df41639a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:40.782773 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e073bc-19eb-46ef-af07-b6c5df41639a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:40.854610 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-76e073bc-19eb-46ef-af07-b6c5df41639a None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:40.855901 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-76e073bc-19eb-46ef-af07-b6c5df41639a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:40.957162 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 735/1472] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:49:41.045297 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917b1c0-1901-4c54-aea4-b90786be941e None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:41.045586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917b1c0-1901-4c54-aea4-b90786be941e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:41.045866 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917b1c0-1901-4c54-aea4-b90786be941e None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:41.047298 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 738/1473] 10.222.0.96 () {54 vars in 966 bytes} [Thu Jul 28 17:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:41.052274 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd485b-223d-49be-bbcd-6a26ddd9f701 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:41.052558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd485b-223d-49be-bbcd-6a26ddd9f701 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:41.052828 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd485b-223d-49be-bbcd-6a26ddd9f701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:41.132508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-ebfd485b-223d-49be-bbcd-6a26ddd9f701 None None] MFA Rules not processed for user `98465c2d73e540b5bf506f5a7423e035`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:41.133756 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ebfd485b-223d-49be-bbcd-6a26ddd9f701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:41.160280 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:41.223097 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 736/1474] 10.222.0.96 () {58 vars in 1063 bytes} [Thu Jul 28 17:49:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:49:41.231148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917b1c0-1901-4c54-aea4-b90786be941e None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:41.232799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f917b1c0-1901-4c54-aea4-b90786be941e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:41.347858 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917b1c0-1901-4c54-aea4-b90786be941e None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:41.441497 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be516f37-b5c1-4d51-9391-f79a8f3af5d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98465c2d73e540b5bf506f5a7423e035', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:41.442122 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be516f37-b5c1-4d51-9391-f79a8f3af5d5 service glance] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:41.442401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be516f37-b5c1-4d51-9391-f79a8f3af5d5 service glance] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:41.442671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be516f37-b5c1-4d51-9391-f79a8f3af5d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:41.444321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-be516f37-b5c1-4d51-9391-f79a8f3af5d5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:41.501647 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:41.560819 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be516f37-b5c1-4d51-9391-f79a8f3af5d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:41.562359 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be516f37-b5c1-4d51-9391-f79a8f3af5d5 service glance] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:41.591299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 739/1475] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:49:43.666383 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58ed86-7a27-4554-a012-adf146ba5170 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:43.666983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58ed86-7a27-4554-a012-adf146ba5170 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:43.666983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58ed86-7a27-4554-a012-adf146ba5170 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:43.668340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 737/1476] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:43.674275 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6095f2f-1907-4bc4-8aaf-7a997317fb27 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:43.674713 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6095f2f-1907-4bc4-8aaf-7a997317fb27 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:43.674841 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6095f2f-1907-4bc4-8aaf-7a997317fb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:43.742142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-d6095f2f-1907-4bc4-8aaf-7a997317fb27 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:43.743542 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-d6095f2f-1907-4bc4-8aaf-7a997317fb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:43.847762 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 740/1477] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:49:43.870625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58ed86-7a27-4554-a012-adf146ba5170 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:43.872316 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-af58ed86-7a27-4554-a012-adf146ba5170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:44.019798 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58ed86-7a27-4554-a012-adf146ba5170 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:44.076515 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:44.123462 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685fb13-e49c-4b06-91e9-9d8b9cabde12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:44.124074 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685fb13-e49c-4b06-91e9-9d8b9cabde12 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:44.124345 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685fb13-e49c-4b06-91e9-9d8b9cabde12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:44.124616 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685fb13-e49c-4b06-91e9-9d8b9cabde12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:44.125326 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685fb13-e49c-4b06-91e9-9d8b9cabde12 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:44.127158 dv-cinder-813229-13-smb devstack@keystone.service[80310]: WARNING py.warnings [None req-d685fb13-e49c-4b06-91e9-9d8b9cabde12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:49:44.127158 dv-cinder-813229-13-smb devstack@keystone.service[80310]: warnings.warn(msg) Jul 28 17:49:44.127158 dv-cinder-813229-13-smb devstack@keystone.service[80310]: Jul 28 17:49:44.128312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685fb13-e49c-4b06-91e9-9d8b9cabde12 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:44.147470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 738/1478] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Jul 28 17:49:43 2022] GET /identity/v3/projects => generated 2553 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:49:46.208512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6865cd-ae6d-4047-9044-b467ed46c048 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:46.209119 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6865cd-ae6d-4047-9044-b467ed46c048 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:46.209119 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6865cd-ae6d-4047-9044-b467ed46c048 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:46.211217 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 741/1479] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:49:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:46.219349 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614e103-79a5-4784-969a-a294e22d0fd5 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:46.220062 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614e103-79a5-4784-969a-a294e22d0fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:46.220328 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614e103-79a5-4784-969a-a294e22d0fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:46.298811 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7614e103-79a5-4784-969a-a294e22d0fd5 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:46.299938 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7614e103-79a5-4784-969a-a294e22d0fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:46.408925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 739/1480] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:49:46.452460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6865cd-ae6d-4047-9044-b467ed46c048 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:46.454476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-7b6865cd-ae6d-4047-9044-b467ed46c048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:46.464489 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:46.630691 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6865cd-ae6d-4047-9044-b467ed46c048 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:46.725505 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:46.758692 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d812b4d-8da2-4036-9497-a1dc8ea2ae66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:46.759312 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d812b4d-8da2-4036-9497-a1dc8ea2ae66 service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:46.759548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d812b4d-8da2-4036-9497-a1dc8ea2ae66 service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:46.759860 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d812b4d-8da2-4036-9497-a1dc8ea2ae66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:46.761503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-2d812b4d-8da2-4036-9497-a1dc8ea2ae66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:46.852967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d812b4d-8da2-4036-9497-a1dc8ea2ae66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:46.854631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d812b4d-8da2-4036-9497-a1dc8ea2ae66 service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:46.873715 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 742/1481] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:49:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:49:49.123446 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf53463-08f4-4f49-a2c6-fd8f88cc9789 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:49.124035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf53463-08f4-4f49-a2c6-fd8f88cc9789 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:49.124035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf53463-08f4-4f49-a2c6-fd8f88cc9789 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:49.125409 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 740/1482] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:49.132128 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba638f2-4546-4dc1-a580-183c0a8b144b None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:49.132847 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba638f2-4546-4dc1-a580-183c0a8b144b None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:49.133119 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba638f2-4546-4dc1-a580-183c0a8b144b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:49.205082 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-eba638f2-4546-4dc1-a580-183c0a8b144b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:49.206308 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-eba638f2-4546-4dc1-a580-183c0a8b144b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:49.255807 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:49.310586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 743/1483] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:49:49.353273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf53463-08f4-4f49-a2c6-fd8f88cc9789 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:49.354811 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ebf53463-08f4-4f49-a2c6-fd8f88cc9789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:49.383968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:49.478795 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf53463-08f4-4f49-a2c6-fd8f88cc9789 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:49.564184 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009eb83e-2762-428f-9823-01cb0fd649d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:49.564717 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eb83e-2762-428f-9823-01cb0fd649d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:49.564996 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eb83e-2762-428f-9823-01cb0fd649d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:49.565303 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eb83e-2762-428f-9823-01cb0fd649d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:49.566964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-009eb83e-2762-428f-9823-01cb0fd649d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:49.655933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:49.695555 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009eb83e-2762-428f-9823-01cb0fd649d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:49.697006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009eb83e-2762-428f-9823-01cb0fd649d3 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:49.716841 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 741/1484] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:49:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:49:51.797405 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966fbde-cb6d-4798-b8df-0477bcc9e2bb None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:51.798258 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966fbde-cb6d-4798-b8df-0477bcc9e2bb None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:51.798407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966fbde-cb6d-4798-b8df-0477bcc9e2bb None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:51.800594 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 744/1485] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:49:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:51.807006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f1beb-885f-4d7d-a50b-ddccf6816198 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:51.807453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f1beb-885f-4d7d-a50b-ddccf6816198 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:51.807726 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f1beb-885f-4d7d-a50b-ddccf6816198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:51.892586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c22f1beb-885f-4d7d-a50b-ddccf6816198 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:51.894551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c22f1beb-885f-4d7d-a50b-ddccf6816198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:52.005313 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 742/1486] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:49:52.045728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966fbde-cb6d-4798-b8df-0477bcc9e2bb None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:52.047297 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9966fbde-cb6d-4798-b8df-0477bcc9e2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:52.162253 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966fbde-cb6d-4798-b8df-0477bcc9e2bb None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:52.236274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:52.238163 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237cdf7-53dc-4aa3-9525-1b8da4d33f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:52.238779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237cdf7-53dc-4aa3-9525-1b8da4d33f8f service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:52.239069 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237cdf7-53dc-4aa3-9525-1b8da4d33f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:52.239380 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237cdf7-53dc-4aa3-9525-1b8da4d33f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:52.241733 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-d237cdf7-53dc-4aa3-9525-1b8da4d33f8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:52.387416 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237cdf7-53dc-4aa3-9525-1b8da4d33f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:52.389337 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237cdf7-53dc-4aa3-9525-1b8da4d33f8f service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:52.415266 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 745/1487] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:49:54.584058 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e921350-2ba7-4f77-bf1f-725d4746e40a None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:54.585030 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e921350-2ba7-4f77-bf1f-725d4746e40a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:54.585030 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e921350-2ba7-4f77-bf1f-725d4746e40a None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:54.587227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 743/1488] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:49:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:54.593670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4883ef-c087-4afa-a00b-f90bb0b31725 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:54.594153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4883ef-c087-4afa-a00b-f90bb0b31725 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:54.594254 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4883ef-c087-4afa-a00b-f90bb0b31725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:54.679356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-0f4883ef-c087-4afa-a00b-f90bb0b31725 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:54.680569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-0f4883ef-c087-4afa-a00b-f90bb0b31725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:54.738106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:54.783125 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 746/1489] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:49:54.826992 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e921350-2ba7-4f77-bf1f-725d4746e40a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:54.829371 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1e921350-2ba7-4f77-bf1f-725d4746e40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:54.872163 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:54.943019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e921350-2ba7-4f77-bf1f-725d4746e40a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:55.024369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82784ac6-7e55-4bb0-8292-5ce43e3ab884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:55.025003 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82784ac6-7e55-4bb0-8292-5ce43e3ab884 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:55.025332 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82784ac6-7e55-4bb0-8292-5ce43e3ab884 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:55.025633 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82784ac6-7e55-4bb0-8292-5ce43e3ab884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:55.027272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-82784ac6-7e55-4bb0-8292-5ce43e3ab884 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:55.123457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:55.154460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82784ac6-7e55-4bb0-8292-5ce43e3ab884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:55.155909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82784ac6-7e55-4bb0-8292-5ce43e3ab884 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:55.175710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 744/1490] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:49:57.359345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b5311-e7e3-4349-8795-6cf10479aafc None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:57.359952 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b5311-e7e3-4349-8795-6cf10479aafc None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:57.359952 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b5311-e7e3-4349-8795-6cf10479aafc None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:57.362083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 747/1491] 10.222.0.96 () {54 vars in 926 bytes} [Thu Jul 28 17:49:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:57.370940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a5137-4a5f-4fa8-9633-03a4b67da4be None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:57.371358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a5137-4a5f-4fa8-9633-03a4b67da4be None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:57.371492 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a5137-4a5f-4fa8-9633-03a4b67da4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:57.451723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-440a5137-4a5f-4fa8-9633-03a4b67da4be None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:57.452971 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-440a5137-4a5f-4fa8-9633-03a4b67da4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:57.563021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 745/1492] 10.222.0.96 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:49:57.607092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b5311-e7e3-4349-8795-6cf10479aafc None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:57.608660 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e40b5311-e7e3-4349-8795-6cf10479aafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:57.715726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b5311-e7e3-4349-8795-6cf10479aafc None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:57.792392 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6e89d-f9ac-4cb0-ae08-f3f7e274ce2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:57.793015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6e89d-f9ac-4cb0-ae08-f3f7e274ce2c service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:57.793320 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6e89d-f9ac-4cb0-ae08-f3f7e274ce2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:57.793588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6e89d-f9ac-4cb0-ae08-f3f7e274ce2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:57.795303 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-37a6e89d-f9ac-4cb0-ae08-f3f7e274ce2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:57.804355 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:57.920820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6e89d-f9ac-4cb0-ae08-f3f7e274ce2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:57.922310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6e89d-f9ac-4cb0-ae08-f3f7e274ce2c service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:57.942037 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 748/1493] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:49:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:50:07.560791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=82 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:50:07.939350 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=50 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:27.291068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53c849-315d-4b97-b263-59658955aca0 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:27.291592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53c849-315d-4b97-b263-59658955aca0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:27.291592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53c849-315d-4b97-b263-59658955aca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:27.374832 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-2f53c849-315d-4b97-b263-59658955aca0 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:51:27.376280 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2f53c849-315d-4b97-b263-59658955aca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:27.479322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 746/1494] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:51:27.488224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95f685-a749-4f7f-8936-3e14f96be5c4 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:27.488801 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95f685-a749-4f7f-8936-3e14f96be5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:27.488801 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95f685-a749-4f7f-8936-3e14f96be5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:27.569687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-ae95f685-a749-4f7f-8936-3e14f96be5c4 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:51:27.570842 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ae95f685-a749-4f7f-8936-3e14f96be5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:27.691804 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 749/1495] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:51:27.698611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53c849-315d-4b97-b263-59658955aca0 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:27.699869 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2f53c849-315d-4b97-b263-59658955aca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:27.712102 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53c849-315d-4b97-b263-59658955aca0 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:27.784508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:27.829273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f594a1-7052-4d5b-9274-1ef4c97792a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:27.830218 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f594a1-7052-4d5b-9274-1ef4c97792a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:27.830636 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f594a1-7052-4d5b-9274-1ef4c97792a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:27.830996 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f594a1-7052-4d5b-9274-1ef4c97792a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:27.832088 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f594a1-7052-4d5b-9274-1ef4c97792a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:27.832545 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f594a1-7052-4d5b-9274-1ef4c97792a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:27.834280 dv-cinder-813229-13-smb devstack@keystone.service[80310]: WARNING py.warnings [None req-53f594a1-7052-4d5b-9274-1ef4c97792a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:51:27.834280 dv-cinder-813229-13-smb devstack@keystone.service[80310]: warnings.warn(msg) Jul 28 17:51:27.834280 dv-cinder-813229-13-smb devstack@keystone.service[80310]: Jul 28 17:51:27.835498 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f594a1-7052-4d5b-9274-1ef4c97792a9 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:27.850589 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 747/1496] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:27.859896 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95f685-a749-4f7f-8936-3e14f96be5c4 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:27.874014 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95f685-a749-4f7f-8936-3e14f96be5c4 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:27.944582 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:27.986010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4575afc-9a3f-427d-87e5-9c610207213d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:27.986636 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4575afc-9a3f-427d-87e5-9c610207213d admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:27.986908 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4575afc-9a3f-427d-87e5-9c610207213d admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:27.987173 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4575afc-9a3f-427d-87e5-9c610207213d admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:27.987831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4575afc-9a3f-427d-87e5-9c610207213d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:27.989598 dv-cinder-813229-13-smb devstack@keystone.service[80309]: WARNING py.warnings [None req-c4575afc-9a3f-427d-87e5-9c610207213d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:51:27.989598 dv-cinder-813229-13-smb devstack@keystone.service[80309]: warnings.warn(msg) Jul 28 17:51:27.989598 dv-cinder-813229-13-smb devstack@keystone.service[80309]: Jul 28 17:51:27.990779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4575afc-9a3f-427d-87e5-9c610207213d admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:28.052944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 750/1497] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:51:27 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:51:28.059621 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f594a1-7052-4d5b-9274-1ef4c97792a9 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:28.062166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-53f594a1-7052-4d5b-9274-1ef4c97792a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:28.107632 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f594a1-7052-4d5b-9274-1ef4c97792a9 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:28.222793 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a276c52-5537-40a1-8b30-3b817156e032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:28.223430 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a276c52-5537-40a1-8b30-3b817156e032 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:28.223701 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a276c52-5537-40a1-8b30-3b817156e032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:28.223967 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a276c52-5537-40a1-8b30-3b817156e032 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:28.224638 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a276c52-5537-40a1-8b30-3b817156e032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:28.225732 dv-cinder-813229-13-smb devstack@keystone.service[80310]: WARNING py.warnings [None req-0a276c52-5537-40a1-8b30-3b817156e032 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:51:28.225732 dv-cinder-813229-13-smb devstack@keystone.service[80310]: warnings.warn(msg) Jul 28 17:51:28.225732 dv-cinder-813229-13-smb devstack@keystone.service[80310]: Jul 28 17:51:28.226959 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a276c52-5537-40a1-8b30-3b817156e032 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:28.278939 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 748/1498] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:51:28 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:51:28.283564 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4575afc-9a3f-427d-87e5-9c610207213d admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:28.285194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-c4575afc-9a3f-427d-87e5-9c610207213d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:28.351204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4575afc-9a3f-427d-87e5-9c610207213d admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:28.436381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:28.448882 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7927c48-f1ad-40a9-86b3-85358b4223bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:28.449549 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7927c48-f1ad-40a9-86b3-85358b4223bf admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:28.449829 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7927c48-f1ad-40a9-86b3-85358b4223bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:28.450100 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7927c48-f1ad-40a9-86b3-85358b4223bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:28.450801 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7927c48-f1ad-40a9-86b3-85358b4223bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:28.451834 dv-cinder-813229-13-smb devstack@keystone.service[80309]: WARNING py.warnings [None req-f7927c48-f1ad-40a9-86b3-85358b4223bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:51:28.451834 dv-cinder-813229-13-smb devstack@keystone.service[80309]: warnings.warn(msg) Jul 28 17:51:28.451834 dv-cinder-813229-13-smb devstack@keystone.service[80309]: Jul 28 17:51:28.452741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7927c48-f1ad-40a9-86b3-85358b4223bf admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:28.465876 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 751/1499] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:51:28.470447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a276c52-5537-40a1-8b30-3b817156e032 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:28.471994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0a276c52-5537-40a1-8b30-3b817156e032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:28.484605 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a276c52-5537-40a1-8b30-3b817156e032 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:28.517292 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:28.603729 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32dcba4-89dd-4280-abdc-d2c1c3e31409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:28.604360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dcba4-89dd-4280-abdc-d2c1c3e31409 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:28.604636 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dcba4-89dd-4280-abdc-d2c1c3e31409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:28.604911 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dcba4-89dd-4280-abdc-d2c1c3e31409 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:28.605644 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32dcba4-89dd-4280-abdc-d2c1c3e31409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:28.606709 dv-cinder-813229-13-smb devstack@keystone.service[80310]: WARNING py.warnings [None req-a32dcba4-89dd-4280-abdc-d2c1c3e31409 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:51:28.606709 dv-cinder-813229-13-smb devstack@keystone.service[80310]: warnings.warn(msg) Jul 28 17:51:28.606709 dv-cinder-813229-13-smb devstack@keystone.service[80310]: Jul 28 17:51:28.607599 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32dcba4-89dd-4280-abdc-d2c1c3e31409 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:28.620901 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 749/1500] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:51:28.626305 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7927c48-f1ad-40a9-86b3-85358b4223bf admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:28.628708 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f7927c48-f1ad-40a9-86b3-85358b4223bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:28.673229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7927c48-f1ad-40a9-86b3-85358b4223bf admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:28.787481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395bbda-94de-4d72-b075-e8f58b3fe1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:28.788067 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395bbda-94de-4d72-b075-e8f58b3fe1b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:28.788347 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395bbda-94de-4d72-b075-e8f58b3fe1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:28.788612 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395bbda-94de-4d72-b075-e8f58b3fe1b2 admin admin] PATH_INFO: `/v3/projects/d2c8a0c91b334097963d6ff9ddc3d18e/users/631be6504cc8422d9d269bd07cdbe598/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:28.812187 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395bbda-94de-4d72-b075-e8f58b3fe1b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c8a0c91b334097963d6ff9ddc3d18e, user_id=631be6504cc8422d9d269bd07cdbe598, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:28.813250 dv-cinder-813229-13-smb devstack@keystone.service[80309]: WARNING py.warnings [None req-6395bbda-94de-4d72-b075-e8f58b3fe1b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:51:28.813250 dv-cinder-813229-13-smb devstack@keystone.service[80309]: warnings.warn(msg) Jul 28 17:51:28.813250 dv-cinder-813229-13-smb devstack@keystone.service[80309]: Jul 28 17:51:28.815170 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395bbda-94de-4d72-b075-e8f58b3fe1b2 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:28.841713 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 752/1501] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:51:28 2022] PUT /identity/v3/projects/d2c8a0c91b334097963d6ff9ddc3d18e/users/631be6504cc8422d9d269bd07cdbe598/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:51:28.854207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79420b-6d93-426f-bfdc-da34b2f19886 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:28.854499 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79420b-6d93-426f-bfdc-da34b2f19886 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:28.854775 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79420b-6d93-426f-bfdc-da34b2f19886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:28.915873 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-ed79420b-6d93-426f-bfdc-da34b2f19886 None None] MFA Rules not processed for user `631be6504cc8422d9d269bd07cdbe598`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:51:28.917178 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ed79420b-6d93-426f-bfdc-da34b2f19886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:29.007812 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 750/1502] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:51:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:51:29.020062 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3563c48-4ce3-4bef-a77a-2dc9d30b9968 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:29.020801 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3563c48-4ce3-4bef-a77a-2dc9d30b9968 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:29.020801 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3563c48-4ce3-4bef-a77a-2dc9d30b9968 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:29.022026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 753/1503] 10.222.0.96 () {54 vars in 964 bytes} [Thu Jul 28 17:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:51:29.027312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f5a8f-d95c-4976-802a-f4a2c5047fae None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:29.027602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f5a8f-d95c-4976-802a-f4a2c5047fae None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:29.027881 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f5a8f-d95c-4976-802a-f4a2c5047fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:29.058549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:29.106860 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-062f5a8f-d95c-4976-802a-f4a2c5047fae None None] MFA Rules not processed for user `e6d20d753e37498e8664f983b0988e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:51:29.108099 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-062f5a8f-d95c-4976-802a-f4a2c5047fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:29.205748 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 751/1504] 10.222.0.96 () {58 vars in 1061 bytes} [Thu Jul 28 17:51:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:51:29.214565 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3563c48-4ce3-4bef-a77a-2dc9d30b9968 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:29.216808 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-a3563c48-4ce3-4bef-a77a-2dc9d30b9968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:29.283708 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:29.349096 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3563c48-4ce3-4bef-a77a-2dc9d30b9968 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:29.433362 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443f3e9-ad0d-49a6-a548-f94220cf30c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:29.433989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443f3e9-ad0d-49a6-a548-f94220cf30c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:29.434271 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443f3e9-ad0d-49a6-a548-f94220cf30c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:29.434553 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443f3e9-ad0d-49a6-a548-f94220cf30c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:29.436191 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-4443f3e9-ad0d-49a6-a548-f94220cf30c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:29.549543 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443f3e9-ad0d-49a6-a548-f94220cf30c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:29.550990 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443f3e9-ad0d-49a6-a548-f94220cf30c4 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:29.554489 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:29.571867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 754/1505] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:51:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:51:29.626580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be49b1-7be3-4d37-a709-54a37ad32aac None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:29.627014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be49b1-7be3-4d37-a709-54a37ad32aac None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:29.627132 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be49b1-7be3-4d37-a709-54a37ad32aac None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:29.628793 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 752/1506] 10.222.0.96 () {52 vars in 830 bytes} [Thu Jul 28 17:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:51:29.632601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443f3e9-ad0d-49a6-a548-f94220cf30c4 service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:29.633879 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-4443f3e9-ad0d-49a6-a548-f94220cf30c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:29.743958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443f3e9-ad0d-49a6-a548-f94220cf30c4 service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:29.847954 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c090e5f-2dcf-4629-8237-1373b6387674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:29.848617 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c090e5f-2dcf-4629-8237-1373b6387674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:29.848897 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c090e5f-2dcf-4629-8237-1373b6387674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:29.849198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c090e5f-2dcf-4629-8237-1373b6387674 admin admin] PATH_INFO: `/v3/users/631be6504cc8422d9d269bd07cdbe598` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:29.863548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c090e5f-2dcf-4629-8237-1373b6387674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=631be6504cc8422d9d269bd07cdbe598)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:29.864547 dv-cinder-813229-13-smb devstack@keystone.service[80309]: WARNING py.warnings [None req-8c090e5f-2dcf-4629-8237-1373b6387674 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:51:29.864547 dv-cinder-813229-13-smb devstack@keystone.service[80309]: warnings.warn(msg) Jul 28 17:51:29.864547 dv-cinder-813229-13-smb devstack@keystone.service[80309]: Jul 28 17:51:29.865813 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c090e5f-2dcf-4629-8237-1373b6387674 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:29.876186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:29.938370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-8c090e5f-2dcf-4629-8237-1373b6387674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '631be6504cc8422d9d269bd07cdbe598'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:51:29.958118 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-8c090e5f-2dcf-4629-8237-1373b6387674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '631be6504cc8422d9d269bd07cdbe598'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:51:29.973138 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-8c090e5f-2dcf-4629-8237-1373b6387674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '631be6504cc8422d9d269bd07cdbe598'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:51:29.987686 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-8c090e5f-2dcf-4629-8237-1373b6387674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '631be6504cc8422d9d269bd07cdbe598'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:51:29.988298 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-8c090e5f-2dcf-4629-8237-1373b6387674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '631be6504cc8422d9d269bd07cdbe598'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:51:29.994220 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 755/1507] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:51:29 2022] DELETE /identity/v3/users/631be6504cc8422d9d269bd07cdbe598 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:51:29.998941 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6dde9-5f59-43a2-acef-51822390ae25 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:29.999223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6dde9-5f59-43a2-acef-51822390ae25 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:29.999558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6dde9-5f59-43a2-acef-51822390ae25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:30.059826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-62a6dde9-5f59-43a2-acef-51822390ae25 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:51:30.061087 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-62a6dde9-5f59-43a2-acef-51822390ae25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:30.144053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:30.158599 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 753/1508] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:51:30.168933 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c090e5f-2dcf-4629-8237-1373b6387674 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:30.170689 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-8c090e5f-2dcf-4629-8237-1373b6387674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:30.297465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c090e5f-2dcf-4629-8237-1373b6387674 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:30.365615 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:30.387027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed48b5f-e2b1-4eca-a4a2-6a683d5b7c49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:30.387669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed48b5f-e2b1-4eca-a4a2-6a683d5b7c49 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:30.387951 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed48b5f-e2b1-4eca-a4a2-6a683d5b7c49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:30.388229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed48b5f-e2b1-4eca-a4a2-6a683d5b7c49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:30.389934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-fed48b5f-e2b1-4eca-a4a2-6a683d5b7c49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:30.510942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed48b5f-e2b1-4eca-a4a2-6a683d5b7c49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:30.512447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed48b5f-e2b1-4eca-a4a2-6a683d5b7c49 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:30.533221 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 756/1509] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:51:30.910437 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6dde9-5f59-43a2-acef-51822390ae25 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:30.911696 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-62a6dde9-5f59-43a2-acef-51822390ae25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:30.923534 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6dde9-5f59-43a2-acef-51822390ae25 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:31.026400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b97d7a-7a8e-4c6c-9a7d-2a6afe9a79c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:31.027076 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97d7a-7a8e-4c6c-9a7d-2a6afe9a79c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:31.027344 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97d7a-7a8e-4c6c-9a7d-2a6afe9a79c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:31.027615 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97d7a-7a8e-4c6c-9a7d-2a6afe9a79c1 admin admin] PATH_INFO: `/v3/projects/d2c8a0c91b334097963d6ff9ddc3d18e` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:31.038713 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b97d7a-7a8e-4c6c-9a7d-2a6afe9a79c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c8a0c91b334097963d6ff9ddc3d18e)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:31.039774 dv-cinder-813229-13-smb devstack@keystone.service[80310]: WARNING py.warnings [None req-14b97d7a-7a8e-4c6c-9a7d-2a6afe9a79c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:51:31.039774 dv-cinder-813229-13-smb devstack@keystone.service[80310]: warnings.warn(msg) Jul 28 17:51:31.039774 dv-cinder-813229-13-smb devstack@keystone.service[80310]: Jul 28 17:51:31.040985 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b97d7a-7a8e-4c6c-9a7d-2a6afe9a79c1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:31.107724 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-14b97d7a-7a8e-4c6c-9a7d-2a6afe9a79c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c8a0c91b334097963d6ff9ddc3d18e', 'request_id': 'req-14b97d7a-7a8e-4c6c-9a7d-2a6afe9a79c1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:51:31.121568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-14b97d7a-7a8e-4c6c-9a7d-2a6afe9a79c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c8a0c91b334097963d6ff9ddc3d18e', 'request_id': 'req-14b97d7a-7a8e-4c6c-9a7d-2a6afe9a79c1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:51:31.131649 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-14b97d7a-7a8e-4c6c-9a7d-2a6afe9a79c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c8a0c91b334097963d6ff9ddc3d18e', 'request_id': 'req-14b97d7a-7a8e-4c6c-9a7d-2a6afe9a79c1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:51:31.156038 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-14b97d7a-7a8e-4c6c-9a7d-2a6afe9a79c1 admin admin] The token cache is being invalidate because project d2c8a0c91b334097963d6ff9ddc3d18e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:51:31.156389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-14b97d7a-7a8e-4c6c-9a7d-2a6afe9a79c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:51:31.156743 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-14b97d7a-7a8e-4c6c-9a7d-2a6afe9a79c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:51:31.158336 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 754/1510] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:51:30 2022] DELETE /identity/v3/projects/d2c8a0c91b334097963d6ff9ddc3d18e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:51:40.530831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=62 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:41.153798 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:19.732718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0726a84-7505-432b-9221-e040adeedd76 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:19.733793 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0726a84-7505-432b-9221-e040adeedd76 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:19.734190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0726a84-7505-432b-9221-e040adeedd76 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:19.736676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 17:53:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:53:19.745604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631ff9a-dffa-4132-88e8-55335d9d4b2a None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:19.746482 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631ff9a-dffa-4132-88e8-55335d9d4b2a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:19.746482 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631ff9a-dffa-4132-88e8-55335d9d4b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:19.838802 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-6631ff9a-dffa-4132-88e8-55335d9d4b2a None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:53:19.840015 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6631ff9a-dffa-4132-88e8-55335d9d4b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:53:19.956454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 17:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:53:20.112796 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0726a84-7505-432b-9221-e040adeedd76 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:53:20.116625 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-d0726a84-7505-432b-9221-e040adeedd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:53:20.264167 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0726a84-7505-432b-9221-e040adeedd76 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:53:20.275352 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1947e81-42ce-4e0f-a964-f689aab6af6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:53:20.276116 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1947e81-42ce-4e0f-a964-f689aab6af6e service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:20.276478 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1947e81-42ce-4e0f-a964-f689aab6af6e service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:20.276835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1947e81-42ce-4e0f-a964-f689aab6af6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:20.290975 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1947e81-42ce-4e0f-a964-f689aab6af6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:53:20.293482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1947e81-42ce-4e0f-a964-f689aab6af6e service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:53:20.306603 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 758/1513] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:53:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:53:21.178342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781ce58-7f91-47b3-bd80-3feca221b40c None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:21.179203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781ce58-7f91-47b3-bd80-3feca221b40c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:21.179203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781ce58-7f91-47b3-bd80-3feca221b40c None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:21.181459 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 17:53:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:53:21.190044 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace0eb8-26f0-45ed-8692-2e05c5cf26fd None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:21.190798 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace0eb8-26f0-45ed-8692-2e05c5cf26fd None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:21.190992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace0eb8-26f0-45ed-8692-2e05c5cf26fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:21.212958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-eace0eb8-26f0-45ed-8692-2e05c5cf26fd None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:53:21.214192 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-eace0eb8-26f0-45ed-8692-2e05c5cf26fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:53:21.222343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 17:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:53:21.373124 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781ce58-7f91-47b3-bd80-3feca221b40c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:53:21.392062 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781ce58-7f91-47b3-bd80-3feca221b40c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:53:21.398415 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb585cb2-654d-4bfd-8387-d87b434dc40e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:53:21.399032 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb585cb2-654d-4bfd-8387-d87b434dc40e service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:21.399306 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb585cb2-654d-4bfd-8387-d87b434dc40e service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:21.399585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb585cb2-654d-4bfd-8387-d87b434dc40e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:21.412143 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb585cb2-654d-4bfd-8387-d87b434dc40e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:53:21.414327 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb585cb2-654d-4bfd-8387-d87b434dc40e service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:53:21.424848 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 757/1516] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:53:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:53:21.611717 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585350b1-9721-421a-aaee-70fd4bbd5868 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:21.611971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585350b1-9721-421a-aaee-70fd4bbd5868 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:21.612269 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585350b1-9721-421a-aaee-70fd4bbd5868 None None] PATH_INFO: `/v3` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:21.613688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 760/1517] 10.222.0.81 () {54 vars in 925 bytes} [Thu Jul 28 17:53:21 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:53:21.621421 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875411e6-a35a-4754-9cf9-4ce2c0731baa None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:21.621706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875411e6-a35a-4754-9cf9-4ce2c0731baa None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:21.621980 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875411e6-a35a-4754-9cf9-4ce2c0731baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:21.687204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-875411e6-a35a-4754-9cf9-4ce2c0731baa None None] MFA Rules not processed for user `38257735924d44488e1407fefb886324`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:53:21.689272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-875411e6-a35a-4754-9cf9-4ce2c0731baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:53:21.709817 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:21.777918 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 758/1518] 10.222.0.81 () {58 vars in 1015 bytes} [Thu Jul 28 17:53:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:53:30.811378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adb91d-5e08-4a3d-8426-bd5304bbc15c None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:30.811982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adb91d-5e08-4a3d-8426-bd5304bbc15c None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:30.811982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adb91d-5e08-4a3d-8426-bd5304bbc15c None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:30.813780 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 761/1519] 10.222.0.96 () {54 vars in 961 bytes} [Thu Jul 28 17:53:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:53:30.822120 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c40961-8785-4771-a41f-ddeb4bcd9572 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:30.823187 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c40961-8785-4771-a41f-ddeb4bcd9572 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:30.823187 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c40961-8785-4771-a41f-ddeb4bcd9572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:30.844859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a6c40961-8785-4771-a41f-ddeb4bcd9572 None None] MFA Rules not processed for user `38257735924d44488e1407fefb886324`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:53:30.846187 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a6c40961-8785-4771-a41f-ddeb4bcd9572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:53:30.856682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 759/1520] 10.222.0.96 () {58 vars in 1058 bytes} [Thu Jul 28 17:53:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:53:30.864599 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adb91d-5e08-4a3d-8426-bd5304bbc15c None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:53:30.879928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adb91d-5e08-4a3d-8426-bd5304bbc15c None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:53:30.885948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9a8ca-7b01-4e20-bec1-f2944f059123 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38257735924d44488e1407fefb886324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:53:30.886557 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9a8ca-7b01-4e20-bec1-f2944f059123 service placement] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:30.886836 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9a8ca-7b01-4e20-bec1-f2944f059123 service placement] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:30.887112 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9a8ca-7b01-4e20-bec1-f2944f059123 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:30.896335 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9a8ca-7b01-4e20-bec1-f2944f059123 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:53:30.897980 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9a8ca-7b01-4e20-bec1-f2944f059123 service placement] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:53:30.907959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 762/1521] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:53:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:53:32.673315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b2268-0071-47fc-8ed0-64b19ed4d292 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:32.673895 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b2268-0071-47fc-8ed0-64b19ed4d292 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:32.673895 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b2268-0071-47fc-8ed0-64b19ed4d292 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:32.675268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 17:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:53:32.681438 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560e107-8942-4c5e-b354-235f03b3b785 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:32.681960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560e107-8942-4c5e-b354-235f03b3b785 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:32.682076 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560e107-8942-4c5e-b354-235f03b3b785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:32.703739 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-0560e107-8942-4c5e-b354-235f03b3b785 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:53:32.704954 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-0560e107-8942-4c5e-b354-235f03b3b785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:53:32.714746 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 17:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:53:32.874543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b2268-0071-47fc-8ed0-64b19ed4d292 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:53:32.898020 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b2268-0071-47fc-8ed0-64b19ed4d292 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:53:32.905871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacad2f-71b5-47ac-b92e-27a4b9bceb89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:53:32.906498 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacad2f-71b5-47ac-b92e-27a4b9bceb89 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:32.906778 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacad2f-71b5-47ac-b92e-27a4b9bceb89 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:32.907087 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacad2f-71b5-47ac-b92e-27a4b9bceb89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:32.915585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacad2f-71b5-47ac-b92e-27a4b9bceb89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:53:32.917378 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacad2f-71b5-47ac-b92e-27a4b9bceb89 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:53:32.927153 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 761/1524] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:53:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:53:33.763162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fe3f9-a6a0-4511-94b6-61a42c4c2e45 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:33.764096 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fe3f9-a6a0-4511-94b6-61a42c4c2e45 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:33.764096 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fe3f9-a6a0-4511-94b6-61a42c4c2e45 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:33.766394 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 17:53:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:53:33.774467 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f3b52-5cd3-4784-8e6d-db97717c4a2c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:33.774891 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f3b52-5cd3-4784-8e6d-db97717c4a2c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:33.775007 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f3b52-5cd3-4784-8e6d-db97717c4a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:33.801973 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d74f3b52-5cd3-4784-8e6d-db97717c4a2c None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:53:33.803193 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d74f3b52-5cd3-4784-8e6d-db97717c4a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:53:33.812067 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 17:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:53:33.971099 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fe3f9-a6a0-4511-94b6-61a42c4c2e45 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:53:33.988055 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fe3f9-a6a0-4511-94b6-61a42c4c2e45 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:53:33.994139 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e9f7f-08d6-415c-a8eb-d3b591b6ed22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:53:33.994987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e9f7f-08d6-415c-a8eb-d3b591b6ed22 service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:33.995290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e9f7f-08d6-415c-a8eb-d3b591b6ed22 service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:33.995557 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e9f7f-08d6-415c-a8eb-d3b591b6ed22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:34.004971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e9f7f-08d6-415c-a8eb-d3b591b6ed22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:53:34.007596 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e9f7f-08d6-415c-a8eb-d3b591b6ed22 service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:53:34.019220 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 765/1527] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:53:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:53:37.956033 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6877b-86be-4014-9455-f7e8bd08a9c9 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:37.956977 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6877b-86be-4014-9455-f7e8bd08a9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:37.956977 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6877b-86be-4014-9455-f7e8bd08a9c9 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:37.958818 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:53:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:53:37.964917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09d45a-5f8b-468c-ad9b-eb1814bde861 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:37.965400 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09d45a-5f8b-468c-ad9b-eb1814bde861 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:37.965506 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09d45a-5f8b-468c-ad9b-eb1814bde861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:37.986156 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-7f09d45a-5f8b-468c-ad9b-eb1814bde861 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:53:37.987366 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-7f09d45a-5f8b-468c-ad9b-eb1814bde861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:53:37.996420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:53:38.074622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6877b-86be-4014-9455-f7e8bd08a9c9 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:53:38.076614 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-51f6877b-86be-4014-9455-f7e8bd08a9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:53:38.160702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6877b-86be-4014-9455-f7e8bd08a9c9 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:53:38.164841 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07818165-9ec1-4323-94be-b8363b7195e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:53:38.165501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07818165-9ec1-4323-94be-b8363b7195e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:38.165787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07818165-9ec1-4323-94be-b8363b7195e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:38.166064 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07818165-9ec1-4323-94be-b8363b7195e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:38.176065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07818165-9ec1-4323-94be-b8363b7195e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:53:38.177581 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07818165-9ec1-4323-94be-b8363b7195e3 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:53:38.188822 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 764/1530] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:53:40.159475 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e94e2-e8d8-4371-b66b-464d1714cc80 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:40.160393 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e94e2-e8d8-4371-b66b-464d1714cc80 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:40.160393 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e94e2-e8d8-4371-b66b-464d1714cc80 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:40.162596 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:53:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:53:40.168375 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2800c0d-17bf-44ff-b684-61c0045e8e7b None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:40.168828 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2800c0d-17bf-44ff-b684-61c0045e8e7b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:40.168938 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2800c0d-17bf-44ff-b684-61c0045e8e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:40.190367 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c2800c0d-17bf-44ff-b684-61c0045e8e7b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:53:40.191556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c2800c0d-17bf-44ff-b684-61c0045e8e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:53:40.200702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:53:40.236942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e94e2-e8d8-4371-b66b-464d1714cc80 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:53:40.251168 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e94e2-e8d8-4371-b66b-464d1714cc80 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:53:40.255343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa3f86-226d-450b-8fc4-77b6ab6329da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:53:40.255960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa3f86-226d-450b-8fc4-77b6ab6329da service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:40.256242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa3f86-226d-450b-8fc4-77b6ab6329da service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:40.256515 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa3f86-226d-450b-8fc4-77b6ab6329da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:40.267225 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa3f86-226d-450b-8fc4-77b6ab6329da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:53:40.268670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa3f86-226d-450b-8fc4-77b6ab6329da service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:53:40.279463 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 768/1533] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:53:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:53:43.834821 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f5165-2300-4fe0-b36f-02a46a269637 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:43.835760 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f5165-2300-4fe0-b36f-02a46a269637 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:43.835760 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f5165-2300-4fe0-b36f-02a46a269637 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:43.838024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:53:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:53:43.843564 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb21f5-22a3-45f5-aece-9df4c11e8f51 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:43.844044 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb21f5-22a3-45f5-aece-9df4c11e8f51 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:43.844158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb21f5-22a3-45f5-aece-9df4c11e8f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:43.854600 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=81 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:43.867631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-70fb21f5-22a3-45f5-aece-9df4c11e8f51 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:53:43.868854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-70fb21f5-22a3-45f5-aece-9df4c11e8f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:53:43.877671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:53:44.196092 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f5165-2300-4fe0-b36f-02a46a269637 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:53:44.199727 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-981f5165-2300-4fe0-b36f-02a46a269637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:53:44.279275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:44.293541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f5165-2300-4fe0-b36f-02a46a269637 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:53:44.297383 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ac712-b649-4abb-aaee-27766dedfe09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:53:44.298008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ac712-b649-4abb-aaee-27766dedfe09 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:44.298283 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ac712-b649-4abb-aaee-27766dedfe09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:44.298555 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ac712-b649-4abb-aaee-27766dedfe09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:44.308091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ac712-b649-4abb-aaee-27766dedfe09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:53:44.309587 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ac712-b649-4abb-aaee-27766dedfe09 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:53:44.319418 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 767/1536] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:53:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:53:46.362928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5acebe-4fcc-4756-9034-b6d29a9d9a23 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:46.363472 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5acebe-4fcc-4756-9034-b6d29a9d9a23 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:46.363472 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5acebe-4fcc-4756-9034-b6d29a9d9a23 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:46.364848 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 17:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:53:46.370922 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c4367-0ea2-4dc6-9fd7-60caa374f289 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:46.371399 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c4367-0ea2-4dc6-9fd7-60caa374f289 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:46.371491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c4367-0ea2-4dc6-9fd7-60caa374f289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:46.392083 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c29c4367-0ea2-4dc6-9fd7-60caa374f289 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:53:46.393334 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c29c4367-0ea2-4dc6-9fd7-60caa374f289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:53:46.402877 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 17:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:53:46.717412 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5acebe-4fcc-4756-9034-b6d29a9d9a23 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:53:46.720462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1b5acebe-4fcc-4756-9034-b6d29a9d9a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:53:46.738745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5acebe-4fcc-4756-9034-b6d29a9d9a23 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:53:46.742592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480cb1c-b5b9-41aa-a579-20b4986719fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:53:46.743206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480cb1c-b5b9-41aa-a579-20b4986719fb service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:53:46.743481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480cb1c-b5b9-41aa-a579-20b4986719fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:53:46.743752 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480cb1c-b5b9-41aa-a579-20b4986719fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:53:46.754206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480cb1c-b5b9-41aa-a579-20b4986719fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:53:46.755672 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480cb1c-b5b9-41aa-a579-20b4986719fb service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:53:46.765816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 771/1539] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:53:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:53:56.387001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=11 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:53:56.761282 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=8 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:18.325475 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753b265-6efb-4b4a-b97d-ef4d52dfe8ec None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:18.326746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753b265-6efb-4b4a-b97d-ef4d52dfe8ec None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:18.326746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753b265-6efb-4b4a-b97d-ef4d52dfe8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:18.351920 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-0753b265-6efb-4b4a-b97d-ef4d52dfe8ec None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:18.353316 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0753b265-6efb-4b4a-b97d-ef4d52dfe8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:18.371711 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 769/1540] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:18.381359 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a60a2c-e876-4e04-a3bf-e1fe3b630c3c None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:18.381990 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a60a2c-e876-4e04-a3bf-e1fe3b630c3c None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:18.381990 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a60a2c-e876-4e04-a3bf-e1fe3b630c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:18.414510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-21a60a2c-e876-4e04-a3bf-e1fe3b630c3c None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:18.415854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-21a60a2c-e876-4e04-a3bf-e1fe3b630c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:18.427620 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 772/1541] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:55:18.432385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753b265-6efb-4b4a-b97d-ef4d52dfe8ec None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:18.446868 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753b265-6efb-4b4a-b97d-ef4d52dfe8ec None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:18.454326 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73900950-1c5b-485a-b7d3-f6b9b78f823f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:18.455228 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73900950-1c5b-485a-b7d3-f6b9b78f823f admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:18.455716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73900950-1c5b-485a-b7d3-f6b9b78f823f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:18.456196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73900950-1c5b-485a-b7d3-f6b9b78f823f admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:18.457125 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73900950-1c5b-485a-b7d3-f6b9b78f823f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:55:18.457657 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73900950-1c5b-485a-b7d3-f6b9b78f823f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:18.459475 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73900950-1c5b-485a-b7d3-f6b9b78f823f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:18.475888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 770/1542] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:55:18.484191 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a60a2c-e876-4e04-a3bf-e1fe3b630c3c None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:18.503686 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a60a2c-e876-4e04-a3bf-e1fe3b630c3c None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:18.508672 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048fe66-83cd-427e-899d-6124fd293ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:18.509389 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048fe66-83cd-427e-899d-6124fd293ddc admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:18.509685 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048fe66-83cd-427e-899d-6124fd293ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:18.510004 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048fe66-83cd-427e-899d-6124fd293ddc admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:18.510616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048fe66-83cd-427e-899d-6124fd293ddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:18.512845 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048fe66-83cd-427e-899d-6124fd293ddc admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:18.580966 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 773/1543] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:18 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:18.585106 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73900950-1c5b-485a-b7d3-f6b9b78f823f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:18.599487 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73900950-1c5b-485a-b7d3-f6b9b78f823f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:18.678013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8504470-724b-4ac6-89a6-7f7dd458f394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:18.679401 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8504470-724b-4ac6-89a6-7f7dd458f394 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:18.679911 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8504470-724b-4ac6-89a6-7f7dd458f394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:18.680401 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8504470-724b-4ac6-89a6-7f7dd458f394 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:18.681557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8504470-724b-4ac6-89a6-7f7dd458f394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:18.683876 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8504470-724b-4ac6-89a6-7f7dd458f394 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:18.709757 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 771/1544] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:18 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:18.713942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048fe66-83cd-427e-899d-6124fd293ddc admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:18.731194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048fe66-83cd-427e-899d-6124fd293ddc admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:18.734856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8945a36-3e6a-4536-8332-45dcaf9525aa None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:18.735390 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8945a36-3e6a-4536-8332-45dcaf9525aa None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:18.735876 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8945a36-3e6a-4536-8332-45dcaf9525aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:18.745084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81d2fb-5aaf-4d75-8d5b-9479e51ca8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:18.745084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81d2fb-5aaf-4d75-8d5b-9479e51ca8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:18.745084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81d2fb-5aaf-4d75-8d5b-9479e51ca8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:18.745084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81d2fb-5aaf-4d75-8d5b-9479e51ca8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:18.745490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81d2fb-5aaf-4d75-8d5b-9479e51ca8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:18.745490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81d2fb-5aaf-4d75-8d5b-9479e51ca8c2 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:18.763031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 774/1545] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:55:18.763031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea157de2-e028-463e-afae-3bca34482678 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:18.763031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea157de2-e028-463e-afae-3bca34482678 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:18.763031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea157de2-e028-463e-afae-3bca34482678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:18.770384 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b8945a36-3e6a-4536-8332-45dcaf9525aa None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:18.771864 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b8945a36-3e6a-4536-8332-45dcaf9525aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:18.789220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 772/1546] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:55:18.790507 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8945a36-3e6a-4536-8332-45dcaf9525aa None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:18.802975 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8945a36-3e6a-4536-8332-45dcaf9525aa None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:18.807596 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-ea157de2-e028-463e-afae-3bca34482678 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:18.807767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ea157de2-e028-463e-afae-3bca34482678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:18.814260 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950341fe-58e4-4c8c-8d32-8b4435d0e4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:18.815197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950341fe-58e4-4c8c-8d32-8b4435d0e4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:18.815777 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950341fe-58e4-4c8c-8d32-8b4435d0e4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:18.816375 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950341fe-58e4-4c8c-8d32-8b4435d0e4a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:18.817304 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950341fe-58e4-4c8c-8d32-8b4435d0e4a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:18.819522 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950341fe-58e4-4c8c-8d32-8b4435d0e4a1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:18.820546 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 775/1547] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:18.828029 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d6f87-2d71-462a-b845-3f6ac86aab7e None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:18.828029 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d6f87-2d71-462a-b845-3f6ac86aab7e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:18.828029 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d6f87-2d71-462a-b845-3f6ac86aab7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:18.845557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 773/1548] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:18.847262 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bee3c-d35b-4a85-a2ab-4c53983d6414 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:18.847759 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bee3c-d35b-4a85-a2ab-4c53983d6414 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:18.848263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bee3c-d35b-4a85-a2ab-4c53983d6414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:18.869659 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-002d6f87-2d71-462a-b845-3f6ac86aab7e None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:18.870892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-002d6f87-2d71-462a-b845-3f6ac86aab7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:18.882731 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 776/1549] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:18.884166 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f578a-9b5b-4141-b640-4ba95d560a04 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:18.884450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f578a-9b5b-4141-b640-4ba95d560a04 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:18.884628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-721bee3c-d35b-4a85-a2ab-4c53983d6414 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:18.884744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f578a-9b5b-4141-b640-4ba95d560a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:18.886064 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-721bee3c-d35b-4a85-a2ab-4c53983d6414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:18.895109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 774/1550] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:18.895908 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bee3c-d35b-4a85-a2ab-4c53983d6414 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:18.907504 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bee3c-d35b-4a85-a2ab-4c53983d6414 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:18.909282 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-812f578a-9b5b-4141-b640-4ba95d560a04 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:18.910492 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-812f578a-9b5b-4141-b640-4ba95d560a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:18.912156 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756963e-c8ea-481d-9bc8-571dfd98b196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:18.912840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756963e-c8ea-481d-9bc8-571dfd98b196 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:18.913151 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756963e-c8ea-481d-9bc8-571dfd98b196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:18.913429 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756963e-c8ea-481d-9bc8-571dfd98b196 admin admin] PATH_INFO: `/v3/projects/9258441a9e3942738abcecda9115aab0/users/c67f233588d74a4494a0ce5f334f9e7b/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:18.919403 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 777/1551] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:18.920539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ead16-185b-407e-b18c-f52f5cf985f4 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:18.920835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ead16-185b-407e-b18c-f52f5cf985f4 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:18.921129 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ead16-185b-407e-b18c-f52f5cf985f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:18.933701 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756963e-c8ea-481d-9bc8-571dfd98b196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9258441a9e3942738abcecda9115aab0, user_id=c67f233588d74a4494a0ce5f334f9e7b, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:18.935948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: WARNING py.warnings [None req-5756963e-c8ea-481d-9bc8-571dfd98b196 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:55:18.935948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: warnings.warn(msg) Jul 28 17:55:18.935948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: Jul 28 17:55:18.938586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756963e-c8ea-481d-9bc8-571dfd98b196 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:18.947993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-f49ead16-185b-407e-b18c-f52f5cf985f4 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:18.950259 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f49ead16-185b-407e-b18c-f52f5cf985f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:18.956529 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 775/1552] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:18 2022] PUT /identity/v3/projects/9258441a9e3942738abcecda9115aab0/users/c67f233588d74a4494a0ce5f334f9e7b/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:18.957903 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07352f-cd0d-4884-b537-d476d9ca47d3 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:18.958234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07352f-cd0d-4884-b537-d476d9ca47d3 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:18.958493 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07352f-cd0d-4884-b537-d476d9ca47d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:18.979346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-da07352f-cd0d-4884-b537-d476d9ca47d3 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:18.980659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-da07352f-cd0d-4884-b537-d476d9ca47d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:19.011345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 778/1553] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:19.012400 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ead16-185b-407e-b18c-f52f5cf985f4 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:19.022465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ead16-185b-407e-b18c-f52f5cf985f4 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:19.027476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be73833-dfae-487e-944d-7a6a9b342ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:19.028249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be73833-dfae-487e-944d-7a6a9b342ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.028536 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be73833-dfae-487e-944d-7a6a9b342ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.028810 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be73833-dfae-487e-944d-7a6a9b342ec5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.029550 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be73833-dfae-487e-944d-7a6a9b342ec5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:55:19.029859 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be73833-dfae-487e-944d-7a6a9b342ec5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:19.030908 dv-cinder-813229-13-smb devstack@keystone.service[80309]: WARNING py.warnings [None req-9be73833-dfae-487e-944d-7a6a9b342ec5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:55:19.030908 dv-cinder-813229-13-smb devstack@keystone.service[80309]: warnings.warn(msg) Jul 28 17:55:19.030908 dv-cinder-813229-13-smb devstack@keystone.service[80309]: Jul 28 17:55:19.031796 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be73833-dfae-487e-944d-7a6a9b342ec5 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:19.043494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 779/1554] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:55:19.044787 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afe0f8-7783-41bb-9f6f-6335981f2c7b None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.049376 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afe0f8-7783-41bb-9f6f-6335981f2c7b None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.049533 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 776/1555] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:19.049643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afe0f8-7783-41bb-9f6f-6335981f2c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.049732 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07352f-cd0d-4884-b537-d476d9ca47d3 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:19.057920 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07352f-cd0d-4884-b537-d476d9ca47d3 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:19.063814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f26df-69d8-4b55-b1f5-a5216f70cd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:19.064450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f26df-69d8-4b55-b1f5-a5216f70cd54 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.064731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f26df-69d8-4b55-b1f5-a5216f70cd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.065004 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f26df-69d8-4b55-b1f5-a5216f70cd54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.065739 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f26df-69d8-4b55-b1f5-a5216f70cd54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:55:19.066048 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f26df-69d8-4b55-b1f5-a5216f70cd54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:19.067747 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f26df-69d8-4b55-b1f5-a5216f70cd54 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:19.069895 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-d9afe0f8-7783-41bb-9f6f-6335981f2c7b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:19.071290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-d9afe0f8-7783-41bb-9f6f-6335981f2c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:19.079509 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 780/1556] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:19.080811 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bd1a8-3330-4508-a171-0d3f6c6eb429 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.088161 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bd1a8-3330-4508-a171-0d3f6c6eb429 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.088338 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 777/1557] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:55:19.088449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bd1a8-3330-4508-a171-0d3f6c6eb429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.088551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bba98-a0fe-4368-afce-dfaa77e25a0c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.088551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bba98-a0fe-4368-afce-dfaa77e25a0c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.088551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bba98-a0fe-4368-afce-dfaa77e25a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.105770 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-411bd1a8-3330-4508-a171-0d3f6c6eb429 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:19.106138 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-809bba98-a0fe-4368-afce-dfaa77e25a0c None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:19.106979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-411bd1a8-3330-4508-a171-0d3f6c6eb429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:19.107323 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-809bba98-a0fe-4368-afce-dfaa77e25a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:19.114821 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 781/1558] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:19.116216 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e4c3f-773e-4971-8fdb-75438dd412f9 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.116506 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e4c3f-773e-4971-8fdb-75438dd412f9 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.116779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e4c3f-773e-4971-8fdb-75438dd412f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.121231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 778/1559] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:19.122922 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256002d0-4f0d-4757-a60c-08d641fb1e43 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.123865 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256002d0-4f0d-4757-a60c-08d641fb1e43 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.124147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256002d0-4f0d-4757-a60c-08d641fb1e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.131805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:19.144948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-1b9e4c3f-773e-4971-8fdb-75438dd412f9 None None] MFA Rules not processed for user `c67f233588d74a4494a0ce5f334f9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:19.145210 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-256002d0-4f0d-4757-a60c-08d641fb1e43 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:19.146564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-256002d0-4f0d-4757-a60c-08d641fb1e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:19.146690 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1b9e4c3f-773e-4971-8fdb-75438dd412f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:19.155828 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 779/1560] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:19.156596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256002d0-4f0d-4757-a60c-08d641fb1e43 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:19.166637 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256002d0-4f0d-4757-a60c-08d641fb1e43 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:19.171800 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5612a7-ebea-4da6-9fee-d7ec3fe2af6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:19.172399 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5612a7-ebea-4da6-9fee-d7ec3fe2af6c admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.172690 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5612a7-ebea-4da6-9fee-d7ec3fe2af6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.173103 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5612a7-ebea-4da6-9fee-d7ec3fe2af6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.173787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5612a7-ebea-4da6-9fee-d7ec3fe2af6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:19.174821 dv-cinder-813229-13-smb devstack@keystone.service[80310]: WARNING py.warnings [None req-9f5612a7-ebea-4da6-9fee-d7ec3fe2af6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:55:19.174821 dv-cinder-813229-13-smb devstack@keystone.service[80310]: warnings.warn(msg) Jul 28 17:55:19.174821 dv-cinder-813229-13-smb devstack@keystone.service[80310]: Jul 28 17:55:19.176004 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5612a7-ebea-4da6-9fee-d7ec3fe2af6c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:19.204913 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 780/1561] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:19 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:19.206342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2b06f-145b-4273-becd-7303afa9fc70 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.206633 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2b06f-145b-4273-becd-7303afa9fc70 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.206909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2b06f-145b-4273-becd-7303afa9fc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.208278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:19.218672 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 782/1562] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:19.224536 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240320a-581d-420f-b2c7-c14dadb45035 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.224739 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240320a-581d-420f-b2c7-c14dadb45035 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.225025 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240320a-581d-420f-b2c7-c14dadb45035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.228474 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-04f2b06f-145b-4273-becd-7303afa9fc70 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:19.229706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-04f2b06f-145b-4273-becd-7303afa9fc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:19.246701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-7240320a-581d-420f-b2c7-c14dadb45035 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:19.248007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-7240320a-581d-420f-b2c7-c14dadb45035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:19.303150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 781/1563] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:19.306375 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2b06f-145b-4273-becd-7303afa9fc70 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:19.309906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 783/1564] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:19.310749 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240320a-581d-420f-b2c7-c14dadb45035 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:19.316295 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2b06f-145b-4273-becd-7303afa9fc70 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:19.321883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe750ed8-8049-4c5e-bd80-abb743a70689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:19.322440 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe750ed8-8049-4c5e-bd80-abb743a70689 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.322680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240320a-581d-420f-b2c7-c14dadb45035 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:19.322788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe750ed8-8049-4c5e-bd80-abb743a70689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.322950 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe750ed8-8049-4c5e-bd80-abb743a70689 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.323716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe750ed8-8049-4c5e-bd80-abb743a70689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:19.325735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe750ed8-8049-4c5e-bd80-abb743a70689 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:19.327309 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a4101-c3e3-449d-8822-e9c361ccd2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:19.327911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a4101-c3e3-449d-8822-e9c361ccd2ba admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.328190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a4101-c3e3-449d-8822-e9c361ccd2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.328462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a4101-c3e3-449d-8822-e9c361ccd2ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.329260 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a4101-c3e3-449d-8822-e9c361ccd2ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:55:19.329571 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a4101-c3e3-449d-8822-e9c361ccd2ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:19.331159 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a4101-c3e3-449d-8822-e9c361ccd2ba admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:19.343241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 784/1565] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:55:19.351074 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb48775-0042-4883-8eac-91987c8f40d5 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.351074 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb48775-0042-4883-8eac-91987c8f40d5 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.351074 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb48775-0042-4883-8eac-91987c8f40d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.359146 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 782/1566] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:19 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:19.359146 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe750ed8-8049-4c5e-bd80-abb743a70689 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:19.371911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-8eb48775-0042-4883-8eac-91987c8f40d5 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:19.373138 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-8eb48775-0042-4883-8eac-91987c8f40d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:19.421604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe750ed8-8049-4c5e-bd80-abb743a70689 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:19.426305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b0ee5-7c8a-4c10-8b85-5cff002e76eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:19.426930 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b0ee5-7c8a-4c10-8b85-5cff002e76eb admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.427207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b0ee5-7c8a-4c10-8b85-5cff002e76eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.427484 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b0ee5-7c8a-4c10-8b85-5cff002e76eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.428172 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b0ee5-7c8a-4c10-8b85-5cff002e76eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:55:19.428474 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b0ee5-7c8a-4c10-8b85-5cff002e76eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:19.430116 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b0ee5-7c8a-4c10-8b85-5cff002e76eb admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:19.438765 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 785/1567] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:19.439568 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb48775-0042-4883-8eac-91987c8f40d5 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:19.441736 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 783/1568] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:55:19.442854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb9dcd-b0d7-4249-ad79-eb0b5effab5a None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.443139 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb9dcd-b0d7-4249-ad79-eb0b5effab5a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.443414 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb9dcd-b0d7-4249-ad79-eb0b5effab5a None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.444605 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 784/1569] 10.222.0.96 () {54 vars in 962 bytes} [Thu Jul 28 17:55:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:55:19.445312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb9dcd-b0d7-4249-ad79-eb0b5effab5a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:19.453610 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb48775-0042-4883-8eac-91987c8f40d5 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:19.457993 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb9dcd-b0d7-4249-ad79-eb0b5effab5a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:19.458230 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053c301-3036-4d25-97db-0381394d2f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:19.458851 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053c301-3036-4d25-97db-0381394d2f5e admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.459132 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053c301-3036-4d25-97db-0381394d2f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.459408 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053c301-3036-4d25-97db-0381394d2f5e admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.460090 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053c301-3036-4d25-97db-0381394d2f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:19.461161 dv-cinder-813229-13-smb devstack@keystone.service[80309]: WARNING py.warnings [None req-8053c301-3036-4d25-97db-0381394d2f5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:55:19.461161 dv-cinder-813229-13-smb devstack@keystone.service[80309]: warnings.warn(msg) Jul 28 17:55:19.461161 dv-cinder-813229-13-smb devstack@keystone.service[80309]: Jul 28 17:55:19.462647 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053c301-3036-4d25-97db-0381394d2f5e admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:19.463129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091a23e-66f8-416b-a2ec-32ed0a00cb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:19.463738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091a23e-66f8-416b-a2ec-32ed0a00cb1c admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.464017 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091a23e-66f8-416b-a2ec-32ed0a00cb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.464291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091a23e-66f8-416b-a2ec-32ed0a00cb1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.464974 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091a23e-66f8-416b-a2ec-32ed0a00cb1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:55:19.465314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091a23e-66f8-416b-a2ec-32ed0a00cb1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:19.466932 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091a23e-66f8-416b-a2ec-32ed0a00cb1c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:19.480993 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 785/1570] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:55:19.481941 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091a23e-66f8-416b-a2ec-32ed0a00cb1c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:19.490123 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 786/1571] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:19 2022] POST /identity/v3/users => generated 290 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:19.491078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053c301-3036-4d25-97db-0381394d2f5e admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:19.498130 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091a23e-66f8-416b-a2ec-32ed0a00cb1c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:19.502306 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053c301-3036-4d25-97db-0381394d2f5e admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:19.505157 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ecf76-8c87-420c-bd34-7388872cb90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:19.505777 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ecf76-8c87-420c-bd34-7388872cb90c admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.506055 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ecf76-8c87-420c-bd34-7388872cb90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.506328 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ecf76-8c87-420c-bd34-7388872cb90c admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.507008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ecf76-8c87-420c-bd34-7388872cb90c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:55:19.507312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ecf76-8c87-420c-bd34-7388872cb90c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:19.508917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ecf76-8c87-420c-bd34-7388872cb90c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:19.512311 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2fa03-207d-406f-ac40-a964b2347943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:19.512976 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2fa03-207d-406f-ac40-a964b2347943 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.513287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2fa03-207d-406f-ac40-a964b2347943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.513607 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2fa03-207d-406f-ac40-a964b2347943 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.514302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2fa03-207d-406f-ac40-a964b2347943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:19.516257 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2fa03-207d-406f-ac40-a964b2347943 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:19.521390 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 786/1572] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:55:19.522236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ecf76-8c87-420c-bd34-7388872cb90c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:19.533512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ecf76-8c87-420c-bd34-7388872cb90c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:19.538896 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72fece-ff66-4fc2-9e5d-9bff89e2ee70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:19.539563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72fece-ff66-4fc2-9e5d-9bff89e2ee70 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.539835 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72fece-ff66-4fc2-9e5d-9bff89e2ee70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.540197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72fece-ff66-4fc2-9e5d-9bff89e2ee70 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.540971 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72fece-ff66-4fc2-9e5d-9bff89e2ee70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:19.542948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72fece-ff66-4fc2-9e5d-9bff89e2ee70 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:19.547652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 787/1573] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:19 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:19.547652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2fa03-207d-406f-ac40-a964b2347943 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:19.565151 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 787/1574] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:19 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:19.565950 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72fece-ff66-4fc2-9e5d-9bff89e2ee70 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:19.570669 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:19.576046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72fece-ff66-4fc2-9e5d-9bff89e2ee70 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:19.596686 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:19.616444 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2fa03-207d-406f-ac40-a964b2347943 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:19.621488 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da9f41-30f4-4fb7-8e9b-c884ae09333d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:19.622139 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da9f41-30f4-4fb7-8e9b-c884ae09333d admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.622413 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da9f41-30f4-4fb7-8e9b-c884ae09333d admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.622655 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da9f41-30f4-4fb7-8e9b-c884ae09333d admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.623677 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da9f41-30f4-4fb7-8e9b-c884ae09333d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:55:19.623970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da9f41-30f4-4fb7-8e9b-c884ae09333d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:19.625652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da9f41-30f4-4fb7-8e9b-c884ae09333d admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:19.635890 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498876a-84bf-434b-bfcc-772e4f63b0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:19.636531 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498876a-84bf-434b-bfcc-772e4f63b0e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.636814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498876a-84bf-434b-bfcc-772e4f63b0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.637121 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498876a-84bf-434b-bfcc-772e4f63b0e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.637604 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 788/1575] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:55:19.637821 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498876a-84bf-434b-bfcc-772e4f63b0e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:19.638854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90880d78-548d-4048-89a5-78eae0562dbe None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.639134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90880d78-548d-4048-89a5-78eae0562dbe None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.639405 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90880d78-548d-4048-89a5-78eae0562dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.639877 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498876a-84bf-434b-bfcc-772e4f63b0e1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:19.670317 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 788/1576] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:19 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:19.671635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498876a-84bf-434b-bfcc-772e4f63b0e1 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:19.678800 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-90880d78-548d-4048-89a5-78eae0562dbe None None] MFA Rules not processed for user `5ac367247aa54671ae5c33d251017470`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:19.680142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-90880d78-548d-4048-89a5-78eae0562dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:19.736956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498876a-84bf-434b-bfcc-772e4f63b0e1 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:19.742297 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057221f-184f-4864-994d-01fb948b1577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:19.742948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057221f-184f-4864-994d-01fb948b1577 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.743305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057221f-184f-4864-994d-01fb948b1577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.743751 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057221f-184f-4864-994d-01fb948b1577 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.744404 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057221f-184f-4864-994d-01fb948b1577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:19.746966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057221f-184f-4864-994d-01fb948b1577 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:19.751344 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 789/1577] 10.222.0.96 () {58 vars in 1059 bytes} [Thu Jul 28 17:55:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:19.752612 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90880d78-548d-4048-89a5-78eae0562dbe None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:19.764451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90880d78-548d-4048-89a5-78eae0562dbe None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:19.770289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c82b9-94a3-4b7c-92de-f474a7a124e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:19.770994 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c82b9-94a3-4b7c-92de-f474a7a124e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.771277 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c82b9-94a3-4b7c-92de-f474a7a124e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.771567 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c82b9-94a3-4b7c-92de-f474a7a124e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.772293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c82b9-94a3-4b7c-92de-f474a7a124e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:19.773988 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c82b9-94a3-4b7c-92de-f474a7a124e4 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:19.780206 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 789/1578] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:19 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:19.780206 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057221f-184f-4864-994d-01fb948b1577 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:19.787007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 790/1579] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:19.788050 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c82b9-94a3-4b7c-92de-f474a7a124e4 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:19.799084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c82b9-94a3-4b7c-92de-f474a7a124e4 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:19.841499 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057221f-184f-4864-994d-01fb948b1577 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:19.846432 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919caeb9-3afb-4274-a8ba-0023c6b686b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:19.847056 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919caeb9-3afb-4274-a8ba-0023c6b686b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.847332 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919caeb9-3afb-4274-a8ba-0023c6b686b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.847603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919caeb9-3afb-4274-a8ba-0023c6b686b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.848290 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919caeb9-3afb-4274-a8ba-0023c6b686b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:19.850224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919caeb9-3afb-4274-a8ba-0023c6b686b1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:19.859009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480bfe8-3530-4d24-9155-d56a1fc59be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:19.859636 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480bfe8-3530-4d24-9155-d56a1fc59be9 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.859918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480bfe8-3530-4d24-9155-d56a1fc59be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.860552 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480bfe8-3530-4d24-9155-d56a1fc59be9 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.860858 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480bfe8-3530-4d24-9155-d56a1fc59be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:19.862861 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480bfe8-3530-4d24-9155-d56a1fc59be9 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:19.875550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:19.883662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 790/1580] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:19 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:19.888453 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 791/1581] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:19 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:19.888453 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480bfe8-3530-4d24-9155-d56a1fc59be9 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:19.888710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919caeb9-3afb-4274-a8ba-0023c6b686b1 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:19.898311 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480bfe8-3530-4d24-9155-d56a1fc59be9 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:19.936982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:19.953498 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919caeb9-3afb-4274-a8ba-0023c6b686b1 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:19.958937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b59f9-67c8-4a3c-98f9-55120088e8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:19.960276 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b59f9-67c8-4a3c-98f9-55120088e8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.960607 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b59f9-67c8-4a3c-98f9-55120088e8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.960824 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b59f9-67c8-4a3c-98f9-55120088e8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.961559 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b59f9-67c8-4a3c-98f9-55120088e8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:19.963282 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b59f9-67c8-4a3c-98f9-55120088e8f2 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:19.965399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c3459-7918-4470-a48a-9fe207da053a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:19.966024 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c3459-7918-4470-a48a-9fe207da053a admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.966301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c3459-7918-4470-a48a-9fe207da053a admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.966576 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c3459-7918-4470-a48a-9fe207da053a admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.967415 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c3459-7918-4470-a48a-9fe207da053a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:19.969326 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c3459-7918-4470-a48a-9fe207da053a admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:19.973610 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 791/1582] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:19.974421 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b59f9-67c8-4a3c-98f9-55120088e8f2 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:19.984219 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b59f9-67c8-4a3c-98f9-55120088e8f2 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:19.988875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812955a6-b1f4-4220-8891-ba2560fbafff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:19.989522 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812955a6-b1f4-4220-8891-ba2560fbafff admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:19.989798 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812955a6-b1f4-4220-8891-ba2560fbafff admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:19.990069 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812955a6-b1f4-4220-8891-ba2560fbafff admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:19.990796 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812955a6-b1f4-4220-8891-ba2560fbafff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:19.993162 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812955a6-b1f4-4220-8891-ba2560fbafff admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.005144 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 792/1583] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:19 2022] POST /identity/v3/projects => generated 391 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:20.006063 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c3459-7918-4470-a48a-9fe207da053a admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.025861 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 792/1584] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:19 2022] POST /identity/v3/users => generated 288 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:20.026701 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812955a6-b1f4-4220-8891-ba2560fbafff admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.037301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812955a6-b1f4-4220-8891-ba2560fbafff admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.080554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c3459-7918-4470-a48a-9fe207da053a admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.087365 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1f457-63a4-4357-9489-3b2b6ef22731 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.088195 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1f457-63a4-4357-9489-3b2b6ef22731 service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.088491 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1f457-63a4-4357-9489-3b2b6ef22731 service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.088795 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1f457-63a4-4357-9489-3b2b6ef22731 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.094480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca40c3a-bb9c-4c28-82c2-11e908d3109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.095109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca40c3a-bb9c-4c28-82c2-11e908d3109d admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.095390 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca40c3a-bb9c-4c28-82c2-11e908d3109d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.095663 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca40c3a-bb9c-4c28-82c2-11e908d3109d admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.096328 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca40c3a-bb9c-4c28-82c2-11e908d3109d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.098310 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca40c3a-bb9c-4c28-82c2-11e908d3109d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.121013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 793/1585] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:20 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:20.121986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca40c3a-bb9c-4c28-82c2-11e908d3109d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.132010 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca40c3a-bb9c-4c28-82c2-11e908d3109d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.137596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5caf0-f087-4309-8bb5-fc28bc2428b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.138177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5caf0-f087-4309-8bb5-fc28bc2428b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.138459 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5caf0-f087-4309-8bb5-fc28bc2428b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.138758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5caf0-f087-4309-8bb5-fc28bc2428b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.139480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5caf0-f087-4309-8bb5-fc28bc2428b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.141113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5caf0-f087-4309-8bb5-fc28bc2428b5 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.151250 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1f457-63a4-4357-9489-3b2b6ef22731 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.153200 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1f457-63a4-4357-9489-3b2b6ef22731 service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.153643 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 794/1586] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:20.154576 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5caf0-f087-4309-8bb5-fc28bc2428b5 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.164748 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5caf0-f087-4309-8bb5-fc28bc2428b5 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.167074 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 793/1587] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:20.167963 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1f457-63a4-4357-9489-3b2b6ef22731 service nova] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.171448 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127b488-d366-48d6-a785-825f4257e555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.172116 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127b488-d366-48d6-a785-825f4257e555 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.172351 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127b488-d366-48d6-a785-825f4257e555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.172650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127b488-d366-48d6-a785-825f4257e555 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.173376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127b488-d366-48d6-a785-825f4257e555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.175277 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127b488-d366-48d6-a785-825f4257e555 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.179026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1f457-63a4-4357-9489-3b2b6ef22731 service nova] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.185106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4292835-1d40-41f8-bedf-8011f22dc347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.185424 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4292835-1d40-41f8-bedf-8011f22dc347 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.186087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4292835-1d40-41f8-bedf-8011f22dc347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.186087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4292835-1d40-41f8-bedf-8011f22dc347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.187048 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4292835-1d40-41f8-bedf-8011f22dc347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.188647 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4292835-1d40-41f8-bedf-8011f22dc347 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.199186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 795/1588] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:20 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:20.199957 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127b488-d366-48d6-a785-825f4257e555 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.206539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 794/1589] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:20.206539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4292835-1d40-41f8-bedf-8011f22dc347 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.210604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127b488-d366-48d6-a785-825f4257e555 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.216983 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4292835-1d40-41f8-bedf-8011f22dc347 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.217777 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a1e31-4299-44ac-83b7-9b8de47d6f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.218395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a1e31-4299-44ac-83b7-9b8de47d6f7a admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.218677 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a1e31-4299-44ac-83b7-9b8de47d6f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.219012 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a1e31-4299-44ac-83b7-9b8de47d6f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.219635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a1e31-4299-44ac-83b7-9b8de47d6f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.221469 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a1e31-4299-44ac-83b7-9b8de47d6f7a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.222324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df194aa6-684d-478b-8590-c20c4461f099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.223010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df194aa6-684d-478b-8590-c20c4461f099 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.223351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df194aa6-684d-478b-8590-c20c4461f099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.223687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df194aa6-684d-478b-8590-c20c4461f099 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.224401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df194aa6-684d-478b-8590-c20c4461f099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.226393 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df194aa6-684d-478b-8590-c20c4461f099 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.232845 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 796/1590] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:20.233620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a1e31-4299-44ac-83b7-9b8de47d6f7a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.245836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a1e31-4299-44ac-83b7-9b8de47d6f7a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.252881 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fae97b-38a9-4b6f-a0ef-e1e530ef31f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.253597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fae97b-38a9-4b6f-a0ef-e1e530ef31f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.253870 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fae97b-38a9-4b6f-a0ef-e1e530ef31f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.254134 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fae97b-38a9-4b6f-a0ef-e1e530ef31f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.254810 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fae97b-38a9-4b6f-a0ef-e1e530ef31f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.256183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 795/1591] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:20 2022] POST /identity/v3/users => generated 296 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:20.256387 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fae97b-38a9-4b6f-a0ef-e1e530ef31f3 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.257381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df194aa6-684d-478b-8590-c20c4461f099 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.267714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 797/1592] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:20.268362 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fae97b-38a9-4b6f-a0ef-e1e530ef31f3 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.270965 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df194aa6-684d-478b-8590-c20c4461f099 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.277492 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4c569-fdf3-443d-a9a5-d27a4eb2b2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.278131 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fae97b-38a9-4b6f-a0ef-e1e530ef31f3 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.278546 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4c569-fdf3-443d-a9a5-d27a4eb2b2bf admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.279284 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4c569-fdf3-443d-a9a5-d27a4eb2b2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.279817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4c569-fdf3-443d-a9a5-d27a4eb2b2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.280846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4c569-fdf3-443d-a9a5-d27a4eb2b2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.283002 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b89ce6-d730-4ae6-b682-b794e9c0e02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.283284 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4c569-fdf3-443d-a9a5-d27a4eb2b2bf admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.283640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b89ce6-d730-4ae6-b682-b794e9c0e02d admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.283917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b89ce6-d730-4ae6-b682-b794e9c0e02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.284183 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b89ce6-d730-4ae6-b682-b794e9c0e02d admin admin] PATH_INFO: `/v3/projects/a98ccbc115bc4658985507916f080cfe/users/6aa21660ef2e496a908472dcd7d201cf/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.296606 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:20.299699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 796/1593] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:20.300806 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4c569-fdf3-443d-a9a5-d27a4eb2b2bf admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.302300 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b89ce6-d730-4ae6-b682-b794e9c0e02d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98ccbc115bc4658985507916f080cfe, user_id=6aa21660ef2e496a908472dcd7d201cf, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.305521 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b89ce6-d730-4ae6-b682-b794e9c0e02d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.316157 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4c569-fdf3-443d-a9a5-d27a4eb2b2bf admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.323239 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 798/1594] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:20 2022] PUT /identity/v3/projects/a98ccbc115bc4658985507916f080cfe/users/6aa21660ef2e496a908472dcd7d201cf/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:20.324039 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b89ce6-d730-4ae6-b682-b794e9c0e02d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.340916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:20.389053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b89ce6-d730-4ae6-b682-b794e9c0e02d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.393954 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487cd4a-2d5c-4a9a-8f1f-1cb9f47ffa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.394679 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487cd4a-2d5c-4a9a-8f1f-1cb9f47ffa72 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.395027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487cd4a-2d5c-4a9a-8f1f-1cb9f47ffa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.395488 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487cd4a-2d5c-4a9a-8f1f-1cb9f47ffa72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.396241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487cd4a-2d5c-4a9a-8f1f-1cb9f47ffa72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.398365 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487cd4a-2d5c-4a9a-8f1f-1cb9f47ffa72 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.401781 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3ebd4-fd49-4584-af8e-b389098b6c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.402407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3ebd4-fd49-4584-af8e-b389098b6c94 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.402687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3ebd4-fd49-4584-af8e-b389098b6c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.402963 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3ebd4-fd49-4584-af8e-b389098b6c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.403655 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3ebd4-fd49-4584-af8e-b389098b6c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.405279 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3ebd4-fd49-4584-af8e-b389098b6c94 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.413575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 799/1595] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:20.414515 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487cd4a-2d5c-4a9a-8f1f-1cb9f47ffa72 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.416888 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 797/1596] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:20.416888 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3ebd4-fd49-4584-af8e-b389098b6c94 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.426185 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487cd4a-2d5c-4a9a-8f1f-1cb9f47ffa72 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.428747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3ebd4-fd49-4584-af8e-b389098b6c94 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.431040 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cc50f-f29e-4903-bdff-5c0c65c4a7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.431785 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cc50f-f29e-4903-bdff-5c0c65c4a7cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.432129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cc50f-f29e-4903-bdff-5c0c65c4a7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.432470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cc50f-f29e-4903-bdff-5c0c65c4a7cd admin admin] PATH_INFO: `/v3/projects/af7e6cfc595f441db9cc6223083c792a/users/d10fb0f5ce9544048f9656ae535bac77/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.433687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c36494-d8ce-46d4-ad4b-a4b5906b2f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.434297 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c36494-d8ce-46d4-ad4b-a4b5906b2f14 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.434579 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c36494-d8ce-46d4-ad4b-a4b5906b2f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.434854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c36494-d8ce-46d4-ad4b-a4b5906b2f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.435541 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c36494-d8ce-46d4-ad4b-a4b5906b2f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.437175 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c36494-d8ce-46d4-ad4b-a4b5906b2f14 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.447521 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 798/1597] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:20.448273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cc50f-f29e-4903-bdff-5c0c65c4a7cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=af7e6cfc595f441db9cc6223083c792a, user_id=d10fb0f5ce9544048f9656ae535bac77, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.448381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c36494-d8ce-46d4-ad4b-a4b5906b2f14 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.450527 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cc50f-f29e-4903-bdff-5c0c65c4a7cd admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.458796 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c36494-d8ce-46d4-ad4b-a4b5906b2f14 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.466021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 800/1598] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:20 2022] PUT /identity/v3/projects/af7e6cfc595f441db9cc6223083c792a/users/d10fb0f5ce9544048f9656ae535bac77/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:20.473963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cc50f-f29e-4903-bdff-5c0c65c4a7cd admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.517236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0143afa-3ee3-4e67-8301-fec166a801d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.517733 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0143afa-3ee3-4e67-8301-fec166a801d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.518190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0143afa-3ee3-4e67-8301-fec166a801d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.519052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0143afa-3ee3-4e67-8301-fec166a801d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.519245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0143afa-3ee3-4e67-8301-fec166a801d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.520948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0143afa-3ee3-4e67-8301-fec166a801d7 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.534951 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 799/1599] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:20.534951 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa046efb-8bf1-4ef3-a609-5e3ff4092033 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.534951 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa046efb-8bf1-4ef3-a609-5e3ff4092033 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.534951 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa046efb-8bf1-4ef3-a609-5e3ff4092033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.541453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cc50f-f29e-4903-bdff-5c0c65c4a7cd admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.546021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be3b35-f206-4893-9f0b-b2ba971fc0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.546646 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be3b35-f206-4893-9f0b-b2ba971fc0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.546926 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be3b35-f206-4893-9f0b-b2ba971fc0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.547198 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be3b35-f206-4893-9f0b-b2ba971fc0a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.547891 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be3b35-f206-4893-9f0b-b2ba971fc0a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.549562 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be3b35-f206-4893-9f0b-b2ba971fc0a6 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.559605 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 801/1600] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:20.560962 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-aa046efb-8bf1-4ef3-a609-5e3ff4092033 None None] MFA Rules not processed for user `6aa21660ef2e496a908472dcd7d201cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:20.562298 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-aa046efb-8bf1-4ef3-a609-5e3ff4092033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:20.563683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be3b35-f206-4893-9f0b-b2ba971fc0a6 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.573088 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be3b35-f206-4893-9f0b-b2ba971fc0a6 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.577748 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad94d8-cab5-45ed-9e1c-c24b860c17e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.578632 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad94d8-cab5-45ed-9e1c-c24b860c17e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.579106 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad94d8-cab5-45ed-9e1c-c24b860c17e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.579389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad94d8-cab5-45ed-9e1c-c24b860c17e9 admin admin] PATH_INFO: `/v3/projects/e425fa77bd3143ddb6b6d10888c2ff51/users/d2a83fb7509446c3a342ea635eccf04d/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.595962 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad94d8-cab5-45ed-9e1c-c24b860c17e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e425fa77bd3143ddb6b6d10888c2ff51, user_id=d2a83fb7509446c3a342ea635eccf04d, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.598753 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad94d8-cab5-45ed-9e1c-c24b860c17e9 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.613950 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 802/1601] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:20 2022] PUT /identity/v3/projects/e425fa77bd3143ddb6b6d10888c2ff51/users/d2a83fb7509446c3a342ea635eccf04d/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:20.614912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad94d8-cab5-45ed-9e1c-c24b860c17e9 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.631016 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 800/1602] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:20.632311 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aa69e-e797-46e8-81bf-d2dfd32197e0 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.632587 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aa69e-e797-46e8-81bf-d2dfd32197e0 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.632854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aa69e-e797-46e8-81bf-d2dfd32197e0 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.634352 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 801/1603] 10.222.0.96 () {54 vars in 912 bytes} [Thu Jul 28 17:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:55:20.635303 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aa69e-e797-46e8-81bf-d2dfd32197e0 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.658899 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:20.667581 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:20.683267 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad94d8-cab5-45ed-9e1c-c24b860c17e9 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.688248 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc258d0c-dd6e-44a8-b252-2b4adb731561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.688875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc258d0c-dd6e-44a8-b252-2b4adb731561 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.689187 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc258d0c-dd6e-44a8-b252-2b4adb731561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.689467 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc258d0c-dd6e-44a8-b252-2b4adb731561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.690153 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc258d0c-dd6e-44a8-b252-2b4adb731561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.691792 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc258d0c-dd6e-44a8-b252-2b4adb731561 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.700852 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aa69e-e797-46e8-81bf-d2dfd32197e0 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.702364 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 803/1604] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:20.703664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e7033-d219-4923-ae72-6df3d57e1478 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.703955 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e7033-d219-4923-ae72-6df3d57e1478 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.704232 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e7033-d219-4923-ae72-6df3d57e1478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.708834 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f00f8-d0cc-494f-a5cf-591bbb685a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.709503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f00f8-d0cc-494f-a5cf-591bbb685a7d admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.709780 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f00f8-d0cc-494f-a5cf-591bbb685a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.710053 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f00f8-d0cc-494f-a5cf-591bbb685a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.710749 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f00f8-d0cc-494f-a5cf-591bbb685a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.712411 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f00f8-d0cc-494f-a5cf-591bbb685a7d admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.723489 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 802/1605] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:20.724282 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f00f8-d0cc-494f-a5cf-591bbb685a7d admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.735005 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f00f8-d0cc-494f-a5cf-591bbb685a7d admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.736356 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-227e7033-d219-4923-ae72-6df3d57e1478 None None] MFA Rules not processed for user `d10fb0f5ce9544048f9656ae535bac77`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:20.737678 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-227e7033-d219-4923-ae72-6df3d57e1478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:20.739950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84c162-f1f2-4d3c-b9b7-b08b2399e2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.740602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84c162-f1f2-4d3c-b9b7-b08b2399e2d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.740885 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84c162-f1f2-4d3c-b9b7-b08b2399e2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.741190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84c162-f1f2-4d3c-b9b7-b08b2399e2d7 admin admin] PATH_INFO: `/v3/projects/2e1fd1bc330e40dbb045325e7253383c/users/389aed9a73184c6da0107fd2c18f4d71/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.756617 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84c162-f1f2-4d3c-b9b7-b08b2399e2d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1fd1bc330e40dbb045325e7253383c, user_id=389aed9a73184c6da0107fd2c18f4d71, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.759475 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84c162-f1f2-4d3c-b9b7-b08b2399e2d7 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.773716 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 803/1606] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:20 2022] PUT /identity/v3/projects/2e1fd1bc330e40dbb045325e7253383c/users/389aed9a73184c6da0107fd2c18f4d71/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:20.774577 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84c162-f1f2-4d3c-b9b7-b08b2399e2d7 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.814742 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 804/1607] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:20.816225 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90373063-e864-48ab-9e7f-97905db3ecf9 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.816347 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90373063-e864-48ab-9e7f-97905db3ecf9 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.816553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90373063-e864-48ab-9e7f-97905db3ecf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.838597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-90373063-e864-48ab-9e7f-97905db3ecf9 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:20.838783 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84c162-f1f2-4d3c-b9b7-b08b2399e2d7 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.839806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-90373063-e864-48ab-9e7f-97905db3ecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:20.843895 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da51827-cca5-49c5-bd37-e99b77250744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.844576 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da51827-cca5-49c5-bd37-e99b77250744 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.844860 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da51827-cca5-49c5-bd37-e99b77250744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.845192 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da51827-cca5-49c5-bd37-e99b77250744 admin admin] PATH_INFO: `/v3/projects/b6ee8a2c8c3a45db840ef797597e3d82/users/281f0535eb1543aeb731200585fe4998/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.847633 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 805/1608] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:20.848432 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90373063-e864-48ab-9e7f-97905db3ecf9 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.859789 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90373063-e864-48ab-9e7f-97905db3ecf9 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.864462 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6af292-2b65-4527-bc5f-1e3539d73edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.865134 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6af292-2b65-4527-bc5f-1e3539d73edb admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.865421 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6af292-2b65-4527-bc5f-1e3539d73edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.865699 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6af292-2b65-4527-bc5f-1e3539d73edb admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.866129 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da51827-cca5-49c5-bd37-e99b77250744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ee8a2c8c3a45db840ef797597e3d82, user_id=281f0535eb1543aeb731200585fe4998, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.866390 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6af292-2b65-4527-bc5f-1e3539d73edb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.868669 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6af292-2b65-4527-bc5f-1e3539d73edb admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.869288 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da51827-cca5-49c5-bd37-e99b77250744 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.883534 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 804/1609] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:20 2022] PUT /identity/v3/projects/b6ee8a2c8c3a45db840ef797597e3d82/users/281f0535eb1543aeb731200585fe4998/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:20.884950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b18ec-97fd-4570-95a5-c798b6e17ea1 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.885397 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b18ec-97fd-4570-95a5-c798b6e17ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.885801 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b18ec-97fd-4570-95a5-c798b6e17ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.904399 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 806/1610] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:20 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:20.904399 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6af292-2b65-4527-bc5f-1e3539d73edb admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.909163 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-4b2b18ec-97fd-4570-95a5-c798b6e17ea1 None None] MFA Rules not processed for user `5ac367247aa54671ae5c33d251017470`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:20.910417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-4b2b18ec-97fd-4570-95a5-c798b6e17ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:20.966977 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6af292-2b65-4527-bc5f-1e3539d73edb admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.971878 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacb864-28ea-4586-80c2-cf88c9414af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.972556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacb864-28ea-4586-80c2-cf88c9414af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.972836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacb864-28ea-4586-80c2-cf88c9414af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.973140 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacb864-28ea-4586-80c2-cf88c9414af1 admin admin] PATH_INFO: `/v3/projects/4488dea1ea244c5da3033646031190de/users/7fe1bb900c544286ba2fbed4f1d8c066/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:20.979267 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 805/1611] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Jul 28 17:55:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:20.980293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b18ec-97fd-4570-95a5-c798b6e17ea1 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:20.988707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eacb864-28ea-4586-80c2-cf88c9414af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4488dea1ea244c5da3033646031190de, user_id=7fe1bb900c544286ba2fbed4f1d8c066, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:20.991312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eacb864-28ea-4586-80c2-cf88c9414af1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:20.992091 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b18ec-97fd-4570-95a5-c798b6e17ea1 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:20.997552 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de29b8-05e6-471f-8fef-c2fdf03d52c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:20.998700 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de29b8-05e6-471f-8fef-c2fdf03d52c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:20.998955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de29b8-05e6-471f-8fef-c2fdf03d52c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:20.999212 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de29b8-05e6-471f-8fef-c2fdf03d52c6 admin admin] PATH_INFO: `/v3/projects/9f0a46d163314f88846586f1ea333019/users/6f0d7343fee749b89293973a422c22a6/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:21.006084 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 807/1612] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:20 2022] PUT /identity/v3/projects/4488dea1ea244c5da3033646031190de/users/7fe1bb900c544286ba2fbed4f1d8c066/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:21.007481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78c73e-e786-4232-bb0a-f9968e9691f2 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:21.007905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78c73e-e786-4232-bb0a-f9968e9691f2 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:21.008327 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78c73e-e786-4232-bb0a-f9968e9691f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:21.014144 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:21.017483 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de29b8-05e6-471f-8fef-c2fdf03d52c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f0a46d163314f88846586f1ea333019, user_id=6f0d7343fee749b89293973a422c22a6, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:21.020555 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de29b8-05e6-471f-8fef-c2fdf03d52c6 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:21.037002 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 806/1613] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:20 2022] PUT /identity/v3/projects/9f0a46d163314f88846586f1ea333019/users/6f0d7343fee749b89293973a422c22a6/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:21.038377 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc5b42-dbea-4377-95bb-571b5795c4a3 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:21.038799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc5b42-dbea-4377-95bb-571b5795c4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:21.039075 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc5b42-dbea-4377-95bb-571b5795c4a3 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:21.040833 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 807/1614] 10.222.0.96 () {54 vars in 962 bytes} [Thu Jul 28 17:55:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:55:21.041792 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc5b42-dbea-4377-95bb-571b5795c4a3 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:21.043811 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-06fc5b42-dbea-4377-95bb-571b5795c4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:21.044067 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7c78c73e-e786-4232-bb0a-f9968e9691f2 None None] MFA Rules not processed for user `389aed9a73184c6da0107fd2c18f4d71`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:21.045322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7c78c73e-e786-4232-bb0a-f9968e9691f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:21.049291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:21.109448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc5b42-dbea-4377-95bb-571b5795c4a3 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:21.113832 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c900c-0652-4cc4-8f1e-4c6ca064a7b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:21.114453 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c900c-0652-4cc4-8f1e-4c6ca064a7b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:21.114734 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c900c-0652-4cc4-8f1e-4c6ca064a7b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:21.115009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c900c-0652-4cc4-8f1e-4c6ca064a7b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:21.116382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 808/1615] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:21.117649 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd179dda-3279-4565-88e4-06c9a5a94bee None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:21.117938 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd179dda-3279-4565-88e4-06c9a5a94bee None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:21.118414 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd179dda-3279-4565-88e4-06c9a5a94bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:21.147764 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-fd179dda-3279-4565-88e4-06c9a5a94bee None None] MFA Rules not processed for user `281f0535eb1543aeb731200585fe4998`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:21.148990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fd179dda-3279-4565-88e4-06c9a5a94bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:21.182950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c900c-0652-4cc4-8f1e-4c6ca064a7b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:21.184325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c900c-0652-4cc4-8f1e-4c6ca064a7b7 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:21.194060 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 808/1616] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:21.194876 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c900c-0652-4cc4-8f1e-4c6ca064a7b7 service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:21.204429 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c900c-0652-4cc4-8f1e-4c6ca064a7b7 service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:21.209542 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bc5fa-775a-4f84-8a10-1e1c758dec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:21.210179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bc5fa-775a-4f84-8a10-1e1c758dec9e admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:21.210514 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bc5fa-775a-4f84-8a10-1e1c758dec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:21.210791 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bc5fa-775a-4f84-8a10-1e1c758dec9e admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:21.211468 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bc5fa-775a-4f84-8a10-1e1c758dec9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:21.213514 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bc5fa-775a-4f84-8a10-1e1c758dec9e admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:21.220376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 809/1617] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:21.221193 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd179dda-3279-4565-88e4-06c9a5a94bee None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:21.243662 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 809/1618] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:21 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:21.243662 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b43859-14a5-49b9-aae0-03c4e6d5abc2 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:21.243662 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b43859-14a5-49b9-aae0-03c4e6d5abc2 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:21.243662 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b43859-14a5-49b9-aae0-03c4e6d5abc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:21.264674 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-16b43859-14a5-49b9-aae0-03c4e6d5abc2 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:21.265950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-16b43859-14a5-49b9-aae0-03c4e6d5abc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:21.278002 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 810/1619] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:21.278002 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db354528-12a7-4479-b822-21b247d2cbe9 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:21.278002 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db354528-12a7-4479-b822-21b247d2cbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:21.278002 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db354528-12a7-4479-b822-21b247d2cbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:21.295639 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd179dda-3279-4565-88e4-06c9a5a94bee None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:21.295956 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-db354528-12a7-4479-b822-21b247d2cbe9 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:21.297222 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-db354528-12a7-4479-b822-21b247d2cbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:21.299358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699263f-032f-4605-ae92-6c741e3254eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:21.299994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699263f-032f-4605-ae92-6c741e3254eb service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:21.300277 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699263f-032f-4605-ae92-6c741e3254eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:21.300553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699263f-032f-4605-ae92-6c741e3254eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:21.305188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 811/1620] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:21.309576 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae6e1e-f593-4a82-84cd-1f7b7610fc1e None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:21.309861 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae6e1e-f593-4a82-84cd-1f7b7610fc1e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:21.310369 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae6e1e-f593-4a82-84cd-1f7b7610fc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:21.331909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-37ae6e1e-f593-4a82-84cd-1f7b7610fc1e None None] MFA Rules not processed for user `5ac367247aa54671ae5c33d251017470`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:21.335281 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-37ae6e1e-f593-4a82-84cd-1f7b7610fc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:21.352970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:21.378191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699263f-032f-4605-ae92-6c741e3254eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:21.379923 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699263f-032f-4605-ae92-6c741e3254eb service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:21.392357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 810/1621] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:21.393286 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699263f-032f-4605-ae92-6c741e3254eb service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:21.404623 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699263f-032f-4605-ae92-6c741e3254eb service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:21.410880 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92493022-ad44-4300-adee-b839fc9ae0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:21.411672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92493022-ad44-4300-adee-b839fc9ae0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:21.411976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92493022-ad44-4300-adee-b839fc9ae0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:21.412358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92493022-ad44-4300-adee-b839fc9ae0e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:21.413159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92493022-ad44-4300-adee-b839fc9ae0e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:21.416079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92493022-ad44-4300-adee-b839fc9ae0e6 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:21.427641 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 812/1622] 10.222.0.96 () {58 vars in 1059 bytes} [Thu Jul 28 17:55:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:21.428475 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae6e1e-f593-4a82-84cd-1f7b7610fc1e None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:21.434160 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:21.442471 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae6e1e-f593-4a82-84cd-1f7b7610fc1e None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:21.450971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a7990-fa3c-43ba-a4ae-c2c6689c01f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:21.451743 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a7990-fa3c-43ba-a4ae-c2c6689c01f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:21.452146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a7990-fa3c-43ba-a4ae-c2c6689c01f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:21.452479 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a7990-fa3c-43ba-a4ae-c2c6689c01f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:21.453367 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a7990-fa3c-43ba-a4ae-c2c6689c01f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:21.454267 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 811/1623] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:21 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:21.455046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92493022-ad44-4300-adee-b839fc9ae0e6 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:21.458463 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a7990-fa3c-43ba-a4ae-c2c6689c01f2 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:21.490661 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 813/1624] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:21 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:21.490661 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a7990-fa3c-43ba-a4ae-c2c6689c01f2 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:21.537814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92493022-ad44-4300-adee-b839fc9ae0e6 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:21.574614 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a7990-fa3c-43ba-a4ae-c2c6689c01f2 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:21.590580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6f8c-5b4a-488e-bcb1-d07036d3567b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:21.592430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6f8c-5b4a-488e-bcb1-d07036d3567b service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:21.592713 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6f8c-5b4a-488e-bcb1-d07036d3567b service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:21.593016 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6f8c-5b4a-488e-bcb1-d07036d3567b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:21.644801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bccb04-6f31-4715-95b3-90d9d6569ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:21.645505 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bccb04-6f31-4715-95b3-90d9d6569ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:21.645913 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bccb04-6f31-4715-95b3-90d9d6569ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:21.646196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bccb04-6f31-4715-95b3-90d9d6569ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:21.646929 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bccb04-6f31-4715-95b3-90d9d6569ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:21.649235 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bccb04-6f31-4715-95b3-90d9d6569ef1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:21.662204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 812/1625] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:21.667804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bccb04-6f31-4715-95b3-90d9d6569ef1 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:21.679164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bccb04-6f31-4715-95b3-90d9d6569ef1 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:21.683674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c9ffc-65e0-4f48-86ce-a40ca3b1fc2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:21.684240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c9ffc-65e0-4f48-86ce-a40ca3b1fc2f service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:21.684462 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c9ffc-65e0-4f48-86ce-a40ca3b1fc2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:21.684738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c9ffc-65e0-4f48-86ce-a40ca3b1fc2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:21.700971 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c9ffc-65e0-4f48-86ce-a40ca3b1fc2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:21.702588 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c9ffc-65e0-4f48-86ce-a40ca3b1fc2f service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:21.721169 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 813/1626] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:21.724356 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c9ffc-65e0-4f48-86ce-a40ca3b1fc2f service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:21.742489 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac6f8c-5b4a-488e-bcb1-d07036d3567b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:21.745987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac6f8c-5b4a-488e-bcb1-d07036d3567b service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:21.769882 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 814/1627] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:21.771726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6f8c-5b4a-488e-bcb1-d07036d3567b service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:21.786898 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6f8c-5b4a-488e-bcb1-d07036d3567b service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:21.793597 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579be717-ae00-4b58-ba9c-9cd8c5d42653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:21.794697 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579be717-ae00-4b58-ba9c-9cd8c5d42653 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:21.794989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579be717-ae00-4b58-ba9c-9cd8c5d42653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:21.795269 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579be717-ae00-4b58-ba9c-9cd8c5d42653 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:21.796019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579be717-ae00-4b58-ba9c-9cd8c5d42653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:21.797487 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:21.798785 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579be717-ae00-4b58-ba9c-9cd8c5d42653 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:21.832194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 815/1628] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:21 2022] POST /identity/v3/users => generated 294 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:21.833195 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579be717-ae00-4b58-ba9c-9cd8c5d42653 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:21.844822 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579be717-ae00-4b58-ba9c-9cd8c5d42653 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:21.845338 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c9ffc-65e0-4f48-86ce-a40ca3b1fc2f service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:21.850841 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05222e23-4e59-4338-a3f0-52e98490677a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:21.851554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05222e23-4e59-4338-a3f0-52e98490677a admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:21.851872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05222e23-4e59-4338-a3f0-52e98490677a admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:21.852194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05222e23-4e59-4338-a3f0-52e98490677a admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:21.853179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05222e23-4e59-4338-a3f0-52e98490677a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:21.855552 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05222e23-4e59-4338-a3f0-52e98490677a admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:21.857208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ffa1c-2a7e-4451-a3a2-2c0425239690 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:21.858229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ffa1c-2a7e-4451-a3a2-2c0425239690 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:21.858868 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ffa1c-2a7e-4451-a3a2-2c0425239690 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:21.859302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ffa1c-2a7e-4451-a3a2-2c0425239690 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:21.887612 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 816/1629] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:21 2022] POST /identity/v3/users => generated 292 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:21.888611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05222e23-4e59-4338-a3f0-52e98490677a admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:21.900059 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05222e23-4e59-4338-a3f0-52e98490677a admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:21.908932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b7edb-1670-42f4-9bc0-003a9c97a7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:21.910598 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b7edb-1670-42f4-9bc0-003a9c97a7b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:21.910887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b7edb-1670-42f4-9bc0-003a9c97a7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:21.912559 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b7edb-1670-42f4-9bc0-003a9c97a7b9 admin admin] PATH_INFO: `/v3/projects/24babe4b39724a94a76ee714b6aba68c/users/10e9502c8c4a467b8e4f612d83d5b792/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:21.930924 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b7edb-1670-42f4-9bc0-003a9c97a7b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24babe4b39724a94a76ee714b6aba68c, user_id=10e9502c8c4a467b8e4f612d83d5b792, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:21.934111 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b7edb-1670-42f4-9bc0-003a9c97a7b9 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:21.943662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ffa1c-2a7e-4451-a3a2-2c0425239690 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:21.946517 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ffa1c-2a7e-4451-a3a2-2c0425239690 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:21.955550 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 817/1630] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:21 2022] PUT /identity/v3/projects/24babe4b39724a94a76ee714b6aba68c/users/10e9502c8c4a467b8e4f612d83d5b792/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:21.956534 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b7edb-1670-42f4-9bc0-003a9c97a7b9 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:21.962192 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 814/1631] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:21.963788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ffa1c-2a7e-4451-a3a2-2c0425239690 service nova] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:21.977858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ffa1c-2a7e-4451-a3a2-2c0425239690 service nova] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:22.010697 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:22.076933 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b7edb-1670-42f4-9bc0-003a9c97a7b9 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:22.088812 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb245d-3673-46f4-8dd5-d21bb80b1985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:22.089654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb245d-3673-46f4-8dd5-d21bb80b1985 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:22.089946 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb245d-3673-46f4-8dd5-d21bb80b1985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:22.090226 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb245d-3673-46f4-8dd5-d21bb80b1985 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:22.090942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb245d-3673-46f4-8dd5-d21bb80b1985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:22.100897 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb245d-3673-46f4-8dd5-d21bb80b1985 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:22.110459 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4b789-3ece-44d9-b524-cef1657934e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:22.111529 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4b789-3ece-44d9-b524-cef1657934e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:22.112330 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4b789-3ece-44d9-b524-cef1657934e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:22.112710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4b789-3ece-44d9-b524-cef1657934e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:22.113922 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4b789-3ece-44d9-b524-cef1657934e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:22.115942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4b789-3ece-44d9-b524-cef1657934e4 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:22.119688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 818/1632] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:22.119688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb245d-3673-46f4-8dd5-d21bb80b1985 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:22.129843 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb245d-3673-46f4-8dd5-d21bb80b1985 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:22.133875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 815/1633] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:22.135399 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4b789-3ece-44d9-b524-cef1657934e4 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:22.150228 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4b789-3ece-44d9-b524-cef1657934e4 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:22.164258 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc043f-3bb5-4080-956a-4ad7982e1de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:22.164902 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc043f-3bb5-4080-956a-4ad7982e1de3 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:22.165581 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc043f-3bb5-4080-956a-4ad7982e1de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:22.166619 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc043f-3bb5-4080-956a-4ad7982e1de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:22.167343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc043f-3bb5-4080-956a-4ad7982e1de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:22.170342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d99cf8-3137-42ca-a115-0e5eb24e2f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:22.172814 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc043f-3bb5-4080-956a-4ad7982e1de3 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:22.174181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d99cf8-3137-42ca-a115-0e5eb24e2f68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:22.175973 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d99cf8-3137-42ca-a115-0e5eb24e2f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:22.176448 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d99cf8-3137-42ca-a115-0e5eb24e2f68 admin admin] PATH_INFO: `/v3/projects/81bf547bb55140c9b4f3be2070cac9be/users/692fee07747346539376d2aadf46732f/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:22.202492 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 819/1634] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:22.203386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc043f-3bb5-4080-956a-4ad7982e1de3 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:22.226987 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d99cf8-3137-42ca-a115-0e5eb24e2f68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81bf547bb55140c9b4f3be2070cac9be, user_id=692fee07747346539376d2aadf46732f, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:22.229532 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc043f-3bb5-4080-956a-4ad7982e1de3 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:22.231856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d99cf8-3137-42ca-a115-0e5eb24e2f68 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:22.237772 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563c04f-8a0b-4c80-ba74-5e584169d295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:22.238475 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563c04f-8a0b-4c80-ba74-5e584169d295 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:22.238748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563c04f-8a0b-4c80-ba74-5e584169d295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:22.239031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563c04f-8a0b-4c80-ba74-5e584169d295 admin admin] PATH_INFO: `/v3/projects/1e4c86e44a544c9cb22de2ed99002e23/users/7b7716818a7f4a7594463c7e5dd810be/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:22.258793 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 816/1635] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:22 2022] PUT /identity/v3/projects/81bf547bb55140c9b4f3be2070cac9be/users/692fee07747346539376d2aadf46732f/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:22.258793 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d99cf8-3137-42ca-a115-0e5eb24e2f68 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:22.275199 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563c04f-8a0b-4c80-ba74-5e584169d295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e4c86e44a544c9cb22de2ed99002e23, user_id=7b7716818a7f4a7594463c7e5dd810be, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:22.277940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563c04f-8a0b-4c80-ba74-5e584169d295 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:22.301140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 820/1636] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:22 2022] PUT /identity/v3/projects/1e4c86e44a544c9cb22de2ed99002e23/users/7b7716818a7f4a7594463c7e5dd810be/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:22.304835 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563c04f-8a0b-4c80-ba74-5e584169d295 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:22.354344 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:22.369235 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d99cf8-3137-42ca-a115-0e5eb24e2f68 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:22.408537 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563c04f-8a0b-4c80-ba74-5e584169d295 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:22.416645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15dab6-b270-4c21-a11e-972518dc2b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:22.417829 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15dab6-b270-4c21-a11e-972518dc2b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:22.417971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15dab6-b270-4c21-a11e-972518dc2b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:22.418260 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15dab6-b270-4c21-a11e-972518dc2b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:22.419136 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15dab6-b270-4c21-a11e-972518dc2b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:22.421260 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15dab6-b270-4c21-a11e-972518dc2b8d admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:22.437083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 821/1637] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:22.437083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e32e6c-860e-4852-b8b5-4b7a49b7a5e4 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:22.437083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e32e6c-860e-4852-b8b5-4b7a49b7a5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:22.437083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e32e6c-860e-4852-b8b5-4b7a49b7a5e4 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:22.437650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 822/1638] 10.222.0.96 () {54 vars in 912 bytes} [Thu Jul 28 17:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:55:22.438339 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e32e6c-860e-4852-b8b5-4b7a49b7a5e4 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:22.442676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4d124-621a-44f0-90b0-e8c027dc5403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:22.443739 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4d124-621a-44f0-90b0-e8c027dc5403 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:22.444165 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4d124-621a-44f0-90b0-e8c027dc5403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:22.444536 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4d124-621a-44f0-90b0-e8c027dc5403 admin admin] PATH_INFO: `/v3/projects/24babe4b39724a94a76ee714b6aba68c/users/10e9502c8c4a467b8e4f612d83d5b792/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:22.447967 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4d124-621a-44f0-90b0-e8c027dc5403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24babe4b39724a94a76ee714b6aba68c, user_id=10e9502c8c4a467b8e4f612d83d5b792, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:22.451047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4d124-621a-44f0-90b0-e8c027dc5403 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:22.456887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e32e6c-860e-4852-b8b5-4b7a49b7a5e4 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:22.462539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70771a36-5eda-4983-bdb3-6d3a7d74aae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:22.463230 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70771a36-5eda-4983-bdb3-6d3a7d74aae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:22.463516 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70771a36-5eda-4983-bdb3-6d3a7d74aae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:22.463793 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70771a36-5eda-4983-bdb3-6d3a7d74aae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:22.464808 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70771a36-5eda-4983-bdb3-6d3a7d74aae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:22.467188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70771a36-5eda-4983-bdb3-6d3a7d74aae7 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:22.484412 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 817/1639] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:22 2022] PUT /identity/v3/projects/24babe4b39724a94a76ee714b6aba68c/users/10e9502c8c4a467b8e4f612d83d5b792/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:22.484412 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4d124-621a-44f0-90b0-e8c027dc5403 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:22.486643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 823/1640] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:22.486643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502e4c6-5084-48f3-8844-387c443a014b None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:22.486643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502e4c6-5084-48f3-8844-387c443a014b None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:22.486643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502e4c6-5084-48f3-8844-387c443a014b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:22.508709 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-e502e4c6-5084-48f3-8844-387c443a014b None None] MFA Rules not processed for user `5ac367247aa54671ae5c33d251017470`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:22.510281 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e502e4c6-5084-48f3-8844-387c443a014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:22.583372 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4d124-621a-44f0-90b0-e8c027dc5403 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:22.589481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e02b3-50d3-4265-84a6-8fb962d93340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:22.590604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e02b3-50d3-4265-84a6-8fb962d93340 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:22.590604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e02b3-50d3-4265-84a6-8fb962d93340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:22.590945 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e02b3-50d3-4265-84a6-8fb962d93340 admin admin] PATH_INFO: `/v3/projects/81bf547bb55140c9b4f3be2070cac9be/users/692fee07747346539376d2aadf46732f/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:22.593173 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e02b3-50d3-4265-84a6-8fb962d93340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81bf547bb55140c9b4f3be2070cac9be, user_id=692fee07747346539376d2aadf46732f, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:22.596070 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e02b3-50d3-4265-84a6-8fb962d93340 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:22.605227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 824/1641] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Jul 28 17:55:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:22.606774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502e4c6-5084-48f3-8844-387c443a014b None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:22.610254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 818/1642] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:22 2022] PUT /identity/v3/projects/81bf547bb55140c9b4f3be2070cac9be/users/692fee07747346539376d2aadf46732f/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:22.613293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b8e57-eba3-40de-bb33-9ae5c87647f3 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:22.613293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b8e57-eba3-40de-bb33-9ae5c87647f3 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:22.613293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b8e57-eba3-40de-bb33-9ae5c87647f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:22.627473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502e4c6-5084-48f3-8844-387c443a014b None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:22.635615 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:22.650570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-362b8e57-eba3-40de-bb33-9ae5c87647f3 None None] MFA Rules not processed for user `10e9502c8c4a467b8e4f612d83d5b792`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:22.652037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-362b8e57-eba3-40de-bb33-9ae5c87647f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:22.710111 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33eb8f-ec65-4bef-a573-bc3602ef008b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:22.710714 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33eb8f-ec65-4bef-a573-bc3602ef008b admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:22.710999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33eb8f-ec65-4bef-a573-bc3602ef008b admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:22.711861 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33eb8f-ec65-4bef-a573-bc3602ef008b admin admin] PATH_INFO: `/v3/projects/1e4c86e44a544c9cb22de2ed99002e23/users/7b7716818a7f4a7594463c7e5dd810be/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:22.713769 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33eb8f-ec65-4bef-a573-bc3602ef008b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e4c86e44a544c9cb22de2ed99002e23, user_id=7b7716818a7f4a7594463c7e5dd810be, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:22.716436 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33eb8f-ec65-4bef-a573-bc3602ef008b admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:22.730406 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 825/1643] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:22 2022] PUT /identity/v3/projects/1e4c86e44a544c9cb22de2ed99002e23/users/7b7716818a7f4a7594463c7e5dd810be/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:22.740177 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6869676-8a46-4483-b245-83852e433982 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:22.745708 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 819/1644] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:22.745914 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6869676-8a46-4483-b245-83852e433982 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:22.745914 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6869676-8a46-4483-b245-83852e433982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:22.746087 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b8e57-eba3-40de-bb33-9ae5c87647f3 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:22.761241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:22.783238 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-f6869676-8a46-4483-b245-83852e433982 None None] MFA Rules not processed for user `692fee07747346539376d2aadf46732f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:22.786195 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f6869676-8a46-4483-b245-83852e433982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:22.824977 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b8e57-eba3-40de-bb33-9ae5c87647f3 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:22.924976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826d8f9-4a91-4f66-a137-1f37846823ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:22.926122 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826d8f9-4a91-4f66-a137-1f37846823ff service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:22.926665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826d8f9-4a91-4f66-a137-1f37846823ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:22.927202 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826d8f9-4a91-4f66-a137-1f37846823ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:23.047340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826d8f9-4a91-4f66-a137-1f37846823ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:23.049231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826d8f9-4a91-4f66-a137-1f37846823ff service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:23.056843 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 826/1645] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:23.058250 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19677fc8-9bf1-48f3-90b6-61414600d316 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:23.058539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19677fc8-9bf1-48f3-90b6-61414600d316 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:23.058864 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19677fc8-9bf1-48f3-90b6-61414600d316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:23.066195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 820/1646] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:23.067472 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826d8f9-4a91-4f66-a137-1f37846823ff service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:23.080182 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826d8f9-4a91-4f66-a137-1f37846823ff service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:23.085361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55695111-e98f-4bc9-bc5d-a7a352ce14e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:23.086453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55695111-e98f-4bc9-bc5d-a7a352ce14e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:23.087799 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55695111-e98f-4bc9-bc5d-a7a352ce14e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:23.088489 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55695111-e98f-4bc9-bc5d-a7a352ce14e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:23.134389 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-19677fc8-9bf1-48f3-90b6-61414600d316 None None] MFA Rules not processed for user `7b7716818a7f4a7594463c7e5dd810be`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:23.135745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-19677fc8-9bf1-48f3-90b6-61414600d316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:23.222238 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55695111-e98f-4bc9-bc5d-a7a352ce14e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:23.225667 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55695111-e98f-4bc9-bc5d-a7a352ce14e4 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:23.251711 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 821/1647] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:23.291277 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 827/1648] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:23.338935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55695111-e98f-4bc9-bc5d-a7a352ce14e4 service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:23.348650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:23.355074 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55695111-e98f-4bc9-bc5d-a7a352ce14e4 service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:23.365822 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795df0f-0d38-446b-b566-69385a2d44f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:23.369509 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795df0f-0d38-446b-b566-69385a2d44f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:23.369803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795df0f-0d38-446b-b566-69385a2d44f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:23.370234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795df0f-0d38-446b-b566-69385a2d44f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:23.532591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795df0f-0d38-446b-b566-69385a2d44f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:23.536055 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795df0f-0d38-446b-b566-69385a2d44f0 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:23.562118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 822/1649] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:23.885639 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19677fc8-9bf1-48f3-90b6-61414600d316 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:23.901208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19677fc8-9bf1-48f3-90b6-61414600d316 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:23.913604 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1f885-02d9-47ce-82b0-7c820b9b4a2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:23.915715 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1f885-02d9-47ce-82b0-7c820b9b4a2c service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:23.917212 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1f885-02d9-47ce-82b0-7c820b9b4a2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:23.918416 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1f885-02d9-47ce-82b0-7c820b9b4a2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:23.948188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1f885-02d9-47ce-82b0-7c820b9b4a2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:23.950227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1f885-02d9-47ce-82b0-7c820b9b4a2c service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:23.968175 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:23.989985 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 828/1650] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:23 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:24.288936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795df0f-0d38-446b-b566-69385a2d44f0 service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:24.298085 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795df0f-0d38-446b-b566-69385a2d44f0 service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:24.305493 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719d6f2-bb91-40ca-a670-cd2d171f5e07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:24.306428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719d6f2-bb91-40ca-a670-cd2d171f5e07 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:24.306877 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719d6f2-bb91-40ca-a670-cd2d171f5e07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:24.307162 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719d6f2-bb91-40ca-a670-cd2d171f5e07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:24.391959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1f885-02d9-47ce-82b0-7c820b9b4a2c service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:24.407715 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1f885-02d9-47ce-82b0-7c820b9b4a2c service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:24.412729 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbadef-4375-4d27-bced-bde32e3c9d77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:24.413780 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbadef-4375-4d27-bced-bde32e3c9d77 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:24.413927 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbadef-4375-4d27-bced-bde32e3c9d77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:24.414479 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbadef-4375-4d27-bced-bde32e3c9d77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:24.415043 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719d6f2-bb91-40ca-a670-cd2d171f5e07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:24.417368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719d6f2-bb91-40ca-a670-cd2d171f5e07 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:24.441269 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 823/1651] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:24.513872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbadef-4375-4d27-bced-bde32e3c9d77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:24.517208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbadef-4375-4d27-bced-bde32e3c9d77 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:24.533584 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 829/1652] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:25.489544 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719d6f2-bb91-40ca-a670-cd2d171f5e07 service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:25.698480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719d6f2-bb91-40ca-a670-cd2d171f5e07 service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:25.709441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a91df-837e-401e-8d0c-9e4127605d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:25.710460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a91df-837e-401e-8d0c-9e4127605d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:25.712791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a91df-837e-401e-8d0c-9e4127605d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:25.713380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a91df-837e-401e-8d0c-9e4127605d59 admin admin] PATH_INFO: `/v3/users/c67f233588d74a4494a0ce5f334f9e7b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:25.715182 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a91df-837e-401e-8d0c-9e4127605d59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c67f233588d74a4494a0ce5f334f9e7b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:25.719680 dv-cinder-813229-13-smb devstack@keystone.service[80310]: WARNING py.warnings [None req-135a91df-837e-401e-8d0c-9e4127605d59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:55:25.719680 dv-cinder-813229-13-smb devstack@keystone.service[80310]: warnings.warn(msg) Jul 28 17:55:25.719680 dv-cinder-813229-13-smb devstack@keystone.service[80310]: Jul 28 17:55:25.724074 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a91df-837e-401e-8d0c-9e4127605d59 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:25.868843 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:25.890827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-135a91df-837e-401e-8d0c-9e4127605d59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c67f233588d74a4494a0ce5f334f9e7b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:25.892705 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-135a91df-837e-401e-8d0c-9e4127605d59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c67f233588d74a4494a0ce5f334f9e7b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:25.917947 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-135a91df-837e-401e-8d0c-9e4127605d59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c67f233588d74a4494a0ce5f334f9e7b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:25.971837 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-135a91df-837e-401e-8d0c-9e4127605d59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c67f233588d74a4494a0ce5f334f9e7b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:25.973482 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-135a91df-837e-401e-8d0c-9e4127605d59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c67f233588d74a4494a0ce5f334f9e7b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:26.003263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 824/1653] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:55:25 2022] DELETE /identity/v3/users/c67f233588d74a4494a0ce5f334f9e7b => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:26.007493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b7f97-a3c7-4081-b2d8-6157db0fab16 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:26.008022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b7f97-a3c7-4081-b2d8-6157db0fab16 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:26.008148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b7f97-a3c7-4081-b2d8-6157db0fab16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:26.072119 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-be0b7f97-a3c7-4081-b2d8-6157db0fab16 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:26.073719 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-be0b7f97-a3c7-4081-b2d8-6157db0fab16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:26.257139 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 830/1654] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:26.355470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a91df-837e-401e-8d0c-9e4127605d59 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:26.356964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-135a91df-837e-401e-8d0c-9e4127605d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:26.552116 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a91df-837e-401e-8d0c-9e4127605d59 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:26.601673 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a9c16-3f2a-4e93-8a7e-68b7888f188f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:26.603077 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a9c16-3f2a-4e93-8a7e-68b7888f188f service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:26.603577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a9c16-3f2a-4e93-8a7e-68b7888f188f service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:26.603940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a9c16-3f2a-4e93-8a7e-68b7888f188f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:26.617747 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a9c16-3f2a-4e93-8a7e-68b7888f188f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:26.621886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a9c16-3f2a-4e93-8a7e-68b7888f188f service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:26.636135 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 825/1655] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:27.368659 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b7f97-a3c7-4081-b2d8-6157db0fab16 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:27.370214 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-be0b7f97-a3c7-4081-b2d8-6157db0fab16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:27.574667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b7f97-a3c7-4081-b2d8-6157db0fab16 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:27.587905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a786dd2-8234-4dc1-88e7-156d0c10fb8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:27.590371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a786dd2-8234-4dc1-88e7-156d0c10fb8c service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:27.590657 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a786dd2-8234-4dc1-88e7-156d0c10fb8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:27.590927 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a786dd2-8234-4dc1-88e7-156d0c10fb8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:27.597278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-7a786dd2-8234-4dc1-88e7-156d0c10fb8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:27.785684 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:27.843985 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a786dd2-8234-4dc1-88e7-156d0c10fb8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:27.847336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a786dd2-8234-4dc1-88e7-156d0c10fb8c service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:27.909399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 831/1656] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:29.646440 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a9c16-3f2a-4e93-8a7e-68b7888f188f service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:29.648880 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1b5a9c16-3f2a-4e93-8a7e-68b7888f188f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:29.685492 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a9c16-3f2a-4e93-8a7e-68b7888f188f service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:29.718881 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a91e3-fa52-4637-8bf5-fe88f31300af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:29.719567 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a91e3-fa52-4637-8bf5-fe88f31300af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:29.719854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a91e3-fa52-4637-8bf5-fe88f31300af admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:29.720136 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a91e3-fa52-4637-8bf5-fe88f31300af admin admin] PATH_INFO: `/v3/projects/9258441a9e3942738abcecda9115aab0` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:29.721368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a91e3-fa52-4637-8bf5-fe88f31300af admin admin] RBAC: Authorizing `identity:delete_project(project_id=9258441a9e3942738abcecda9115aab0)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:29.749699 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a91e3-fa52-4637-8bf5-fe88f31300af admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:29.875557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4e7a91e3-fa52-4637-8bf5-fe88f31300af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9258441a9e3942738abcecda9115aab0', 'request_id': 'req-4e7a91e3-fa52-4637-8bf5-fe88f31300af'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:29.885578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4e7a91e3-fa52-4637-8bf5-fe88f31300af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9258441a9e3942738abcecda9115aab0', 'request_id': 'req-4e7a91e3-fa52-4637-8bf5-fe88f31300af'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:29.934819 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a786dd2-8234-4dc1-88e7-156d0c10fb8c service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:29.937710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-7a786dd2-8234-4dc1-88e7-156d0c10fb8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:29.939947 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4e7a91e3-fa52-4637-8bf5-fe88f31300af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9258441a9e3942738abcecda9115aab0', 'request_id': 'req-4e7a91e3-fa52-4637-8bf5-fe88f31300af'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:29.986472 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a786dd2-8234-4dc1-88e7-156d0c10fb8c service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:29.994824 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4e7a91e3-fa52-4637-8bf5-fe88f31300af admin admin] The token cache is being invalidate because project 9258441a9e3942738abcecda9115aab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:55:29.995319 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4e7a91e3-fa52-4637-8bf5-fe88f31300af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:29.996288 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4e7a91e3-fa52-4637-8bf5-fe88f31300af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:29.999780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 826/1657] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:55:29 2022] DELETE /identity/v3/projects/9258441a9e3942738abcecda9115aab0 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:30.004820 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ef02b-cb35-47ee-95ce-2cce6857ffb0 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:30.005783 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ef02b-cb35-47ee-95ce-2cce6857ffb0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:30.006262 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ef02b-cb35-47ee-95ce-2cce6857ffb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:30.070325 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-bf2ef02b-cb35-47ee-95ce-2cce6857ffb0 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:30.070325 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-bf2ef02b-cb35-47ee-95ce-2cce6857ffb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:30.179001 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a320e54-5b44-4d93-83d4-373690214d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:30.179619 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a320e54-5b44-4d93-83d4-373690214d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:30.179895 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a320e54-5b44-4d93-83d4-373690214d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:30.180168 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a320e54-5b44-4d93-83d4-373690214d10 admin admin] PATH_INFO: `/v3/users/d10fb0f5ce9544048f9656ae535bac77` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:30.183723 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a320e54-5b44-4d93-83d4-373690214d10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d10fb0f5ce9544048f9656ae535bac77)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:30.185451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a320e54-5b44-4d93-83d4-373690214d10 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:30.195823 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:30.243444 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 827/1658] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:55:30.252405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabc051-84c8-4b5e-bd4f-82b08c6a0bab None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:30.252927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabc051-84c8-4b5e-bd4f-82b08c6a0bab None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:30.253412 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabc051-84c8-4b5e-bd4f-82b08c6a0bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:30.303508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-beabc051-84c8-4b5e-bd4f-82b08c6a0bab None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:30.305433 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-beabc051-84c8-4b5e-bd4f-82b08c6a0bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:30.332130 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 828/1659] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:30.333741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabc051-84c8-4b5e-bd4f-82b08c6a0bab None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:30.336524 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-7a320e54-5b44-4d93-83d4-373690214d10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd10fb0f5ce9544048f9656ae535bac77'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:30.360790 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabc051-84c8-4b5e-bd4f-82b08c6a0bab None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:30.373533 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-7a320e54-5b44-4d93-83d4-373690214d10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd10fb0f5ce9544048f9656ae535bac77'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:30.378196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff49702-40f8-4d45-a923-be8a2e2d561b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:30.379509 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff49702-40f8-4d45-a923-be8a2e2d561b admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:30.379942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff49702-40f8-4d45-a923-be8a2e2d561b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:30.380349 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff49702-40f8-4d45-a923-be8a2e2d561b admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:30.382755 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff49702-40f8-4d45-a923-be8a2e2d561b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:55:30.383288 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff49702-40f8-4d45-a923-be8a2e2d561b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:30.388950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-7a320e54-5b44-4d93-83d4-373690214d10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd10fb0f5ce9544048f9656ae535bac77'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:30.392138 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff49702-40f8-4d45-a923-be8a2e2d561b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:30.401951 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-7a320e54-5b44-4d93-83d4-373690214d10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd10fb0f5ce9544048f9656ae535bac77'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:30.403515 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-7a320e54-5b44-4d93-83d4-373690214d10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd10fb0f5ce9544048f9656ae535bac77'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:30.411683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 829/1660] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:55:30.414229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff49702-40f8-4d45-a923-be8a2e2d561b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:30.419457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5ff49702-40f8-4d45-a923-be8a2e2d561b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:30.420653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 832/1661] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:55:29 2022] DELETE /identity/v3/users/d10fb0f5ce9544048f9656ae535bac77 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:30.425858 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc59d38-4d4b-4ad0-8488-e7d70b4f07fd None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:30.426200 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc59d38-4d4b-4ad0-8488-e7d70b4f07fd None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:30.426519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc59d38-4d4b-4ad0-8488-e7d70b4f07fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:30.485488 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff49702-40f8-4d45-a923-be8a2e2d561b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:30.511316 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-0cc59d38-4d4b-4ad0-8488-e7d70b4f07fd None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:30.525823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-0cc59d38-4d4b-4ad0-8488-e7d70b4f07fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:30.659637 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be526d81-162a-4ab7-b0d2-57c4ed89abd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:30.663614 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be526d81-162a-4ab7-b0d2-57c4ed89abd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:30.666456 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be526d81-162a-4ab7-b0d2-57c4ed89abd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:30.667155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be526d81-162a-4ab7-b0d2-57c4ed89abd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:30.672045 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be526d81-162a-4ab7-b0d2-57c4ed89abd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:30.679287 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be526d81-162a-4ab7-b0d2-57c4ed89abd9 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:30.706302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 833/1662] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:55:30.740412 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc59d38-4d4b-4ad0-8488-e7d70b4f07fd None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:30.742841 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-0cc59d38-4d4b-4ad0-8488-e7d70b4f07fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:30.770838 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:30.775005 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 830/1663] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:30 2022] POST /identity/v3/projects => generated 403 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:30.783263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be526d81-162a-4ab7-b0d2-57c4ed89abd9 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:30.894797 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc59d38-4d4b-4ad0-8488-e7d70b4f07fd None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:31.005163 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be526d81-162a-4ab7-b0d2-57c4ed89abd9 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:31.028318 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dacaa-0450-402e-9df1-3848c6119c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:31.028825 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dacaa-0450-402e-9df1-3848c6119c61 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:31.029128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dacaa-0450-402e-9df1-3848c6119c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:31.029406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dacaa-0450-402e-9df1-3848c6119c61 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:31.033009 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dacaa-0450-402e-9df1-3848c6119c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:31.039309 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dacaa-0450-402e-9df1-3848c6119c61 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:31.041687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae2ae7-735e-4ebf-a46d-b1d7fcd1dde9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:31.042495 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae2ae7-735e-4ebf-a46d-b1d7fcd1dde9 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:31.045522 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae2ae7-735e-4ebf-a46d-b1d7fcd1dde9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:31.046010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae2ae7-735e-4ebf-a46d-b1d7fcd1dde9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:31.080749 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae2ae7-735e-4ebf-a46d-b1d7fcd1dde9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:31.089376 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae2ae7-735e-4ebf-a46d-b1d7fcd1dde9 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:31.116976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 831/1664] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:30 2022] POST /identity/v3/users => generated 302 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:31.119295 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dacaa-0450-402e-9df1-3848c6119c61 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:31.126685 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 834/1665] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:31.172745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dacaa-0450-402e-9df1-3848c6119c61 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:31.195069 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48483c7-647a-4599-a1c7-c3a938d3a06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:31.195718 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48483c7-647a-4599-a1c7-c3a938d3a06c admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:31.196155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48483c7-647a-4599-a1c7-c3a938d3a06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:31.196337 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48483c7-647a-4599-a1c7-c3a938d3a06c admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:31.197039 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48483c7-647a-4599-a1c7-c3a938d3a06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:31.207890 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48483c7-647a-4599-a1c7-c3a938d3a06c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:31.253673 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 832/1666] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:31.254719 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae2ae7-735e-4ebf-a46d-b1d7fcd1dde9 service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:31.270887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae2ae7-735e-4ebf-a46d-b1d7fcd1dde9 service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:31.285296 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccb55a-3424-4335-9261-ff366576a016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:31.287452 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccb55a-3424-4335-9261-ff366576a016 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:31.288587 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccb55a-3424-4335-9261-ff366576a016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:31.289131 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccb55a-3424-4335-9261-ff366576a016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:31.291852 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccb55a-3424-4335-9261-ff366576a016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:31.297510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccb55a-3424-4335-9261-ff366576a016 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:31.334371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 835/1667] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:55:31.337512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48483c7-647a-4599-a1c7-c3a938d3a06c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:31.356297 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48483c7-647a-4599-a1c7-c3a938d3a06c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:31.379928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da67ba-5795-44f8-8470-2f6e08ea5d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:31.381300 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da67ba-5795-44f8-8470-2f6e08ea5d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:31.381730 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da67ba-5795-44f8-8470-2f6e08ea5d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:31.382136 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da67ba-5795-44f8-8470-2f6e08ea5d6e admin admin] PATH_INFO: `/v3/projects/42e1575f8ead4a8abceab800b1d009bc/users/3d074126b3494fb5b558e5e0519146a5/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:31.429319 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da67ba-5795-44f8-8470-2f6e08ea5d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=42e1575f8ead4a8abceab800b1d009bc, user_id=3d074126b3494fb5b558e5e0519146a5, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:31.438978 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da67ba-5795-44f8-8470-2f6e08ea5d6e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:31.482681 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c4260-af79-46f1-ac03-ccabd5c587c2 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:31.482913 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 833/1668] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:31 2022] PUT /identity/v3/projects/42e1575f8ead4a8abceab800b1d009bc/users/3d074126b3494fb5b558e5e0519146a5/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:31.483747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c4260-af79-46f1-ac03-ccabd5c587c2 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:31.483961 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c4260-af79-46f1-ac03-ccabd5c587c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:31.566137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-3a1c4260-af79-46f1-ac03-ccabd5c587c2 None None] MFA Rules not processed for user `3d074126b3494fb5b558e5e0519146a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:31.567234 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-3a1c4260-af79-46f1-ac03-ccabd5c587c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:31.796781 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 836/1669] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:55:31.801223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da67ba-5795-44f8-8470-2f6e08ea5d6e admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:31.825119 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:31.967284 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da67ba-5795-44f8-8470-2f6e08ea5d6e admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:31.986802 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954ab76-e91f-42ff-841b-03353afb2689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:31.987926 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954ab76-e91f-42ff-841b-03353afb2689 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:31.988373 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954ab76-e91f-42ff-841b-03353afb2689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:31.992963 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db73781-b47e-45ae-9a34-b54f7c104dd8 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:31.993462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db73781-b47e-45ae-9a34-b54f7c104dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:31.993856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db73781-b47e-45ae-9a34-b54f7c104dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:31.997672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954ab76-e91f-42ff-841b-03353afb2689 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:31.999051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954ab76-e91f-42ff-841b-03353afb2689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:32.009245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954ab76-e91f-42ff-841b-03353afb2689 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:32.092627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-0db73781-b47e-45ae-9a34-b54f7c104dd8 None None] MFA Rules not processed for user `d2a83fb7509446c3a342ea635eccf04d`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:32.096460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-0db73781-b47e-45ae-9a34-b54f7c104dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:32.103524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 834/1670] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:31 2022] POST /identity/v3/projects => generated 403 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:32.108081 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954ab76-e91f-42ff-841b-03353afb2689 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:32.240526 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:32.313386 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954ab76-e91f-42ff-841b-03353afb2689 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:32.337385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f28077-aa66-437c-bf9f-766ad312b168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:32.338040 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f28077-aa66-437c-bf9f-766ad312b168 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:32.338321 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f28077-aa66-437c-bf9f-766ad312b168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:32.338598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f28077-aa66-437c-bf9f-766ad312b168 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:32.339274 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f28077-aa66-437c-bf9f-766ad312b168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:32.353122 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f28077-aa66-437c-bf9f-766ad312b168 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:32.369984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 837/1671] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:32.382319 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db73781-b47e-45ae-9a34-b54f7c104dd8 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:32.385604 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-0db73781-b47e-45ae-9a34-b54f7c104dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:32.412565 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 835/1672] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:32 2022] POST /identity/v3/users => generated 308 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:32.413786 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f28077-aa66-437c-bf9f-766ad312b168 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:32.435150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f28077-aa66-437c-bf9f-766ad312b168 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:32.449579 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0bd23-84da-4c26-8c49-d6026e9e068c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:32.450145 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0bd23-84da-4c26-8c49-d6026e9e068c admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:32.450431 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0bd23-84da-4c26-8c49-d6026e9e068c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:32.450757 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0bd23-84da-4c26-8c49-d6026e9e068c admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:32.451467 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0bd23-84da-4c26-8c49-d6026e9e068c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:32.454398 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0bd23-84da-4c26-8c49-d6026e9e068c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:32.517798 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 836/1673] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:32.518719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0bd23-84da-4c26-8c49-d6026e9e068c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:32.525550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1cf0bd23-84da-4c26-8c49-d6026e9e068c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:32.558677 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0bd23-84da-4c26-8c49-d6026e9e068c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:32.582283 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8eb09f-379c-4250-b9af-7cca64e3b675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:32.582950 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8eb09f-379c-4250-b9af-7cca64e3b675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:32.583228 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8eb09f-379c-4250-b9af-7cca64e3b675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:32.583942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db73781-b47e-45ae-9a34-b54f7c104dd8 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:32.584933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8eb09f-379c-4250-b9af-7cca64e3b675 admin admin] PATH_INFO: `/v3/projects/af7e6cfc595f441db9cc6223083c792a` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:32.593820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527c4e0-ab3a-4407-888a-9d68b9d31c66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:32.594683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527c4e0-ab3a-4407-888a-9d68b9d31c66 service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:32.595068 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527c4e0-ab3a-4407-888a-9d68b9d31c66 service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:32.599517 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527c4e0-ab3a-4407-888a-9d68b9d31c66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:32.601598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8eb09f-379c-4250-b9af-7cca64e3b675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af7e6cfc595f441db9cc6223083c792a)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:32.604686 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8eb09f-379c-4250-b9af-7cca64e3b675 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:32.622026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527c4e0-ab3a-4407-888a-9d68b9d31c66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:32.630793 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527c4e0-ab3a-4407-888a-9d68b9d31c66 service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:32.674167 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 838/1674] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:32.676139 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527c4e0-ab3a-4407-888a-9d68b9d31c66 service nova] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:32.720445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ff8eb09f-379c-4250-b9af-7cca64e3b675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af7e6cfc595f441db9cc6223083c792a', 'request_id': 'req-ff8eb09f-379c-4250-b9af-7cca64e3b675'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:32.731794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ff8eb09f-379c-4250-b9af-7cca64e3b675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af7e6cfc595f441db9cc6223083c792a', 'request_id': 'req-ff8eb09f-379c-4250-b9af-7cca64e3b675'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:32.740541 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527c4e0-ab3a-4407-888a-9d68b9d31c66 service nova] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:32.760644 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ff8eb09f-379c-4250-b9af-7cca64e3b675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af7e6cfc595f441db9cc6223083c792a', 'request_id': 'req-ff8eb09f-379c-4250-b9af-7cca64e3b675'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:32.770466 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:32.805544 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ff8eb09f-379c-4250-b9af-7cca64e3b675 admin admin] The token cache is being invalidate because project af7e6cfc595f441db9cc6223083c792a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:55:32.807047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ff8eb09f-379c-4250-b9af-7cca64e3b675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:32.813751 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ff8eb09f-379c-4250-b9af-7cca64e3b675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:32.815508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 837/1675] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:55:32 2022] DELETE /identity/v3/projects/af7e6cfc595f441db9cc6223083c792a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:32.822600 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6299350-cd2f-4391-8f0a-84df492fc878 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:32.822600 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6299350-cd2f-4391-8f0a-84df492fc878 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:32.822600 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6299350-cd2f-4391-8f0a-84df492fc878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:32.881774 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a6299350-cd2f-4391-8f0a-84df492fc878 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:32.883906 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a6299350-cd2f-4391-8f0a-84df492fc878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:32.971203 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d7d36-e5c9-4654-b319-9dea46d9a834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:32.973040 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d7d36-e5c9-4654-b319-9dea46d9a834 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:32.973870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d7d36-e5c9-4654-b319-9dea46d9a834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:32.974447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d7d36-e5c9-4654-b319-9dea46d9a834 admin admin] PATH_INFO: `/v3/projects/bc95af70915d46b4a1bec6751142a2c5/users/a61bb8d4ff644e35b261ecb08fbf9fbd/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:33.016679 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d7d36-e5c9-4654-b319-9dea46d9a834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc95af70915d46b4a1bec6751142a2c5, user_id=a61bb8d4ff644e35b261ecb08fbf9fbd, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:33.027632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d7d36-e5c9-4654-b319-9dea46d9a834 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:33.051869 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 839/1676] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:32 2022] PUT /identity/v3/projects/bc95af70915d46b4a1bec6751142a2c5/users/a61bb8d4ff644e35b261ecb08fbf9fbd/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:33.059009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d7d36-e5c9-4654-b319-9dea46d9a834 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:33.063399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-968d7d36-e5c9-4654-b319-9dea46d9a834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:33.089291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 838/1677] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:33.098253 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf1656-517f-45e3-9a2d-35cb32d62fdf None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:33.098942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf1656-517f-45e3-9a2d-35cb32d62fdf None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:33.099401 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf1656-517f-45e3-9a2d-35cb32d62fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:33.187962 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-3ecf1656-517f-45e3-9a2d-35cb32d62fdf None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:33.189446 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3ecf1656-517f-45e3-9a2d-35cb32d62fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:33.255081 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:33.309431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d7d36-e5c9-4654-b319-9dea46d9a834 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:33.331682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646d213-5113-477f-b5a3-2d7740cda095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:33.332786 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646d213-5113-477f-b5a3-2d7740cda095 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:33.333302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646d213-5113-477f-b5a3-2d7740cda095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:33.333770 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646d213-5113-477f-b5a3-2d7740cda095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:33.334860 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646d213-5113-477f-b5a3-2d7740cda095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:33.341750 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646d213-5113-477f-b5a3-2d7740cda095 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:33.363320 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 840/1678] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:33.367237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 839/1679] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:55:33.368822 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646d213-5113-477f-b5a3-2d7740cda095 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:33.370422 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf1656-517f-45e3-9a2d-35cb32d62fdf None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:33.385445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf1656-517f-45e3-9a2d-35cb32d62fdf None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:33.396177 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646d213-5113-477f-b5a3-2d7740cda095 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:33.398270 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6745ef-7ab9-4ec0-83e0-232c6c0a0e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:33.400089 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6745ef-7ab9-4ec0-83e0-232c6c0a0e69 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:33.400381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6745ef-7ab9-4ec0-83e0-232c6c0a0e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:33.400659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6745ef-7ab9-4ec0-83e0-232c6c0a0e69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:33.402687 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6745ef-7ab9-4ec0-83e0-232c6c0a0e69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:55:33.403283 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6745ef-7ab9-4ec0-83e0-232c6c0a0e69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:33.410721 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19063148-2a63-443e-9890-d868666050cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:33.411594 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19063148-2a63-443e-9890-d868666050cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:33.412627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19063148-2a63-443e-9890-d868666050cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:33.413467 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19063148-2a63-443e-9890-d868666050cd admin admin] PATH_INFO: `/v3/projects/bc95af70915d46b4a1bec6751142a2c5/users/a61bb8d4ff644e35b261ecb08fbf9fbd/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:33.413695 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6745ef-7ab9-4ec0-83e0-232c6c0a0e69 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:33.420189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19063148-2a63-443e-9890-d868666050cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc95af70915d46b4a1bec6751142a2c5, user_id=a61bb8d4ff644e35b261ecb08fbf9fbd, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:33.426374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19063148-2a63-443e-9890-d868666050cd admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:33.437613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 840/1680] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:55:33.438586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6745ef-7ab9-4ec0-83e0-232c6c0a0e69 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:33.444821 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8c6745ef-7ab9-4ec0-83e0-232c6c0a0e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:33.456016 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 841/1681] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:33 2022] PUT /identity/v3/projects/bc95af70915d46b4a1bec6751142a2c5/users/a61bb8d4ff644e35b261ecb08fbf9fbd/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:33.457559 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19063148-2a63-443e-9890-d868666050cd admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:33.480401 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6745ef-7ab9-4ec0-83e0-232c6c0a0e69 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:33.620203 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19063148-2a63-443e-9890-d868666050cd admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:33.629275 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1b828-86e9-4f56-a991-596f501c7c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:33.630277 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1b828-86e9-4f56-a991-596f501c7c5b admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:33.630874 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1b828-86e9-4f56-a991-596f501c7c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:33.631194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1b828-86e9-4f56-a991-596f501c7c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:33.631872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1b828-86e9-4f56-a991-596f501c7c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:33.634506 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1b828-86e9-4f56-a991-596f501c7c5b admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:33.661617 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623eb64-2b70-4d51-88b6-c313f5e9fac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:33.663535 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623eb64-2b70-4d51-88b6-c313f5e9fac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:33.663823 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623eb64-2b70-4d51-88b6-c313f5e9fac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:33.664101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623eb64-2b70-4d51-88b6-c313f5e9fac8 admin admin] PATH_INFO: `/v3/users/6aa21660ef2e496a908472dcd7d201cf` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:33.668831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623eb64-2b70-4d51-88b6-c313f5e9fac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aa21660ef2e496a908472dcd7d201cf)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:33.671975 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623eb64-2b70-4d51-88b6-c313f5e9fac8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:33.691643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 842/1682] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:33 2022] POST /identity/v3/projects => generated 367 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:33.696995 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eff73f-e696-4324-acd0-0afc147b3594 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:33.700288 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eff73f-e696-4324-acd0-0afc147b3594 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:33.700567 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eff73f-e696-4324-acd0-0afc147b3594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:33.759830 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:33.815562 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-a5eff73f-e696-4324-acd0-0afc147b3594 None None] MFA Rules not processed for user `a61bb8d4ff644e35b261ecb08fbf9fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:33.816906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-a5eff73f-e696-4324-acd0-0afc147b3594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:33.818803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f623eb64-2b70-4d51-88b6-c313f5e9fac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aa21660ef2e496a908472dcd7d201cf'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:33.819435 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f623eb64-2b70-4d51-88b6-c313f5e9fac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aa21660ef2e496a908472dcd7d201cf'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:33.829038 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f623eb64-2b70-4d51-88b6-c313f5e9fac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aa21660ef2e496a908472dcd7d201cf'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:33.875280 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f623eb64-2b70-4d51-88b6-c313f5e9fac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aa21660ef2e496a908472dcd7d201cf'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:33.876742 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f623eb64-2b70-4d51-88b6-c313f5e9fac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aa21660ef2e496a908472dcd7d201cf'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:33.904336 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 841/1683] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:55:33 2022] DELETE /identity/v3/users/6aa21660ef2e496a908472dcd7d201cf => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:33.911056 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623eb64-2b70-4d51-88b6-c313f5e9fac8 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:33.912700 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f623eb64-2b70-4d51-88b6-c313f5e9fac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:33.916416 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 843/1684] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:33 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:33.919300 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c81b8-254a-42c5-8498-66eb609c756b None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:33.919594 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c81b8-254a-42c5-8498-66eb609c756b None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:33.920132 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c81b8-254a-42c5-8498-66eb609c756b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:33.974123 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-9c7c81b8-254a-42c5-8498-66eb609c756b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:33.981278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9c7c81b8-254a-42c5-8498-66eb609c756b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:34.042720 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:34.100896 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623eb64-2b70-4d51-88b6-c313f5e9fac8 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:34.115290 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99101b-228b-4e64-8c17-52cf3b62b184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:34.116104 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99101b-228b-4e64-8c17-52cf3b62b184 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:34.116478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99101b-228b-4e64-8c17-52cf3b62b184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:34.116645 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99101b-228b-4e64-8c17-52cf3b62b184 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:34.117480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99101b-228b-4e64-8c17-52cf3b62b184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:34.119590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99101b-228b-4e64-8c17-52cf3b62b184 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:34.136365 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 844/1685] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:34.143021 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c81b8-254a-42c5-8498-66eb609c756b None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:34.148064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9c7c81b8-254a-42c5-8498-66eb609c756b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:34.175884 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 842/1686] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:33 2022] POST /identity/v3/users => generated 284 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:34.176127 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99101b-228b-4e64-8c17-52cf3b62b184 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:34.181726 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fc99101b-228b-4e64-8c17-52cf3b62b184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:34.290139 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c81b8-254a-42c5-8498-66eb609c756b None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:34.299090 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415721a3-e9c7-4522-9a46-43405c89970f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:34.299738 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415721a3-e9c7-4522-9a46-43405c89970f service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:34.300015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415721a3-e9c7-4522-9a46-43405c89970f service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:34.300286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415721a3-e9c7-4522-9a46-43405c89970f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:34.337188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99101b-228b-4e64-8c17-52cf3b62b184 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:34.347111 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461e088-eca0-40af-b090-238b526ad448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:34.349845 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461e088-eca0-40af-b090-238b526ad448 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:34.350161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461e088-eca0-40af-b090-238b526ad448 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:34.350443 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461e088-eca0-40af-b090-238b526ad448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:34.380352 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461e088-eca0-40af-b090-238b526ad448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:34.386130 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461e088-eca0-40af-b090-238b526ad448 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:34.428557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 843/1687] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:34.430451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461e088-eca0-40af-b090-238b526ad448 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:34.463718 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461e088-eca0-40af-b090-238b526ad448 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:34.486540 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5bafe-fa36-41a9-a03a-ea71312f5531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:34.487180 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5bafe-fa36-41a9-a03a-ea71312f5531 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:34.487460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5bafe-fa36-41a9-a03a-ea71312f5531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:34.487739 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5bafe-fa36-41a9-a03a-ea71312f5531 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:34.496579 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5bafe-fa36-41a9-a03a-ea71312f5531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:34.499007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415721a3-e9c7-4522-9a46-43405c89970f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:34.501638 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5bafe-fa36-41a9-a03a-ea71312f5531 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:34.502608 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415721a3-e9c7-4522-9a46-43405c89970f service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:34.534465 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 844/1688] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:34.537695 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5bafe-fa36-41a9-a03a-ea71312f5531 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:34.542106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 845/1689] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:34 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:34.570002 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5bafe-fa36-41a9-a03a-ea71312f5531 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:34.590723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066252c9-0de6-43c3-b1a1-78c755944de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:34.594129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066252c9-0de6-43c3-b1a1-78c755944de9 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:34.595543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066252c9-0de6-43c3-b1a1-78c755944de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:34.597334 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066252c9-0de6-43c3-b1a1-78c755944de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:34.600943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066252c9-0de6-43c3-b1a1-78c755944de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:34.607222 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066252c9-0de6-43c3-b1a1-78c755944de9 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:34.646689 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415721a3-e9c7-4522-9a46-43405c89970f service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:34.646913 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 845/1690] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:34.662616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415721a3-e9c7-4522-9a46-43405c89970f service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:34.681379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcd09a-8fff-4903-a7a5-daa75f0a26d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:34.681379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcd09a-8fff-4903-a7a5-daa75f0a26d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:34.681379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcd09a-8fff-4903-a7a5-daa75f0a26d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:34.681379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcd09a-8fff-4903-a7a5-daa75f0a26d4 admin admin] PATH_INFO: `/v3/projects/2f51f80042bb46ac8deabcbbde87fdb2/users/fda7c7efa4da4543bad3718eb6d67cff/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:34.722210 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bcd09a-8fff-4903-a7a5-daa75f0a26d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f51f80042bb46ac8deabcbbde87fdb2, user_id=fda7c7efa4da4543bad3718eb6d67cff, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:34.725445 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bcd09a-8fff-4903-a7a5-daa75f0a26d4 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:34.789291 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 846/1691] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:34 2022] PUT /identity/v3/projects/2f51f80042bb46ac8deabcbbde87fdb2/users/fda7c7efa4da4543bad3718eb6d67cff/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:55:34.804734 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a07f4-0e90-42e6-a2db-72479e08439a None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:34.805020 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a07f4-0e90-42e6-a2db-72479e08439a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:34.805494 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a07f4-0e90-42e6-a2db-72479e08439a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:34.882812 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:34.906132 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a38a07f4-0e90-42e6-a2db-72479e08439a None None] MFA Rules not processed for user `fda7c7efa4da4543bad3718eb6d67cff`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:34.909183 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a38a07f4-0e90-42e6-a2db-72479e08439a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:35.021464 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcd09a-8fff-4903-a7a5-daa75f0a26d4 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:35.036044 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-71bcd09a-8fff-4903-a7a5-daa75f0a26d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:35.130148 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 846/1692] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:35.142176 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a07f4-0e90-42e6-a2db-72479e08439a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:35.144458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a38a07f4-0e90-42e6-a2db-72479e08439a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:35.306608 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcd09a-8fff-4903-a7a5-daa75f0a26d4 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:35.331747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9664781-dc33-4529-b075-0b02b4ab803c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:35.332756 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9664781-dc33-4529-b075-0b02b4ab803c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:35.333713 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9664781-dc33-4529-b075-0b02b4ab803c admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:35.334242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9664781-dc33-4529-b075-0b02b4ab803c admin admin] PATH_INFO: `/v3/users/3d074126b3494fb5b558e5e0519146a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:35.336457 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9664781-dc33-4529-b075-0b02b4ab803c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d074126b3494fb5b558e5e0519146a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:35.339913 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9664781-dc33-4529-b075-0b02b4ab803c admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:35.346394 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:35.360071 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a07f4-0e90-42e6-a2db-72479e08439a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:35.370818 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52903f39-2be3-43cd-b350-532f7efd6788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:35.371462 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52903f39-2be3-43cd-b350-532f7efd6788 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:35.372114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52903f39-2be3-43cd-b350-532f7efd6788 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:35.372396 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52903f39-2be3-43cd-b350-532f7efd6788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:35.393996 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52903f39-2be3-43cd-b350-532f7efd6788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:35.396253 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52903f39-2be3-43cd-b350-532f7efd6788 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:35.425239 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 847/1693] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:55:35.435709 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a9664781-dc33-4529-b075-0b02b4ab803c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d074126b3494fb5b558e5e0519146a5'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:35.451782 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a9664781-dc33-4529-b075-0b02b4ab803c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d074126b3494fb5b558e5e0519146a5'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:35.464415 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a9664781-dc33-4529-b075-0b02b4ab803c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d074126b3494fb5b558e5e0519146a5'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:35.474223 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a9664781-dc33-4529-b075-0b02b4ab803c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d074126b3494fb5b558e5e0519146a5'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:35.475109 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a9664781-dc33-4529-b075-0b02b4ab803c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d074126b3494fb5b558e5e0519146a5'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:35.489604 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 847/1694] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:55:35 2022] DELETE /identity/v3/users/3d074126b3494fb5b558e5e0519146a5 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:35.491738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29629d0b-e9fb-46bd-815a-4c4775cdaa69 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:35.492225 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29629d0b-e9fb-46bd-815a-4c4775cdaa69 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:35.492676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29629d0b-e9fb-46bd-815a-4c4775cdaa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:35.540307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-29629d0b-e9fb-46bd-815a-4c4775cdaa69 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:35.542790 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-29629d0b-e9fb-46bd-815a-4c4775cdaa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:35.609106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c203d8-03ef-437b-936f-34d68b5807c1 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:35.609652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c203d8-03ef-437b-936f-34d68b5807c1 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:35.611572 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c203d8-03ef-437b-936f-34d68b5807c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:35.699260 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-b3c203d8-03ef-437b-936f-34d68b5807c1 None None] MFA Rules not processed for user `6f0d7343fee749b89293973a422c22a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:35.713219 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 848/1695] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:35.719522 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b3c203d8-03ef-437b-936f-34d68b5807c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:35.785578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29629d0b-e9fb-46bd-815a-4c4775cdaa69 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:35.787778 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-29629d0b-e9fb-46bd-815a-4c4775cdaa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:35.987305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:35.998878 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 848/1696] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:55:35.999569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c203d8-03ef-437b-936f-34d68b5807c1 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:36.025658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29629d0b-e9fb-46bd-815a-4c4775cdaa69 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:36.045468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e292671-4bcc-48a7-bae1-6592c110794c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:36.046788 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b3c203d8-03ef-437b-936f-34d68b5807c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:36.047687 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e292671-4bcc-48a7-bae1-6592c110794c service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:36.049620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e292671-4bcc-48a7-bae1-6592c110794c service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:36.050604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e292671-4bcc-48a7-bae1-6592c110794c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:36.091261 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e292671-4bcc-48a7-bae1-6592c110794c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:36.096389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e292671-4bcc-48a7-bae1-6592c110794c service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:36.110810 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c203d8-03ef-437b-936f-34d68b5807c1 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:36.132950 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 849/1697] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:36.138069 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235a8e9-e683-4de2-9f68-e51f1295d32b None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:36.138937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235a8e9-e683-4de2-9f68-e51f1295d32b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:36.139038 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66e067-ab71-4243-9acd-84ce5d3e8dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:36.139869 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66e067-ab71-4243-9acd-84ce5d3e8dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:36.140342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66e067-ab71-4243-9acd-84ce5d3e8dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:36.140630 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66e067-ab71-4243-9acd-84ce5d3e8dbf admin admin] PATH_INFO: `/v3/projects/a98ccbc115bc4658985507916f080cfe` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:36.140822 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235a8e9-e683-4de2-9f68-e51f1295d32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:36.142713 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66e067-ab71-4243-9acd-84ce5d3e8dbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a98ccbc115bc4658985507916f080cfe)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:36.145454 dv-cinder-813229-13-smb devstack@keystone.service[80309]: WARNING py.warnings [None req-4b66e067-ab71-4243-9acd-84ce5d3e8dbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:55:36.145454 dv-cinder-813229-13-smb devstack@keystone.service[80309]: warnings.warn(msg) Jul 28 17:55:36.145454 dv-cinder-813229-13-smb devstack@keystone.service[80309]: Jul 28 17:55:36.146730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66e067-ab71-4243-9acd-84ce5d3e8dbf admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:36.175308 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-5235a8e9-e683-4de2-9f68-e51f1295d32b None None] MFA Rules not processed for user `6f0d7343fee749b89293973a422c22a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:36.177704 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5235a8e9-e683-4de2-9f68-e51f1295d32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:36.213035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 850/1698] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:36.227269 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235a8e9-e683-4de2-9f68-e51f1295d32b None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:36.229030 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5235a8e9-e683-4de2-9f68-e51f1295d32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:36.447724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4b66e067-ab71-4243-9acd-84ce5d3e8dbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a98ccbc115bc4658985507916f080cfe', 'request_id': 'req-4b66e067-ab71-4243-9acd-84ce5d3e8dbf'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:36.470741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4b66e067-ab71-4243-9acd-84ce5d3e8dbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a98ccbc115bc4658985507916f080cfe', 'request_id': 'req-4b66e067-ab71-4243-9acd-84ce5d3e8dbf'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:36.523663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4b66e067-ab71-4243-9acd-84ce5d3e8dbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a98ccbc115bc4658985507916f080cfe', 'request_id': 'req-4b66e067-ab71-4243-9acd-84ce5d3e8dbf'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:36.536396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:36.544559 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235a8e9-e683-4de2-9f68-e51f1295d32b None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:36.555493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4b66e067-ab71-4243-9acd-84ce5d3e8dbf admin admin] The token cache is being invalidate because project a98ccbc115bc4658985507916f080cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:55:36.556628 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4b66e067-ab71-4243-9acd-84ce5d3e8dbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:36.558304 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4b66e067-ab71-4243-9acd-84ce5d3e8dbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:36.566551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 849/1699] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:55:35 2022] DELETE /identity/v3/projects/a98ccbc115bc4658985507916f080cfe => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:36.567821 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66e067-ab71-4243-9acd-84ce5d3e8dbf admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:36.571872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-4b66e067-ab71-4243-9acd-84ce5d3e8dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:36.736110 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b84dc8-16ee-4895-b6a4-4bb3b4e18cd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:36.736786 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b84dc8-16ee-4895-b6a4-4bb3b4e18cd4 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:36.737174 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b84dc8-16ee-4895-b6a4-4bb3b4e18cd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:36.737535 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b84dc8-16ee-4895-b6a4-4bb3b4e18cd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:36.743880 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c4b84dc8-16ee-4895-b6a4-4bb3b4e18cd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:36.890964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66e067-ab71-4243-9acd-84ce5d3e8dbf admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:36.921888 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c64fc7-f795-475f-b221-269b26a5fc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:36.923512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b84dc8-16ee-4895-b6a4-4bb3b4e18cd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:36.926640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b84dc8-16ee-4895-b6a4-4bb3b4e18cd4 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:36.939083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c64fc7-f795-475f-b221-269b26a5fc28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:36.939389 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c64fc7-f795-475f-b221-269b26a5fc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:36.942970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c64fc7-f795-475f-b221-269b26a5fc28 admin admin] PATH_INFO: `/v3/users/10e9502c8c4a467b8e4f612d83d5b792` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:36.956187 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c64fc7-f795-475f-b221-269b26a5fc28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10e9502c8c4a467b8e4f612d83d5b792)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:36.963634 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c64fc7-f795-475f-b221-269b26a5fc28 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:36.964574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 851/1700] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 744 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:37.117834 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-46c64fc7-f795-475f-b221-269b26a5fc28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10e9502c8c4a467b8e4f612d83d5b792'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:37.178788 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-46c64fc7-f795-475f-b221-269b26a5fc28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10e9502c8c4a467b8e4f612d83d5b792'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:37.205784 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-46c64fc7-f795-475f-b221-269b26a5fc28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10e9502c8c4a467b8e4f612d83d5b792'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:37.233863 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-46c64fc7-f795-475f-b221-269b26a5fc28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10e9502c8c4a467b8e4f612d83d5b792'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:37.236564 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-46c64fc7-f795-475f-b221-269b26a5fc28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10e9502c8c4a467b8e4f612d83d5b792'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:37.261178 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 850/1701] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:55:36 2022] DELETE /identity/v3/users/10e9502c8c4a467b8e4f612d83d5b792 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:38.428837 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aec8a6-dbad-4f48-8e8f-e9b39077e3f4 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:38.429840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aec8a6-dbad-4f48-8e8f-e9b39077e3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:38.430317 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aec8a6-dbad-4f48-8e8f-e9b39077e3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:38.468904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d2aec8a6-dbad-4f48-8e8f-e9b39077e3f4 None None] MFA Rules not processed for user `7fe1bb900c544286ba2fbed4f1d8c066`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:38.470453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d2aec8a6-dbad-4f48-8e8f-e9b39077e3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:38.477006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:38.583093 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 852/1702] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:38.596732 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c632c-0d80-4580-ba48-37e7d52535be None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:38.597253 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c632c-0d80-4580-ba48-37e7d52535be None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:38.597804 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c632c-0d80-4580-ba48-37e7d52535be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:38.636903 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-f46c632c-0d80-4580-ba48-37e7d52535be None None] MFA Rules not processed for user `7fe1bb900c544286ba2fbed4f1d8c066`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:38.638306 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f46c632c-0d80-4580-ba48-37e7d52535be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:38.658247 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 851/1703] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:38.672931 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aec8a6-dbad-4f48-8e8f-e9b39077e3f4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:38.675055 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d2aec8a6-dbad-4f48-8e8f-e9b39077e3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:38.856006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aec8a6-dbad-4f48-8e8f-e9b39077e3f4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:38.890564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8932e5-5ec0-4db8-9bed-bdd763c0a1e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:38.893999 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8932e5-5ec0-4db8-9bed-bdd763c0a1e6 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:38.895295 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8932e5-5ec0-4db8-9bed-bdd763c0a1e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:38.896339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8932e5-5ec0-4db8-9bed-bdd763c0a1e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:38.912610 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8932e5-5ec0-4db8-9bed-bdd763c0a1e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:38.914412 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8932e5-5ec0-4db8-9bed-bdd763c0a1e6 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:38.926684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 853/1704] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:39.059460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c632c-0d80-4580-ba48-37e7d52535be None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:39.062368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f46c632c-0d80-4580-ba48-37e7d52535be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:39.146238 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becc454-2e18-491b-8582-2e46ea115838 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:39.147526 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becc454-2e18-491b-8582-2e46ea115838 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:39.147934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becc454-2e18-491b-8582-2e46ea115838 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:39.150335 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 854/1705] 10.222.0.96 () {54 vars in 912 bytes} [Thu Jul 28 17:55:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:55:39.160150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98e85a-c4f7-4ae6-ae1b-e62752182b2c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:39.160746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98e85a-c4f7-4ae6-ae1b-e62752182b2c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:39.161158 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98e85a-c4f7-4ae6-ae1b-e62752182b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:39.231653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c632c-0d80-4580-ba48-37e7d52535be None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:39.238131 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ae487-3c46-4662-8f09-8a34bc95faf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:39.239174 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ae487-3c46-4662-8f09-8a34bc95faf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:39.239697 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ae487-3c46-4662-8f09-8a34bc95faf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:39.240615 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ae487-3c46-4662-8f09-8a34bc95faf0 admin admin] PATH_INFO: `/v3/projects/24babe4b39724a94a76ee714b6aba68c` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:39.242799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ae487-3c46-4662-8f09-8a34bc95faf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24babe4b39724a94a76ee714b6aba68c)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:39.245654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ae487-3c46-4662-8f09-8a34bc95faf0 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:39.257794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:39.294465 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-9d98e85a-c4f7-4ae6-ae1b-e62752182b2c None None] MFA Rules not processed for user `76add49d4be940ad846d32fa16431988`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:39.296082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9d98e85a-c4f7-4ae6-ae1b-e62752182b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:39.359051 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4c5ae487-3c46-4662-8f09-8a34bc95faf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24babe4b39724a94a76ee714b6aba68c', 'request_id': 'req-4c5ae487-3c46-4662-8f09-8a34bc95faf0'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:39.375307 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4c5ae487-3c46-4662-8f09-8a34bc95faf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24babe4b39724a94a76ee714b6aba68c', 'request_id': 'req-4c5ae487-3c46-4662-8f09-8a34bc95faf0'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:39.383554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4c5ae487-3c46-4662-8f09-8a34bc95faf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24babe4b39724a94a76ee714b6aba68c', 'request_id': 'req-4c5ae487-3c46-4662-8f09-8a34bc95faf0'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:39.405151 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4c5ae487-3c46-4662-8f09-8a34bc95faf0 admin admin] The token cache is being invalidate because project 24babe4b39724a94a76ee714b6aba68c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:55:39.405457 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4c5ae487-3c46-4662-8f09-8a34bc95faf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:39.406302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4c5ae487-3c46-4662-8f09-8a34bc95faf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:39.411306 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 852/1706] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:55:39 2022] DELETE /identity/v3/projects/24babe4b39724a94a76ee714b6aba68c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:39.413529 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ae487-3c46-4662-8f09-8a34bc95faf0 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:39.415760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-4c5ae487-3c46-4662-8f09-8a34bc95faf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:39.475662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 855/1707] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Jul 28 17:55:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:55:39.477154 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4eae02-d6d3-4cf0-b41f-7eee81a01d3b None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:39.477610 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4eae02-d6d3-4cf0-b41f-7eee81a01d3b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:39.478172 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4eae02-d6d3-4cf0-b41f-7eee81a01d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:39.503145 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-dc4eae02-d6d3-4cf0-b41f-7eee81a01d3b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:39.504472 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-dc4eae02-d6d3-4cf0-b41f-7eee81a01d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:39.543374 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:39.566198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ae487-3c46-4662-8f09-8a34bc95faf0 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:39.579387 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d238e08-b2bf-40f5-b64b-1b383c7d7e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:39.581193 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d238e08-b2bf-40f5-b64b-1b383c7d7e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:39.581486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d238e08-b2bf-40f5-b64b-1b383c7d7e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:39.581763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d238e08-b2bf-40f5-b64b-1b383c7d7e54 admin admin] PATH_INFO: `/v3/projects/42e1575f8ead4a8abceab800b1d009bc` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:39.586741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d238e08-b2bf-40f5-b64b-1b383c7d7e54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42e1575f8ead4a8abceab800b1d009bc)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:39.595381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d238e08-b2bf-40f5-b64b-1b383c7d7e54 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:39.599005 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 856/1708] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:39.601340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e45a5a-9ab7-4452-bb36-26ab9a196ffd None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:39.601852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e45a5a-9ab7-4452-bb36-26ab9a196ffd None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:39.602295 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e45a5a-9ab7-4452-bb36-26ab9a196ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:39.630626 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-92e45a5a-9ab7-4452-bb36-26ab9a196ffd None None] MFA Rules not processed for user `d2a83fb7509446c3a342ea635eccf04d`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:39.632056 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-92e45a5a-9ab7-4452-bb36-26ab9a196ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:39.719616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5d238e08-b2bf-40f5-b64b-1b383c7d7e54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42e1575f8ead4a8abceab800b1d009bc', 'request_id': 'req-5d238e08-b2bf-40f5-b64b-1b383c7d7e54'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:39.725234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 857/1709] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:39.726480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e45a5a-9ab7-4452-bb36-26ab9a196ffd None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:39.728269 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-92e45a5a-9ab7-4452-bb36-26ab9a196ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:39.737013 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5d238e08-b2bf-40f5-b64b-1b383c7d7e54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42e1575f8ead4a8abceab800b1d009bc', 'request_id': 'req-5d238e08-b2bf-40f5-b64b-1b383c7d7e54'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:39.753134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5d238e08-b2bf-40f5-b64b-1b383c7d7e54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42e1575f8ead4a8abceab800b1d009bc', 'request_id': 'req-5d238e08-b2bf-40f5-b64b-1b383c7d7e54'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:39.770191 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5d238e08-b2bf-40f5-b64b-1b383c7d7e54 admin admin] The token cache is being invalidate because project 42e1575f8ead4a8abceab800b1d009bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:55:39.770503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5d238e08-b2bf-40f5-b64b-1b383c7d7e54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:39.773263 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5d238e08-b2bf-40f5-b64b-1b383c7d7e54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:39.775360 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 853/1710] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:55:39 2022] DELETE /identity/v3/projects/42e1575f8ead4a8abceab800b1d009bc => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:39.779618 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05094869-673b-446c-b77c-33507107f389 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:39.780114 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05094869-673b-446c-b77c-33507107f389 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:39.781507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05094869-673b-446c-b77c-33507107f389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:39.825618 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-05094869-673b-446c-b77c-33507107f389 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:39.826850 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-05094869-673b-446c-b77c-33507107f389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:39.875939 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e45a5a-9ab7-4452-bb36-26ab9a196ffd None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:39.910939 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:40.044597 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 854/1711] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:40.046836 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05094869-673b-446c-b77c-33507107f389 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:40.052916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-05094869-673b-446c-b77c-33507107f389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:40.077853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec091d6-cac1-47a2-b2f4-f7c9db2219a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:40.078507 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec091d6-cac1-47a2-b2f4-f7c9db2219a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:40.078790 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec091d6-cac1-47a2-b2f4-f7c9db2219a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:40.079066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec091d6-cac1-47a2-b2f4-f7c9db2219a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:40.083911 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4ec091d6-cac1-47a2-b2f4-f7c9db2219a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:40.098915 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05094869-673b-446c-b77c-33507107f389 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:40.110766 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538f62e-a127-4635-8e41-910cc7f24250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:40.111663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538f62e-a127-4635-8e41-910cc7f24250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:40.112063 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538f62e-a127-4635-8e41-910cc7f24250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:40.112910 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538f62e-a127-4635-8e41-910cc7f24250 admin admin] PATH_INFO: `/v3/users/a61bb8d4ff644e35b261ecb08fbf9fbd` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:40.130685 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538f62e-a127-4635-8e41-910cc7f24250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a61bb8d4ff644e35b261ecb08fbf9fbd)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:40.135634 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538f62e-a127-4635-8e41-910cc7f24250 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:40.143528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec091d6-cac1-47a2-b2f4-f7c9db2219a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:40.145091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec091d6-cac1-47a2-b2f4-f7c9db2219a4 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:40.164825 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 858/1712] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:40.166079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c95dbc-40d6-4b4f-b3e2-f8ec895e6363 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:40.166366 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c95dbc-40d6-4b4f-b3e2-f8ec895e6363 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:40.166644 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c95dbc-40d6-4b4f-b3e2-f8ec895e6363 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:40.181710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 859/1713] 10.222.0.96 () {54 vars in 912 bytes} [Thu Jul 28 17:55:40 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:55:40.193190 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c95dbc-40d6-4b4f-b3e2-f8ec895e6363 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:40.244956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c95dbc-40d6-4b4f-b3e2-f8ec895e6363 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:40.251895 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e538f62e-a127-4635-8e41-910cc7f24250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a61bb8d4ff644e35b261ecb08fbf9fbd'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:40.274098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251ad95-0a58-44fd-abc6-69a235c6d605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:40.274790 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251ad95-0a58-44fd-abc6-69a235c6d605 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:40.275071 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251ad95-0a58-44fd-abc6-69a235c6d605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:40.276196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251ad95-0a58-44fd-abc6-69a235c6d605 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:40.276196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251ad95-0a58-44fd-abc6-69a235c6d605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:55:40.276486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251ad95-0a58-44fd-abc6-69a235c6d605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:40.277944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e538f62e-a127-4635-8e41-910cc7f24250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a61bb8d4ff644e35b261ecb08fbf9fbd'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:40.286700 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251ad95-0a58-44fd-abc6-69a235c6d605 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:40.302329 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e538f62e-a127-4635-8e41-910cc7f24250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a61bb8d4ff644e35b261ecb08fbf9fbd'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:40.321754 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e538f62e-a127-4635-8e41-910cc7f24250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a61bb8d4ff644e35b261ecb08fbf9fbd'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:40.324406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 860/1714] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:55:40.326803 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e538f62e-a127-4635-8e41-910cc7f24250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a61bb8d4ff644e35b261ecb08fbf9fbd'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:40.331812 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7947d0f-30bf-4a8a-8246-d752db606c04 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:40.333686 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7947d0f-30bf-4a8a-8246-d752db606c04 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:40.334106 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7947d0f-30bf-4a8a-8246-d752db606c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:40.344176 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 855/1715] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:55:40 2022] DELETE /identity/v3/users/a61bb8d4ff644e35b261ecb08fbf9fbd => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:40.344176 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538f62e-a127-4635-8e41-910cc7f24250 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:40.347030 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e538f62e-a127-4635-8e41-910cc7f24250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:40.388560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e7947d0f-30bf-4a8a-8246-d752db606c04 None None] MFA Rules not processed for user `76add49d4be940ad846d32fa16431988`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:40.393403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e7947d0f-30bf-4a8a-8246-d752db606c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:40.432694 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:40.552329 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538f62e-a127-4635-8e41-910cc7f24250 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:40.573088 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 861/1716] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Jul 28 17:55:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:40.574854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59028e3-60ac-44dc-816e-fffa2bd39186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:40.574854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59028e3-60ac-44dc-816e-fffa2bd39186 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:40.575044 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59028e3-60ac-44dc-816e-fffa2bd39186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:40.575247 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59028e3-60ac-44dc-816e-fffa2bd39186 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:40.580455 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59028e3-60ac-44dc-816e-fffa2bd39186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:40.589890 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59028e3-60ac-44dc-816e-fffa2bd39186 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:40.693037 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 856/1717] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:40 2022] POST /identity/v3/projects => generated 385 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:40.697607 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7947d0f-30bf-4a8a-8246-d752db606c04 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:40.718235 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7947d0f-30bf-4a8a-8246-d752db606c04 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:40.725479 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59028e3-60ac-44dc-816e-fffa2bd39186 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:40.728870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-c59028e3-60ac-44dc-816e-fffa2bd39186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:40.840659 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:40.846604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843563b5-df0c-486d-8f84-d50f2cc9fec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:40.847551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843563b5-df0c-486d-8f84-d50f2cc9fec7 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:40.848040 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843563b5-df0c-486d-8f84-d50f2cc9fec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:40.848750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843563b5-df0c-486d-8f84-d50f2cc9fec7 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:40.849993 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843563b5-df0c-486d-8f84-d50f2cc9fec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:40.853028 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843563b5-df0c-486d-8f84-d50f2cc9fec7 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:40.903025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 862/1718] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:40 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:40.906787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843563b5-df0c-486d-8f84-d50f2cc9fec7 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:40.931194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59028e3-60ac-44dc-816e-fffa2bd39186 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:40.940139 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d683c47-8788-466d-a82f-5732692267df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:40.946146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d683c47-8788-466d-a82f-5732692267df service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:40.946584 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d683c47-8788-466d-a82f-5732692267df service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:40.946997 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d683c47-8788-466d-a82f-5732692267df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:40.949852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843563b5-df0c-486d-8f84-d50f2cc9fec7 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:40.956877 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a732af-aa90-4282-a709-340c4d306bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:40.957618 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a732af-aa90-4282-a709-340c4d306bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:40.957901 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a732af-aa90-4282-a709-340c4d306bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:40.959622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a732af-aa90-4282-a709-340c4d306bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:40.960332 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a732af-aa90-4282-a709-340c4d306bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:40.965365 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a732af-aa90-4282-a709-340c4d306bd2 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:40.976229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d683c47-8788-466d-a82f-5732692267df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:40.980543 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d683c47-8788-466d-a82f-5732692267df service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:41.009817 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 863/1719] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:41.013999 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a732af-aa90-4282-a709-340c4d306bd2 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:41.034997 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 857/1720] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:41.054457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a732af-aa90-4282-a709-340c4d306bd2 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:41.067458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49238680-7aa7-4ba3-80db-84c76054fd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:41.072097 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49238680-7aa7-4ba3-80db-84c76054fd21 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:41.072474 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49238680-7aa7-4ba3-80db-84c76054fd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:41.072760 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49238680-7aa7-4ba3-80db-84c76054fd21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:41.078604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49238680-7aa7-4ba3-80db-84c76054fd21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:41.080285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49238680-7aa7-4ba3-80db-84c76054fd21 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:41.111666 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 864/1721] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:41.115336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d683c47-8788-466d-a82f-5732692267df service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:41.144795 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d683c47-8788-466d-a82f-5732692267df service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:41.171510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13796e9d-2250-4faf-b9b8-d7f3a015af11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:41.172201 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13796e9d-2250-4faf-b9b8-d7f3a015af11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:41.172479 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13796e9d-2250-4faf-b9b8-d7f3a015af11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:41.172758 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13796e9d-2250-4faf-b9b8-d7f3a015af11 admin admin] PATH_INFO: `/v3/projects/61304086ba9443b0a32b0d72995f8715/users/253572edc5744385a8cc8edc7f050e86/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:41.245775 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13796e9d-2250-4faf-b9b8-d7f3a015af11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61304086ba9443b0a32b0d72995f8715, user_id=253572edc5744385a8cc8edc7f050e86, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:41.257225 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13796e9d-2250-4faf-b9b8-d7f3a015af11 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:41.280584 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49238680-7aa7-4ba3-80db-84c76054fd21 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:41.282990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-49238680-7aa7-4ba3-80db-84c76054fd21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:41.347140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 858/1722] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:41 2022] PUT /identity/v3/projects/61304086ba9443b0a32b0d72995f8715/users/253572edc5744385a8cc8edc7f050e86/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:41.347582 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49238680-7aa7-4ba3-80db-84c76054fd21 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:41.347674 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e005a0-9d69-4389-bc7d-7ea798fac057 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:41.347674 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e005a0-9d69-4389-bc7d-7ea798fac057 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:41.347674 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e005a0-9d69-4389-bc7d-7ea798fac057 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:41.371344 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 859/1723] 10.222.0.96 () {54 vars in 961 bytes} [Thu Jul 28 17:55:41 2022] GET /identity => generated 270 bytes in 32 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:55:41.378472 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0866c8-029c-47a9-94b7-42a9422bf2c1 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:41.378896 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0866c8-029c-47a9-94b7-42a9422bf2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:41.380750 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0866c8-029c-47a9-94b7-42a9422bf2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:41.461000 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-2c0866c8-029c-47a9-94b7-42a9422bf2c1 None None] MFA Rules not processed for user `253572edc5744385a8cc8edc7f050e86`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:41.464399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-2c0866c8-029c-47a9-94b7-42a9422bf2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:41.523316 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9dbeba-b365-4fbd-a527-c39b13d829ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:41.525196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dbeba-b365-4fbd-a527-c39b13d829ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:41.525477 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dbeba-b365-4fbd-a527-c39b13d829ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:41.525778 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dbeba-b365-4fbd-a527-c39b13d829ae admin admin] PATH_INFO: `/v3/projects/bc95af70915d46b4a1bec6751142a2c5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:41.529689 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9dbeba-b365-4fbd-a527-c39b13d829ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc95af70915d46b4a1bec6751142a2c5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:41.535176 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9dbeba-b365-4fbd-a527-c39b13d829ae admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:41.654513 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 860/1724] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:41.657666 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2f536-a9f7-484b-be44-e07938dec68f None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:41.657952 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2f536-a9f7-484b-be44-e07938dec68f None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:41.658226 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2f536-a9f7-484b-be44-e07938dec68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:41.661298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:41.693954 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1d9dbeba-b365-4fbd-a527-c39b13d829ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc95af70915d46b4a1bec6751142a2c5', 'request_id': 'req-1d9dbeba-b365-4fbd-a527-c39b13d829ae'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:41.710592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1d9dbeba-b365-4fbd-a527-c39b13d829ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc95af70915d46b4a1bec6751142a2c5', 'request_id': 'req-1d9dbeba-b365-4fbd-a527-c39b13d829ae'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:41.721522 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-79c2f536-a9f7-484b-be44-e07938dec68f None None] MFA Rules not processed for user `38257735924d44488e1407fefb886324`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:41.722760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-79c2f536-a9f7-484b-be44-e07938dec68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:41.737538 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1d9dbeba-b365-4fbd-a527-c39b13d829ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc95af70915d46b4a1bec6751142a2c5', 'request_id': 'req-1d9dbeba-b365-4fbd-a527-c39b13d829ae'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:41.777282 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1d9dbeba-b365-4fbd-a527-c39b13d829ae admin admin] The token cache is being invalidate because project bc95af70915d46b4a1bec6751142a2c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:55:41.777891 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1d9dbeba-b365-4fbd-a527-c39b13d829ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:41.783832 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1d9dbeba-b365-4fbd-a527-c39b13d829ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:41.796034 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 865/1725] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:55:41 2022] DELETE /identity/v3/projects/bc95af70915d46b4a1bec6751142a2c5 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:41.796926 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9dbeba-b365-4fbd-a527-c39b13d829ae admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:41.799897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1d9dbeba-b365-4fbd-a527-c39b13d829ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:42.015424 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 861/1726] 10.222.0.96 () {58 vars in 1058 bytes} [Thu Jul 28 17:55:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:42.016749 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb13e21-885e-4340-9c92-a4f146a7bfa0 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:42.017033 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb13e21-885e-4340-9c92-a4f146a7bfa0 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:42.017534 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb13e21-885e-4340-9c92-a4f146a7bfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:42.039871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9dbeba-b365-4fbd-a527-c39b13d829ae admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:42.053666 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-aeb13e21-885e-4340-9c92-a4f146a7bfa0 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:42.059519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-aeb13e21-885e-4340-9c92-a4f146a7bfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:42.060112 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e3487-2590-4e66-8083-210f4cfee50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:42.063893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e3487-2590-4e66-8083-210f4cfee50c admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:42.064250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e3487-2590-4e66-8083-210f4cfee50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:42.064543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e3487-2590-4e66-8083-210f4cfee50c admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:42.066048 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e3487-2590-4e66-8083-210f4cfee50c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:42.073205 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e3487-2590-4e66-8083-210f4cfee50c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:42.083869 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 862/1727] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:42.092079 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb13e21-885e-4340-9c92-a4f146a7bfa0 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:42.139636 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 866/1728] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:41 2022] POST /identity/v3/projects => generated 387 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:42.162828 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb13e21-885e-4340-9c92-a4f146a7bfa0 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:42.164527 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce339d-7c56-4f83-ab4c-2d7e05cc246a None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:42.165259 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce339d-7c56-4f83-ab4c-2d7e05cc246a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:42.166829 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce339d-7c56-4f83-ab4c-2d7e05cc246a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:42.273751 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c7ce339d-7c56-4f83-ab4c-2d7e05cc246a None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:42.275749 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c7ce339d-7c56-4f83-ab4c-2d7e05cc246a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:42.290335 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:42.446900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 867/1729] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:42.448012 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce339d-7c56-4f83-ab4c-2d7e05cc246a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:42.450821 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d952a7-e88e-449d-8a9f-113210a0b932 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38257735924d44488e1407fefb886324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:42.451477 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d952a7-e88e-449d-8a9f-113210a0b932 service placement] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:42.451749 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d952a7-e88e-449d-8a9f-113210a0b932 service placement] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:42.453604 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d952a7-e88e-449d-8a9f-113210a0b932 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:42.456732 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-06d952a7-e88e-449d-8a9f-113210a0b932 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:42.469747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d952a7-e88e-449d-8a9f-113210a0b932 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:42.471360 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d952a7-e88e-449d-8a9f-113210a0b932 service placement] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:42.471591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce339d-7c56-4f83-ab4c-2d7e05cc246a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:42.482009 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d1136-4dea-42b9-921f-ab62b205a895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:42.482860 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d1136-4dea-42b9-921f-ab62b205a895 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:42.483238 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d1136-4dea-42b9-921f-ab62b205a895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:42.483616 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d1136-4dea-42b9-921f-ab62b205a895 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:42.484517 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 863/1730] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:42.486157 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8ff8e-7526-427a-92ae-b2a2027e2726 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:42.486447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8ff8e-7526-427a-92ae-b2a2027e2726 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:42.486724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8ff8e-7526-427a-92ae-b2a2027e2726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:42.494732 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d1136-4dea-42b9-921f-ab62b205a895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:42.500163 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d1136-4dea-42b9-921f-ab62b205a895 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:42.507639 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-dbc8ff8e-7526-427a-92ae-b2a2027e2726 None None] MFA Rules not processed for user `6f0d7343fee749b89293973a422c22a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:42.509389 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-dbc8ff8e-7526-427a-92ae-b2a2027e2726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:42.546423 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 868/1731] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:42 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:42.547931 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d1136-4dea-42b9-921f-ab62b205a895 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:42.554497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9b0d1136-4dea-42b9-921f-ab62b205a895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:42.580792 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 864/1732] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:42.587760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8ff8e-7526-427a-92ae-b2a2027e2726 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:42.596534 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d1136-4dea-42b9-921f-ab62b205a895 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:42.618396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8ff8e-7526-427a-92ae-b2a2027e2726 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:42.625707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f381231-c86d-47d2-9564-0e6676378f61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38257735924d44488e1407fefb886324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:42.626346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f381231-c86d-47d2-9564-0e6676378f61 service placement] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:42.626630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f381231-c86d-47d2-9564-0e6676378f61 service placement] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:42.626906 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f381231-c86d-47d2-9564-0e6676378f61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:42.632281 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643fd40-2d04-4a7f-a933-180cee1b635b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:42.633039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643fd40-2d04-4a7f-a933-180cee1b635b admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:42.633520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643fd40-2d04-4a7f-a933-180cee1b635b admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:42.634015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643fd40-2d04-4a7f-a933-180cee1b635b admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:42.635484 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643fd40-2d04-4a7f-a933-180cee1b635b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:55:42.635905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643fd40-2d04-4a7f-a933-180cee1b635b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:42.636537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f381231-c86d-47d2-9564-0e6676378f61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:42.638382 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643fd40-2d04-4a7f-a933-180cee1b635b admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:42.640882 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f381231-c86d-47d2-9564-0e6676378f61 service placement] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:42.654213 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 865/1733] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:55:42.658462 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 869/1734] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:42.660600 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f381231-c86d-47d2-9564-0e6676378f61 service placement] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:42.660755 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643fd40-2d04-4a7f-a933-180cee1b635b admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:42.672494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643fd40-2d04-4a7f-a933-180cee1b635b admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:42.673650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f381231-c86d-47d2-9564-0e6676378f61 service placement] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:42.678653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b768f9-931b-4e83-bee0-2401b09f6092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:42.679505 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b768f9-931b-4e83-bee0-2401b09f6092 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:42.679879 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b768f9-931b-4e83-bee0-2401b09f6092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:42.680531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b768f9-931b-4e83-bee0-2401b09f6092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:42.680639 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f90ce6-4c19-446f-9edc-8ba62b2a07fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:42.681653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b768f9-931b-4e83-bee0-2401b09f6092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:42.683602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b768f9-931b-4e83-bee0-2401b09f6092 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:42.685255 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f90ce6-4c19-446f-9edc-8ba62b2a07fb admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:42.685563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f90ce6-4c19-446f-9edc-8ba62b2a07fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:42.685969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f90ce6-4c19-446f-9edc-8ba62b2a07fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:42.687225 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f90ce6-4c19-446f-9edc-8ba62b2a07fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:42.688834 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f90ce6-4c19-446f-9edc-8ba62b2a07fb admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:42.715586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 866/1735] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:42.715586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b768f9-931b-4e83-bee0-2401b09f6092 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:42.724399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b768f9-931b-4e83-bee0-2401b09f6092 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:42.748338 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbbb2c-c3cd-48f8-b74e-a96a5a578d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:42.749249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbbb2c-c3cd-48f8-b74e-a96a5a578d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:42.750793 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbbb2c-c3cd-48f8-b74e-a96a5a578d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:42.751069 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:42.752591 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbbb2c-c3cd-48f8-b74e-a96a5a578d55 admin admin] PATH_INFO: `/v3/projects/814fb203eb1e40328174ebd4cb649290/users/831cb95d8e114a72bcc8dc6d95b501ad/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:42.769584 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 870/1736] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:42 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:42.773818 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f90ce6-4c19-446f-9edc-8ba62b2a07fb admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:42.853366 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbbb2c-c3cd-48f8-b74e-a96a5a578d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=814fb203eb1e40328174ebd4cb649290, user_id=831cb95d8e114a72bcc8dc6d95b501ad, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:42.866179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbbb2c-c3cd-48f8-b74e-a96a5a578d55 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:42.939315 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 867/1737] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:42 2022] PUT /identity/v3/projects/814fb203eb1e40328174ebd4cb649290/users/831cb95d8e114a72bcc8dc6d95b501ad/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:55:42.940456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbbb2c-c3cd-48f8-b74e-a96a5a578d55 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:42.953078 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f90ce6-4c19-446f-9edc-8ba62b2a07fb admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:43.185107 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad97379-7d9b-4fb1-aaf8-ff9abb1aa4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:43.185699 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad97379-7d9b-4fb1-aaf8-ff9abb1aa4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:43.185979 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad97379-7d9b-4fb1-aaf8-ff9abb1aa4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:43.186260 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad97379-7d9b-4fb1-aaf8-ff9abb1aa4a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:43.186938 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad97379-7d9b-4fb1-aaf8-ff9abb1aa4a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:43.188894 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad97379-7d9b-4fb1-aaf8-ff9abb1aa4a1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:43.217591 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbbb2c-c3cd-48f8-b74e-a96a5a578d55 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:43.235512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dde77-c292-43ac-a367-f740fc2c2870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:43.237858 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dde77-c292-43ac-a367-f740fc2c2870 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:43.240589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dde77-c292-43ac-a367-f740fc2c2870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:43.241604 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dde77-c292-43ac-a367-f740fc2c2870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:43.244766 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13dde77-c292-43ac-a367-f740fc2c2870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:43.263289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13dde77-c292-43ac-a367-f740fc2c2870 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:43.267727 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 871/1738] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:42 2022] POST /identity/v3/users => generated 289 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:43.277679 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 868/1739] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:43.285029 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad97379-7d9b-4fb1-aaf8-ff9abb1aa4a1 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:43.289905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dde77-c292-43ac-a367-f740fc2c2870 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:43.308793 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dde77-c292-43ac-a367-f740fc2c2870 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:43.323252 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394604af-d89d-4cda-96fd-63db1d27a100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:43.325325 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad97379-7d9b-4fb1-aaf8-ff9abb1aa4a1 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:43.325455 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394604af-d89d-4cda-96fd-63db1d27a100 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:43.325455 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394604af-d89d-4cda-96fd-63db1d27a100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:43.325455 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394604af-d89d-4cda-96fd-63db1d27a100 admin admin] PATH_INFO: `/v3/projects/814fb203eb1e40328174ebd4cb649290/users/831cb95d8e114a72bcc8dc6d95b501ad/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:43.327307 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394604af-d89d-4cda-96fd-63db1d27a100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=814fb203eb1e40328174ebd4cb649290, user_id=831cb95d8e114a72bcc8dc6d95b501ad, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:43.329986 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394604af-d89d-4cda-96fd-63db1d27a100 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:43.334815 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:43.343462 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b822d-894e-45ea-842c-fb2d1c5d28b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:43.348232 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b822d-894e-45ea-842c-fb2d1c5d28b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:43.348896 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b822d-894e-45ea-842c-fb2d1c5d28b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:43.353408 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b822d-894e-45ea-842c-fb2d1c5d28b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:43.356833 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b822d-894e-45ea-842c-fb2d1c5d28b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:43.359485 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b822d-894e-45ea-842c-fb2d1c5d28b7 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:43.361332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 869/1740] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:43 2022] PUT /identity/v3/projects/814fb203eb1e40328174ebd4cb649290/users/831cb95d8e114a72bcc8dc6d95b501ad/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:43.374648 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852d46a-c519-41d6-95a6-baf9a4c59c86 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:43.374935 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852d46a-c519-41d6-95a6-baf9a4c59c86 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:43.375238 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852d46a-c519-41d6-95a6-baf9a4c59c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:43.396139 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 872/1741] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:43.401023 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b822d-894e-45ea-842c-fb2d1c5d28b7 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:43.433665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b822d-894e-45ea-842c-fb2d1c5d28b7 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:43.456069 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-f852d46a-c519-41d6-95a6-baf9a4c59c86 None None] MFA Rules not processed for user `831cb95d8e114a72bcc8dc6d95b501ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:43.458362 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f852d46a-c519-41d6-95a6-baf9a4c59c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:43.656750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31dc016-bcb0-4945-9419-93aa91e509b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:43.656750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dc016-bcb0-4945-9419-93aa91e509b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:43.657133 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dc016-bcb0-4945-9419-93aa91e509b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:43.657327 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dc016-bcb0-4945-9419-93aa91e509b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:43.660727 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31dc016-bcb0-4945-9419-93aa91e509b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:43.663318 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31dc016-bcb0-4945-9419-93aa91e509b0 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:43.696802 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 873/1742] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:55:43.699803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31dc016-bcb0-4945-9419-93aa91e509b0 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:43.757621 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31dc016-bcb0-4945-9419-93aa91e509b0 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:43.771960 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab3d77-2a51-4e7e-a2fe-c99ddebeb22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:43.773081 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab3d77-2a51-4e7e-a2fe-c99ddebeb22a admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:43.773560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab3d77-2a51-4e7e-a2fe-c99ddebeb22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:43.774294 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab3d77-2a51-4e7e-a2fe-c99ddebeb22a admin admin] PATH_INFO: `/v3/projects/ffcc1138f30b40a396aaeaf5cb7932e7/users/463cb90d2bc74d1caa580d0eabce3f05/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:43.780333 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 870/1743] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:43.794390 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852d46a-c519-41d6-95a6-baf9a4c59c86 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:43.798308 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f852d46a-c519-41d6-95a6-baf9a4c59c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:43.804202 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab3d77-2a51-4e7e-a2fe-c99ddebeb22a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffcc1138f30b40a396aaeaf5cb7932e7, user_id=463cb90d2bc74d1caa580d0eabce3f05, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:43.807984 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab3d77-2a51-4e7e-a2fe-c99ddebeb22a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:43.812541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:43.857601 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 874/1744] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:43 2022] PUT /identity/v3/projects/ffcc1138f30b40a396aaeaf5cb7932e7/users/463cb90d2bc74d1caa580d0eabce3f05/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:43.866673 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b07031-da7b-4a7f-b6d6-c9b144af9d82 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:43.875416 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b07031-da7b-4a7f-b6d6-c9b144af9d82 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:43.876034 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b07031-da7b-4a7f-b6d6-c9b144af9d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:43.951061 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a9b07031-da7b-4a7f-b6d6-c9b144af9d82 None None] MFA Rules not processed for user `463cb90d2bc74d1caa580d0eabce3f05`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:43.952728 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a9b07031-da7b-4a7f-b6d6-c9b144af9d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:44.086824 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852d46a-c519-41d6-95a6-baf9a4c59c86 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:44.238546 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 875/1745] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:44.239703 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b07031-da7b-4a7f-b6d6-c9b144af9d82 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:44.354806 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bef1a1-8c1a-4913-bcc1-a3204fb6b2ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:44.355467 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bef1a1-8c1a-4913-bcc1-a3204fb6b2ad service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:44.355755 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bef1a1-8c1a-4913-bcc1-a3204fb6b2ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:44.356661 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bef1a1-8c1a-4913-bcc1-a3204fb6b2ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:44.452972 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b07031-da7b-4a7f-b6d6-c9b144af9d82 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:44.467466 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b8e0a-4d37-4478-8893-a549717d237f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:44.468109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b8e0a-4d37-4478-8893-a549717d237f admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:44.468391 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b8e0a-4d37-4478-8893-a549717d237f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:44.474200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b8e0a-4d37-4478-8893-a549717d237f admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:44.475145 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b8e0a-4d37-4478-8893-a549717d237f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:44.481341 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b8e0a-4d37-4478-8893-a549717d237f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:44.520850 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:44.556565 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 876/1746] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:44 2022] POST /identity/v3/projects => generated 377 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:44.560485 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b8e0a-4d37-4478-8893-a549717d237f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:44.569045 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bef1a1-8c1a-4913-bcc1-a3204fb6b2ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:44.572657 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bef1a1-8c1a-4913-bcc1-a3204fb6b2ad service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:44.617797 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 871/1747] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 822 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:44.675983 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bef1a1-8c1a-4913-bcc1-a3204fb6b2ad service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:44.691753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bef1a1-8c1a-4913-bcc1-a3204fb6b2ad service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:44.755363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b8e0a-4d37-4478-8893-a549717d237f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:44.774311 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b2e6c-82d0-4303-a438-291ce1a45420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:44.774953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b2e6c-82d0-4303-a438-291ce1a45420 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:44.775230 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b2e6c-82d0-4303-a438-291ce1a45420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:44.775499 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b2e6c-82d0-4303-a438-291ce1a45420 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:44.776287 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b2e6c-82d0-4303-a438-291ce1a45420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:44.788141 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b2e6c-82d0-4303-a438-291ce1a45420 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:44.831616 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:44.849717 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 877/1748] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:44 2022] POST /identity/v3/users => generated 289 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:44.849717 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b2e6c-82d0-4303-a438-291ce1a45420 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:44.878525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b2e6c-82d0-4303-a438-291ce1a45420 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:44.901017 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fd0e8-002c-4793-9e74-d6cf8a665269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:44.902948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fd0e8-002c-4793-9e74-d6cf8a665269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:44.905567 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332d69f-0909-424f-9ec1-8d5a6a0ff240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:44.906334 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332d69f-0909-424f-9ec1-8d5a6a0ff240 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:44.906612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332d69f-0909-424f-9ec1-8d5a6a0ff240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:44.906887 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332d69f-0909-424f-9ec1-8d5a6a0ff240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:44.907590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332d69f-0909-424f-9ec1-8d5a6a0ff240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:44.909786 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fd0e8-002c-4793-9e74-d6cf8a665269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:44.910254 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fd0e8-002c-4793-9e74-d6cf8a665269 admin admin] PATH_INFO: `/v3/users/253572edc5744385a8cc8edc7f050e86` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:44.913325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fd0e8-002c-4793-9e74-d6cf8a665269 admin admin] RBAC: Authorizing `identity:delete_user(user_id=253572edc5744385a8cc8edc7f050e86)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:44.918150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332d69f-0909-424f-9ec1-8d5a6a0ff240 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:44.920831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fd0e8-002c-4793-9e74-d6cf8a665269 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:44.963153 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 878/1749] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:44.968716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332d69f-0909-424f-9ec1-8d5a6a0ff240 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:45.019925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332d69f-0909-424f-9ec1-8d5a6a0ff240 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:45.043805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c0801-5815-499b-ae55-efe525d7dde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:45.044419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c0801-5815-499b-ae55-efe525d7dde8 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:45.044816 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c0801-5815-499b-ae55-efe525d7dde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:45.045397 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c0801-5815-499b-ae55-efe525d7dde8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:45.046262 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c0801-5815-499b-ae55-efe525d7dde8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:45.051662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c0801-5815-499b-ae55-efe525d7dde8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:45.085714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 879/1750] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:45.095928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c0801-5815-499b-ae55-efe525d7dde8 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:45.105892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c29fd0e8-002c-4793-9e74-d6cf8a665269 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '253572edc5744385a8cc8edc7f050e86'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:45.134576 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c0801-5815-499b-ae55-efe525d7dde8 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:45.141777 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c29fd0e8-002c-4793-9e74-d6cf8a665269 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '253572edc5744385a8cc8edc7f050e86'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:45.154027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0149e42-e844-45e3-94cd-6716b4e823fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:45.158274 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0149e42-e844-45e3-94cd-6716b4e823fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:45.159806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0149e42-e844-45e3-94cd-6716b4e823fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:45.161603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0149e42-e844-45e3-94cd-6716b4e823fe admin admin] PATH_INFO: `/v3/projects/047c92930865416abf9826d66cef8840/users/ef56e7921b3f4bec976b058a6d92538c/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:45.163355 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c29fd0e8-002c-4793-9e74-d6cf8a665269 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '253572edc5744385a8cc8edc7f050e86'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:45.192399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c29fd0e8-002c-4793-9e74-d6cf8a665269 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '253572edc5744385a8cc8edc7f050e86'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:45.198690 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c29fd0e8-002c-4793-9e74-d6cf8a665269 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '253572edc5744385a8cc8edc7f050e86'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:45.215111 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 872/1751] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:55:44 2022] DELETE /identity/v3/users/253572edc5744385a8cc8edc7f050e86 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:45.221445 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a626f2-578d-4530-b225-e5597e186181 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:45.223704 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a626f2-578d-4530-b225-e5597e186181 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:45.224104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a626f2-578d-4530-b225-e5597e186181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:45.231430 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0149e42-e844-45e3-94cd-6716b4e823fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=047c92930865416abf9826d66cef8840, user_id=ef56e7921b3f4bec976b058a6d92538c, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:45.245192 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0149e42-e844-45e3-94cd-6716b4e823fe admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:45.287026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-e1a626f2-578d-4530-b225-e5597e186181 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:45.295205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e1a626f2-578d-4530-b225-e5597e186181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:45.311037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 880/1752] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:45 2022] PUT /identity/v3/projects/047c92930865416abf9826d66cef8840/users/ef56e7921b3f4bec976b058a6d92538c/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:45.314321 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e9399-88b4-4957-beff-0a1dcba6de49 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:45.315567 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e9399-88b4-4957-beff-0a1dcba6de49 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:45.316455 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e9399-88b4-4957-beff-0a1dcba6de49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:45.381094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d65e9399-88b4-4957-beff-0a1dcba6de49 None None] MFA Rules not processed for user `ef56e7921b3f4bec976b058a6d92538c`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:45.382599 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d65e9399-88b4-4957-beff-0a1dcba6de49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:45.439671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 873/1753] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:45.449999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a626f2-578d-4530-b225-e5597e186181 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:45.451582 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e1a626f2-578d-4530-b225-e5597e186181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:45.465325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:45.504179 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 881/1754] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:55:45.509301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e9399-88b4-4957-beff-0a1dcba6de49 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:45.513430 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d65e9399-88b4-4957-beff-0a1dcba6de49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:45.545821 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e9399-88b4-4957-beff-0a1dcba6de49 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:45.555978 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529fa3e-116f-43a6-8677-c67e69fd883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:45.561924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529fa3e-116f-43a6-8677-c67e69fd883c admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:45.580577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529fa3e-116f-43a6-8677-c67e69fd883c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:45.580873 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529fa3e-116f-43a6-8677-c67e69fd883c admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:45.581647 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529fa3e-116f-43a6-8677-c67e69fd883c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:45.595931 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529fa3e-116f-43a6-8677-c67e69fd883c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:45.604656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a626f2-578d-4530-b225-e5597e186181 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:45.609327 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8560518-da59-4849-8122-4a2e7624ac5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:45.610191 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8560518-da59-4849-8122-4a2e7624ac5d service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:45.610566 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8560518-da59-4849-8122-4a2e7624ac5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:45.610935 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8560518-da59-4849-8122-4a2e7624ac5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:45.660180 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8560518-da59-4849-8122-4a2e7624ac5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:45.665583 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8560518-da59-4849-8122-4a2e7624ac5d service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:45.680774 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 882/1755] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:45 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:55:45.683787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529fa3e-116f-43a6-8677-c67e69fd883c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:45.692173 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 874/1756] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:55:45.832792 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529fa3e-116f-43a6-8677-c67e69fd883c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:45.843564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924536fd-ed7d-47a4-9a19-c7659394a435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:45.844517 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924536fd-ed7d-47a4-9a19-c7659394a435 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:45.844903 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924536fd-ed7d-47a4-9a19-c7659394a435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:45.846330 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924536fd-ed7d-47a4-9a19-c7659394a435 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:45.847298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924536fd-ed7d-47a4-9a19-c7659394a435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:45.849397 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924536fd-ed7d-47a4-9a19-c7659394a435 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:45.939271 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 883/1757] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:45 2022] POST /identity/v3/users => generated 295 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:45.943034 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8560518-da59-4849-8122-4a2e7624ac5d service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:45.961672 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8560518-da59-4849-8122-4a2e7624ac5d service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:45.968768 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c9452-f2cc-4bbf-86e8-29ae68b51f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:45.969756 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c9452-f2cc-4bbf-86e8-29ae68b51f70 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:45.970212 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c9452-f2cc-4bbf-86e8-29ae68b51f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:45.970755 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c9452-f2cc-4bbf-86e8-29ae68b51f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:45.971585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c9452-f2cc-4bbf-86e8-29ae68b51f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:45.973942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c9452-f2cc-4bbf-86e8-29ae68b51f70 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:46.013841 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 875/1758] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:46.031558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924536fd-ed7d-47a4-9a19-c7659394a435 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:46.076015 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924536fd-ed7d-47a4-9a19-c7659394a435 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:46.089791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a33001-3924-4652-a9d5-713ec9b7a8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:46.091663 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a33001-3924-4652-a9d5-713ec9b7a8cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:46.091961 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a33001-3924-4652-a9d5-713ec9b7a8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:46.095002 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a33001-3924-4652-a9d5-713ec9b7a8cb admin admin] PATH_INFO: `/v3/projects/7a788fb80bb349c584df29052b2389a2/users/aca93f72c2fb41aa8184ce6f9d1f5d6f/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:46.120449 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:46.152290 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a33001-3924-4652-a9d5-713ec9b7a8cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a788fb80bb349c584df29052b2389a2, user_id=aca93f72c2fb41aa8184ce6f9d1f5d6f, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:46.165038 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a33001-3924-4652-a9d5-713ec9b7a8cb admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:46.204798 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 884/1759] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:46 2022] PUT /identity/v3/projects/7a788fb80bb349c584df29052b2389a2/users/aca93f72c2fb41aa8184ce6f9d1f5d6f/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:46.208659 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c9452-f2cc-4bbf-86e8-29ae68b51f70 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:46.254299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c9452-f2cc-4bbf-86e8-29ae68b51f70 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:46.422903 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d82205-8b92-4bdb-865a-04b4796796f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:46.423863 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d82205-8b92-4bdb-865a-04b4796796f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:46.424290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d82205-8b92-4bdb-865a-04b4796796f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:46.424718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d82205-8b92-4bdb-865a-04b4796796f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:46.425867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d82205-8b92-4bdb-865a-04b4796796f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:46.427821 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d82205-8b92-4bdb-865a-04b4796796f9 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:46.450461 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 876/1760] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:55:46.451388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a33001-3924-4652-a9d5-713ec9b7a8cb admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:46.483339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a33001-3924-4652-a9d5-713ec9b7a8cb admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:46.490686 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b96cb-4758-40ac-9d19-08fe88cbb6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:46.491878 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b96cb-4758-40ac-9d19-08fe88cbb6e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:46.492898 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b96cb-4758-40ac-9d19-08fe88cbb6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:46.507926 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b96cb-4758-40ac-9d19-08fe88cbb6e8 admin admin] PATH_INFO: `/v3/projects/7a788fb80bb349c584df29052b2389a2/users/aca93f72c2fb41aa8184ce6f9d1f5d6f/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:46.512379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b96cb-4758-40ac-9d19-08fe88cbb6e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a788fb80bb349c584df29052b2389a2, user_id=aca93f72c2fb41aa8184ce6f9d1f5d6f, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:46.520127 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b96cb-4758-40ac-9d19-08fe88cbb6e8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:46.554921 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 885/1761] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:46 2022] PUT /identity/v3/projects/7a788fb80bb349c584df29052b2389a2/users/aca93f72c2fb41aa8184ce6f9d1f5d6f/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:55:46.569958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c14a3-c1c5-457d-b151-a06bfc65b2d2 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:46.570418 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c14a3-c1c5-457d-b151-a06bfc65b2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:46.571823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c14a3-c1c5-457d-b151-a06bfc65b2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:46.635030 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-b11c14a3-c1c5-457d-b151-a06bfc65b2d2 None None] MFA Rules not processed for user `aca93f72c2fb41aa8184ce6f9d1f5d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:46.636746 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b11c14a3-c1c5-457d-b151-a06bfc65b2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:46.712240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b96cb-4758-40ac-9d19-08fe88cbb6e8 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:46.719298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-546b96cb-4758-40ac-9d19-08fe88cbb6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:46.774033 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 877/1762] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:46.788070 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c14a3-c1c5-457d-b151-a06bfc65b2d2 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:46.790256 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b11c14a3-c1c5-457d-b151-a06bfc65b2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:46.824968 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:46.843908 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b96cb-4758-40ac-9d19-08fe88cbb6e8 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:46.855484 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf8dd8-891f-42e0-aee6-f477827f3c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:46.856585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf8dd8-891f-42e0-aee6-f477827f3c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:46.856585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf8dd8-891f-42e0-aee6-f477827f3c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:46.856805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf8dd8-891f-42e0-aee6-f477827f3c6f admin admin] PATH_INFO: `/v3/projects/61304086ba9443b0a32b0d72995f8715` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:46.857971 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf8dd8-891f-42e0-aee6-f477827f3c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=61304086ba9443b0a32b0d72995f8715)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:46.860101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf8dd8-891f-42e0-aee6-f477827f3c6f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:46.880459 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c14a3-c1c5-457d-b151-a06bfc65b2d2 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:46.884832 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3689a-28e4-4720-9ff9-30588c3e8756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:46.885686 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3689a-28e4-4720-9ff9-30588c3e8756 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:46.886022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3689a-28e4-4720-9ff9-30588c3e8756 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:46.886358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3689a-28e4-4720-9ff9-30588c3e8756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:46.896652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3689a-28e4-4720-9ff9-30588c3e8756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:46.898264 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3689a-28e4-4720-9ff9-30588c3e8756 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:46.909500 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 878/1763] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:55:46.917883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-37bf8dd8-891f-42e0-aee6-f477827f3c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61304086ba9443b0a32b0d72995f8715', 'request_id': 'req-37bf8dd8-891f-42e0-aee6-f477827f3c6f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:46.926452 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-37bf8dd8-891f-42e0-aee6-f477827f3c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61304086ba9443b0a32b0d72995f8715', 'request_id': 'req-37bf8dd8-891f-42e0-aee6-f477827f3c6f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:46.938935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-37bf8dd8-891f-42e0-aee6-f477827f3c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61304086ba9443b0a32b0d72995f8715', 'request_id': 'req-37bf8dd8-891f-42e0-aee6-f477827f3c6f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:46.956404 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-37bf8dd8-891f-42e0-aee6-f477827f3c6f admin admin] The token cache is being invalidate because project 61304086ba9443b0a32b0d72995f8715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:55:46.956696 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-37bf8dd8-891f-42e0-aee6-f477827f3c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:46.957956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-37bf8dd8-891f-42e0-aee6-f477827f3c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:46.963514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 886/1764] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:55:46 2022] DELETE /identity/v3/projects/61304086ba9443b0a32b0d72995f8715 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:55:46.964389 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3689a-28e4-4720-9ff9-30588c3e8756 service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:46.964510 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf8dd8-891f-42e0-aee6-f477827f3c6f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:46.965458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-8de3689a-28e4-4720-9ff9-30588c3e8756 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:46.965565 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-37bf8dd8-891f-42e0-aee6-f477827f3c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:46.978571 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3689a-28e4-4720-9ff9-30588c3e8756 service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:47.078669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6269b21-9934-4607-8a47-69a299d169d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:47.079315 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6269b21-9934-4607-8a47-69a299d169d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:47.079586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6269b21-9934-4607-8a47-69a299d169d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:47.079857 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6269b21-9934-4607-8a47-69a299d169d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:47.082441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-d6269b21-9934-4607-8a47-69a299d169d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:47.126946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf8dd8-891f-42e0-aee6-f477827f3c6f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:47.143766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babacfca-e36a-4bcf-8cdc-05b6f1c86218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:47.145181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babacfca-e36a-4bcf-8cdc-05b6f1c86218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:47.145882 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babacfca-e36a-4bcf-8cdc-05b6f1c86218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:47.146835 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babacfca-e36a-4bcf-8cdc-05b6f1c86218 admin admin] PATH_INFO: `/v3/users/831cb95d8e114a72bcc8dc6d95b501ad` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:47.148676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babacfca-e36a-4bcf-8cdc-05b6f1c86218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=831cb95d8e114a72bcc8dc6d95b501ad)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:47.151857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babacfca-e36a-4bcf-8cdc-05b6f1c86218 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:47.159400 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6269b21-9934-4607-8a47-69a299d169d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:47.160532 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:47.161993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6269b21-9934-4607-8a47-69a299d169d9 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:47.174478 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 879/1765] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:47.222103 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-babacfca-e36a-4bcf-8cdc-05b6f1c86218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '831cb95d8e114a72bcc8dc6d95b501ad'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:47.222935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-babacfca-e36a-4bcf-8cdc-05b6f1c86218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '831cb95d8e114a72bcc8dc6d95b501ad'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:47.232329 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-babacfca-e36a-4bcf-8cdc-05b6f1c86218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '831cb95d8e114a72bcc8dc6d95b501ad'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:47.254460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-babacfca-e36a-4bcf-8cdc-05b6f1c86218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '831cb95d8e114a72bcc8dc6d95b501ad'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:47.254847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-babacfca-e36a-4bcf-8cdc-05b6f1c86218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '831cb95d8e114a72bcc8dc6d95b501ad'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:47.269217 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 887/1766] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:55:46 2022] DELETE /identity/v3/users/831cb95d8e114a72bcc8dc6d95b501ad => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:47.327486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6269b21-9934-4607-8a47-69a299d169d9 service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:47.329265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-d6269b21-9934-4607-8a47-69a299d169d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:47.348684 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6269b21-9934-4607-8a47-69a299d169d9 service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:47.530012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17605fe-f00e-4a25-983e-5308469c000e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:47.530738 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17605fe-f00e-4a25-983e-5308469c000e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:47.530872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17605fe-f00e-4a25-983e-5308469c000e admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:47.531156 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17605fe-f00e-4a25-983e-5308469c000e admin admin] PATH_INFO: `/v3/users/389aed9a73184c6da0107fd2c18f4d71` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:47.532583 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17605fe-f00e-4a25-983e-5308469c000e admin admin] RBAC: Authorizing `identity:delete_user(user_id=389aed9a73184c6da0107fd2c18f4d71)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:47.534639 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17605fe-f00e-4a25-983e-5308469c000e admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:47.591843 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:47.677955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c17605fe-f00e-4a25-983e-5308469c000e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '389aed9a73184c6da0107fd2c18f4d71'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:47.718486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c17605fe-f00e-4a25-983e-5308469c000e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '389aed9a73184c6da0107fd2c18f4d71'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:47.741604 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c17605fe-f00e-4a25-983e-5308469c000e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '389aed9a73184c6da0107fd2c18f4d71'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:47.759402 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c17605fe-f00e-4a25-983e-5308469c000e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '389aed9a73184c6da0107fd2c18f4d71'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:47.762460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c17605fe-f00e-4a25-983e-5308469c000e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '389aed9a73184c6da0107fd2c18f4d71'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:47.795486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 880/1767] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:55:47 2022] DELETE /identity/v3/users/389aed9a73184c6da0107fd2c18f4d71 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:47.800890 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30897d0-ae25-4717-985d-5c40141ce3bd None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:47.801298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30897d0-ae25-4717-985d-5c40141ce3bd None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:47.801474 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30897d0-ae25-4717-985d-5c40141ce3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:47.846650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a30897d0-ae25-4717-985d-5c40141ce3bd None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:47.850961 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a30897d0-ae25-4717-985d-5c40141ce3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:48.020318 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 888/1768] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:48.075487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17605fe-f00e-4a25-983e-5308469c000e admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:48.077471 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-c17605fe-f00e-4a25-983e-5308469c000e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:48.138460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85945e1-fd6c-470e-bf54-233d6e261ebe None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:48.138654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85945e1-fd6c-470e-bf54-233d6e261ebe None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:48.138992 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85945e1-fd6c-470e-bf54-233d6e261ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:48.258754 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17605fe-f00e-4a25-983e-5308469c000e admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:48.266534 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc0ce0-67f4-4ede-9775-66387f836c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:48.267383 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc0ce0-67f4-4ede-9775-66387f836c38 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:48.268023 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc0ce0-67f4-4ede-9775-66387f836c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:48.268486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc0ce0-67f4-4ede-9775-66387f836c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:48.282515 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc0ce0-67f4-4ede-9775-66387f836c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:48.284374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc0ce0-67f4-4ede-9775-66387f836c38 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:48.301497 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 881/1769] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:48.343872 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b85945e1-fd6c-470e-bf54-233d6e261ebe None None] MFA Rules not processed for user `a1936a2649c349d481f56304b3ee55b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:48.346285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b85945e1-fd6c-470e-bf54-233d6e261ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:48.459706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:48.490449 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 889/1770] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Jul 28 17:55:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:48.738511 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc0ce0-67f4-4ede-9775-66387f836c38 service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:48.740954 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-3cbc0ce0-67f4-4ede-9775-66387f836c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:48.876028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc0ce0-67f4-4ede-9775-66387f836c38 service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:48.882891 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca59e8-cde2-42be-a372-44482fdf3963 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ea1a9023eaf427f96f86af909a803fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:48.883664 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca59e8-cde2-42be-a372-44482fdf3963 service swift] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:48.884024 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca59e8-cde2-42be-a372-44482fdf3963 service swift] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:48.884361 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca59e8-cde2-42be-a372-44482fdf3963 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:48.895255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca59e8-cde2-42be-a372-44482fdf3963 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:48.897598 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca59e8-cde2-42be-a372-44482fdf3963 service swift] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:48.939340 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 882/1771] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Jul 28 17:55:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 17:55:49.555950 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85945e1-fd6c-470e-bf54-233d6e261ebe None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:49.560803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b85945e1-fd6c-470e-bf54-233d6e261ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:49.623105 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85945e1-fd6c-470e-bf54-233d6e261ebe None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:49.640194 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae773d-d13c-488e-85a2-6e8042438c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:49.643198 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae773d-d13c-488e-85a2-6e8042438c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:49.643861 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae773d-d13c-488e-85a2-6e8042438c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:49.644630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae773d-d13c-488e-85a2-6e8042438c14 admin admin] PATH_INFO: `/v3/projects/814fb203eb1e40328174ebd4cb649290` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:49.648728 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae773d-d13c-488e-85a2-6e8042438c14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=814fb203eb1e40328174ebd4cb649290)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:49.663720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae773d-d13c-488e-85a2-6e8042438c14 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:49.770965 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e1ae773d-d13c-488e-85a2-6e8042438c14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '814fb203eb1e40328174ebd4cb649290', 'request_id': 'req-e1ae773d-d13c-488e-85a2-6e8042438c14'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:49.808706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e1ae773d-d13c-488e-85a2-6e8042438c14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '814fb203eb1e40328174ebd4cb649290', 'request_id': 'req-e1ae773d-d13c-488e-85a2-6e8042438c14'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:49.843227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e1ae773d-d13c-488e-85a2-6e8042438c14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '814fb203eb1e40328174ebd4cb649290', 'request_id': 'req-e1ae773d-d13c-488e-85a2-6e8042438c14'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:49.892652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e1ae773d-d13c-488e-85a2-6e8042438c14 admin admin] The token cache is being invalidate because project 814fb203eb1e40328174ebd4cb649290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:55:49.894283 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e1ae773d-d13c-488e-85a2-6e8042438c14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:49.903446 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e1ae773d-d13c-488e-85a2-6e8042438c14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:49.908168 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 890/1772] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:55:49 2022] DELETE /identity/v3/projects/814fb203eb1e40328174ebd4cb649290 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:49.914818 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7340b4a-0306-4cac-8df3-7efe4f400e4b None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:49.915369 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7340b4a-0306-4cac-8df3-7efe4f400e4b None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:49.915369 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7340b4a-0306-4cac-8df3-7efe4f400e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:49.939629 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:49.955990 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-f7340b4a-0306-4cac-8df3-7efe4f400e4b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:49.958139 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f7340b4a-0306-4cac-8df3-7efe4f400e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:50.073247 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 883/1773] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:50.081439 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed70fbb-4bf5-46c9-b530-ff2a37613af4 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:50.081757 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed70fbb-4bf5-46c9-b530-ff2a37613af4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:50.082002 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed70fbb-4bf5-46c9-b530-ff2a37613af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:50.118000 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-bed70fbb-4bf5-46c9-b530-ff2a37613af4 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:50.119243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-bed70fbb-4bf5-46c9-b530-ff2a37613af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:50.136291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 891/1774] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:50.140670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7340b4a-0306-4cac-8df3-7efe4f400e4b None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:50.166123 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7340b4a-0306-4cac-8df3-7efe4f400e4b None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:50.208662 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388ecf6-36d2-4619-bf97-452e26be2720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:50.209423 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388ecf6-36d2-4619-bf97-452e26be2720 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:50.209703 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388ecf6-36d2-4619-bf97-452e26be2720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:50.212514 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388ecf6-36d2-4619-bf97-452e26be2720 admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:50.213334 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388ecf6-36d2-4619-bf97-452e26be2720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:55:50.214107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388ecf6-36d2-4619-bf97-452e26be2720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:50.242123 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388ecf6-36d2-4619-bf97-452e26be2720 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:50.337952 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 884/1775] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:55:50.338622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed70fbb-4bf5-46c9-b530-ff2a37613af4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:50.352617 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed70fbb-4bf5-46c9-b530-ff2a37613af4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:50.379676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3187070-47c1-44d3-bf12-561fb6b4053c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:50.380339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3187070-47c1-44d3-bf12-561fb6b4053c admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:50.380623 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3187070-47c1-44d3-bf12-561fb6b4053c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:50.380899 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3187070-47c1-44d3-bf12-561fb6b4053c admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:50.381611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3187070-47c1-44d3-bf12-561fb6b4053c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:50.383760 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3187070-47c1-44d3-bf12-561fb6b4053c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:50.444205 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 892/1776] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:50 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:50.459279 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388ecf6-36d2-4619-bf97-452e26be2720 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:50.476219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388ecf6-36d2-4619-bf97-452e26be2720 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:50.688166 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f01f90-b7c4-4dfb-b317-d7b87d8e5038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:50.691135 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f01f90-b7c4-4dfb-b317-d7b87d8e5038 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:50.693837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f01f90-b7c4-4dfb-b317-d7b87d8e5038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:50.694899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f01f90-b7c4-4dfb-b317-d7b87d8e5038 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:50.696351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f01f90-b7c4-4dfb-b317-d7b87d8e5038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:50.706922 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f01f90-b7c4-4dfb-b317-d7b87d8e5038 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:50.752590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3187070-47c1-44d3-bf12-561fb6b4053c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:50.754878 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a3187070-47c1-44d3-bf12-561fb6b4053c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:50.762162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 885/1777] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:50 2022] POST /identity/v3/users => generated 290 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:55:50.766527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f01f90-b7c4-4dfb-b317-d7b87d8e5038 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:50.790370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f01f90-b7c4-4dfb-b317-d7b87d8e5038 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:50.793317 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3187070-47c1-44d3-bf12-561fb6b4053c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:50.797790 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20084930-f4a4-4bf2-9829-2ee89558ac40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:50.798822 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20084930-f4a4-4bf2-9829-2ee89558ac40 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:50.799301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20084930-f4a4-4bf2-9829-2ee89558ac40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:50.799876 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20084930-f4a4-4bf2-9829-2ee89558ac40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:50.802152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20084930-f4a4-4bf2-9829-2ee89558ac40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:50.804155 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20084930-f4a4-4bf2-9829-2ee89558ac40 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:50.821662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3845e-dd5c-4ede-be72-e949617b9135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:50.822449 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3845e-dd5c-4ede-be72-e949617b9135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:50.823148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 886/1778] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:50.826934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3845e-dd5c-4ede-be72-e949617b9135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:50.827214 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20084930-f4a4-4bf2-9829-2ee89558ac40 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:50.827323 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3845e-dd5c-4ede-be72-e949617b9135 admin admin] PATH_INFO: `/v3/users/fda7c7efa4da4543bad3718eb6d67cff` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:50.830698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3845e-dd5c-4ede-be72-e949617b9135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda7c7efa4da4543bad3718eb6d67cff)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:50.839248 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3845e-dd5c-4ede-be72-e949617b9135 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:50.846341 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20084930-f4a4-4bf2-9829-2ee89558ac40 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:50.865127 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57746553-6d2b-4911-9756-b65f66a9d36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:50.865925 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57746553-6d2b-4911-9756-b65f66a9d36f admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:50.866349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57746553-6d2b-4911-9756-b65f66a9d36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:50.866550 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57746553-6d2b-4911-9756-b65f66a9d36f admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:50.867589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57746553-6d2b-4911-9756-b65f66a9d36f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:50.870073 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57746553-6d2b-4911-9756-b65f66a9d36f admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:50.904354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 887/1779] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:50.909106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57746553-6d2b-4911-9756-b65f66a9d36f admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:50.950459 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57746553-6d2b-4911-9756-b65f66a9d36f admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:50.967078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0954101-b600-44b5-983a-364cfb0d1333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:50.968462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0954101-b600-44b5-983a-364cfb0d1333 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:50.968751 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0954101-b600-44b5-983a-364cfb0d1333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:50.969038 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0954101-b600-44b5-983a-364cfb0d1333 admin admin] PATH_INFO: `/v3/projects/a3adba06576b4e4ebb0aad65698c7a54/users/47d5a87a0d614f89a5a1fb2c645ceafa/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:51.012407 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-18d3845e-dd5c-4ede-be72-e949617b9135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda7c7efa4da4543bad3718eb6d67cff'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:51.025649 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0954101-b600-44b5-983a-364cfb0d1333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3adba06576b4e4ebb0aad65698c7a54, user_id=47d5a87a0d614f89a5a1fb2c645ceafa, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:51.027500 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-18d3845e-dd5c-4ede-be72-e949617b9135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda7c7efa4da4543bad3718eb6d67cff'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:51.032191 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0954101-b600-44b5-983a-364cfb0d1333 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:51.049634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-18d3845e-dd5c-4ede-be72-e949617b9135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda7c7efa4da4543bad3718eb6d67cff'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:51.075847 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 888/1780] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:50 2022] PUT /identity/v3/projects/a3adba06576b4e4ebb0aad65698c7a54/users/47d5a87a0d614f89a5a1fb2c645ceafa/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:55:51.090192 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-18d3845e-dd5c-4ede-be72-e949617b9135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda7c7efa4da4543bad3718eb6d67cff'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:51.091386 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-18d3845e-dd5c-4ede-be72-e949617b9135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda7c7efa4da4543bad3718eb6d67cff'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:51.095947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac3393-5a6b-47ff-bf89-35c9734acfd2 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:51.100293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac3393-5a6b-47ff-bf89-35c9734acfd2 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:51.100746 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac3393-5a6b-47ff-bf89-35c9734acfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:51.135999 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 893/1781] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:55:50 2022] DELETE /identity/v3/users/fda7c7efa4da4543bad3718eb6d67cff => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:51.141041 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b501466-9ba7-4e8f-bab3-e9f1a34a186b None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:51.145371 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b501466-9ba7-4e8f-bab3-e9f1a34a186b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:51.145642 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b501466-9ba7-4e8f-bab3-e9f1a34a186b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:51.182909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-56ac3393-5a6b-47ff-bf89-35c9734acfd2 None None] MFA Rules not processed for user `76add49d4be940ad846d32fa16431988`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:51.184330 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-56ac3393-5a6b-47ff-bf89-35c9734acfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:51.235580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-2b501466-9ba7-4e8f-bab3-e9f1a34a186b None None] MFA Rules not processed for user `47d5a87a0d614f89a5a1fb2c645ceafa`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:51.239893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2b501466-9ba7-4e8f-bab3-e9f1a34a186b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:51.272951 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:51.353536 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:51.415361 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 889/1782] 10.222.0.81 () {58 vars in 1015 bytes} [Thu Jul 28 17:55:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:51.416359 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac3393-5a6b-47ff-bf89-35c9734acfd2 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:51.425558 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-56ac3393-5a6b-47ff-bf89-35c9734acfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:51.453323 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 894/1783] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:51.459453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24edb9b-25e4-44d4-b5d4-cba62eb9df3d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:51.459830 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24edb9b-25e4-44d4-b5d4-cba62eb9df3d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:51.460008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24edb9b-25e4-44d4-b5d4-cba62eb9df3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:51.516982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f24edb9b-25e4-44d4-b5d4-cba62eb9df3d None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:51.518336 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f24edb9b-25e4-44d4-b5d4-cba62eb9df3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:51.597002 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac3393-5a6b-47ff-bf89-35c9734acfd2 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:51.602165 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77697fb0-862a-43a1-88aa-2ccfa4ea6271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:51.603334 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77697fb0-862a-43a1-88aa-2ccfa4ea6271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:51.603827 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77697fb0-862a-43a1-88aa-2ccfa4ea6271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:51.604320 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77697fb0-862a-43a1-88aa-2ccfa4ea6271 admin admin] PATH_INFO: `/v3/projects/2e1fd1bc330e40dbb045325e7253383c` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:51.610536 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77697fb0-862a-43a1-88aa-2ccfa4ea6271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e1fd1bc330e40dbb045325e7253383c)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:51.612888 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77697fb0-862a-43a1-88aa-2ccfa4ea6271 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:51.670303 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 895/1784] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:51.672131 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24edb9b-25e4-44d4-b5d4-cba62eb9df3d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:51.676280 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f24edb9b-25e4-44d4-b5d4-cba62eb9df3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:51.699912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24edb9b-25e4-44d4-b5d4-cba62eb9df3d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:51.754101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a611f5b-00b2-4046-b1f7-0373468e19fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:51.756634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a611f5b-00b2-4046-b1f7-0373468e19fb admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:51.762341 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a611f5b-00b2-4046-b1f7-0373468e19fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:51.762992 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a611f5b-00b2-4046-b1f7-0373468e19fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:51.763641 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a611f5b-00b2-4046-b1f7-0373468e19fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:51.778712 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a611f5b-00b2-4046-b1f7-0373468e19fb admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:51.792733 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-77697fb0-862a-43a1-88aa-2ccfa4ea6271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e1fd1bc330e40dbb045325e7253383c', 'request_id': 'req-77697fb0-862a-43a1-88aa-2ccfa4ea6271'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:51.811855 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-77697fb0-862a-43a1-88aa-2ccfa4ea6271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e1fd1bc330e40dbb045325e7253383c', 'request_id': 'req-77697fb0-862a-43a1-88aa-2ccfa4ea6271'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:51.829432 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-77697fb0-862a-43a1-88aa-2ccfa4ea6271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e1fd1bc330e40dbb045325e7253383c', 'request_id': 'req-77697fb0-862a-43a1-88aa-2ccfa4ea6271'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:51.854379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-77697fb0-862a-43a1-88aa-2ccfa4ea6271 admin admin] The token cache is being invalidate because project 2e1fd1bc330e40dbb045325e7253383c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:55:51.854889 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-77697fb0-862a-43a1-88aa-2ccfa4ea6271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:51.855754 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-77697fb0-862a-43a1-88aa-2ccfa4ea6271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:51.858514 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 890/1785] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:55:51 2022] DELETE /identity/v3/projects/2e1fd1bc330e40dbb045325e7253383c => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:51.859566 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77697fb0-862a-43a1-88aa-2ccfa4ea6271 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:51.865833 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-77697fb0-862a-43a1-88aa-2ccfa4ea6271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:51.890959 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 896/1786] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:51 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:51.893334 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a611f5b-00b2-4046-b1f7-0373468e19fb admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:51.905614 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3a611f5b-00b2-4046-b1f7-0373468e19fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:51.973572 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77697fb0-862a-43a1-88aa-2ccfa4ea6271 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:52.062463 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a611f5b-00b2-4046-b1f7-0373468e19fb admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:52.063720 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:52.071360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95ca90-c937-42ce-b1d1-aa1916c55df3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:52.072010 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95ca90-c937-42ce-b1d1-aa1916c55df3 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:52.072362 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95ca90-c937-42ce-b1d1-aa1916c55df3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:52.072644 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95ca90-c937-42ce-b1d1-aa1916c55df3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:52.076940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ca95ca90-c937-42ce-b1d1-aa1916c55df3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:52.089395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95ca90-c937-42ce-b1d1-aa1916c55df3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:52.092109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95ca90-c937-42ce-b1d1-aa1916c55df3 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:52.103930 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 897/1787] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:52.105220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95ca90-c937-42ce-b1d1-aa1916c55df3 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:52.106792 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ca95ca90-c937-42ce-b1d1-aa1916c55df3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:52.137671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295bfac-c5a5-4eeb-ab32-5a584363c4b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:52.138330 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295bfac-c5a5-4eeb-ab32-5a584363c4b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:52.142970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295bfac-c5a5-4eeb-ab32-5a584363c4b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:52.143682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295bfac-c5a5-4eeb-ab32-5a584363c4b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:52.153233 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:52.164159 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295bfac-c5a5-4eeb-ab32-5a584363c4b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:52.168274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295bfac-c5a5-4eeb-ab32-5a584363c4b0 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:52.196598 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 891/1788] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:52.197627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295bfac-c5a5-4eeb-ab32-5a584363c4b0 service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:52.215307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95ca90-c937-42ce-b1d1-aa1916c55df3 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:52.223288 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f6dce-f168-4090-9af3-c9aedfba3462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:52.223487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295bfac-c5a5-4eeb-ab32-5a584363c4b0 service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:52.224694 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f6dce-f168-4090-9af3-c9aedfba3462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:52.224979 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f6dce-f168-4090-9af3-c9aedfba3462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:52.225289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f6dce-f168-4090-9af3-c9aedfba3462 admin admin] PATH_INFO: `/v3/users/463cb90d2bc74d1caa580d0eabce3f05` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:52.226927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f6dce-f168-4090-9af3-c9aedfba3462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=463cb90d2bc74d1caa580d0eabce3f05)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:52.229403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f6dce-f168-4090-9af3-c9aedfba3462 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:52.234182 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382cc69-7171-4404-a773-67311c81e646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:52.234890 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382cc69-7171-4404-a773-67311c81e646 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:52.235172 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382cc69-7171-4404-a773-67311c81e646 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:52.235538 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382cc69-7171-4404-a773-67311c81e646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:52.259136 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9382cc69-7171-4404-a773-67311c81e646 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:52.306448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382cc69-7171-4404-a773-67311c81e646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:52.307838 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382cc69-7171-4404-a773-67311c81e646 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:52.332868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 892/1789] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:52.334124 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382cc69-7171-4404-a773-67311c81e646 service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:52.338220 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9382cc69-7171-4404-a773-67311c81e646 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:52.371965 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382cc69-7171-4404-a773-67311c81e646 service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:52.388682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4e5f6dce-f168-4090-9af3-c9aedfba3462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '463cb90d2bc74d1caa580d0eabce3f05'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:52.389185 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525dfd1-2aae-4209-86d1-004f7c4d5b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:52.389642 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4e5f6dce-f168-4090-9af3-c9aedfba3462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '463cb90d2bc74d1caa580d0eabce3f05'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:52.389910 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525dfd1-2aae-4209-86d1-004f7c4d5b74 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:52.390194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525dfd1-2aae-4209-86d1-004f7c4d5b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:52.390464 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525dfd1-2aae-4209-86d1-004f7c4d5b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:52.404075 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6525dfd1-2aae-4209-86d1-004f7c4d5b74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:52.408417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4e5f6dce-f168-4090-9af3-c9aedfba3462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '463cb90d2bc74d1caa580d0eabce3f05'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:52.436972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525dfd1-2aae-4209-86d1-004f7c4d5b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:52.440401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525dfd1-2aae-4209-86d1-004f7c4d5b74 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:52.464640 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 893/1790] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:52.465794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525dfd1-2aae-4209-86d1-004f7c4d5b74 service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:52.466233 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4e5f6dce-f168-4090-9af3-c9aedfba3462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '463cb90d2bc74d1caa580d0eabce3f05'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:52.467938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6525dfd1-2aae-4209-86d1-004f7c4d5b74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:52.468426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4e5f6dce-f168-4090-9af3-c9aedfba3462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '463cb90d2bc74d1caa580d0eabce3f05'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:52.512078 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 898/1791] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:55:52 2022] DELETE /identity/v3/users/463cb90d2bc74d1caa580d0eabce3f05 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:52.514580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f6dce-f168-4090-9af3-c9aedfba3462 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:52.518749 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4e5f6dce-f168-4090-9af3-c9aedfba3462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:52.519545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525dfd1-2aae-4209-86d1-004f7c4d5b74 service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:52.725172 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7f034-0abf-4dbf-9e52-d5af7624e449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:52.725948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7f034-0abf-4dbf-9e52-d5af7624e449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:52.726263 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7f034-0abf-4dbf-9e52-d5af7624e449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:52.727943 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7f034-0abf-4dbf-9e52-d5af7624e449 admin admin] PATH_INFO: `/v3/users/692fee07747346539376d2aadf46732f` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:52.739722 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7f034-0abf-4dbf-9e52-d5af7624e449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=692fee07747346539376d2aadf46732f)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:52.751089 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f6dce-f168-4090-9af3-c9aedfba3462 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:52.754048 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7f034-0abf-4dbf-9e52-d5af7624e449 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:52.766392 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecae057-c3b5-48e0-9530-48d32743c55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:52.767342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecae057-c3b5-48e0-9530-48d32743c55d admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:52.769259 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecae057-c3b5-48e0-9530-48d32743c55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:52.769519 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecae057-c3b5-48e0-9530-48d32743c55d admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:52.772065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecae057-c3b5-48e0-9530-48d32743c55d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:52.778284 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecae057-c3b5-48e0-9530-48d32743c55d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:52.831220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 899/1792] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:52 2022] POST /identity/v3/users => generated 296 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:52.832471 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21917b5d-af34-4cf8-9110-ff437718ebeb None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:52.832770 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21917b5d-af34-4cf8-9110-ff437718ebeb None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:52.833045 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21917b5d-af34-4cf8-9110-ff437718ebeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:52.891278 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-21917b5d-af34-4cf8-9110-ff437718ebeb None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:52.892761 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-21917b5d-af34-4cf8-9110-ff437718ebeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:52.913436 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-90c7f034-0abf-4dbf-9e52-d5af7624e449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '692fee07747346539376d2aadf46732f'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:52.917744 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 900/1793] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:52.922434 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21917b5d-af34-4cf8-9110-ff437718ebeb None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:52.946407 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21917b5d-af34-4cf8-9110-ff437718ebeb None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:52.960725 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-90c7f034-0abf-4dbf-9e52-d5af7624e449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '692fee07747346539376d2aadf46732f'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:52.963371 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054b5b7-61e6-4978-91a0-81c3743abf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:52.964114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054b5b7-61e6-4978-91a0-81c3743abf9e admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:52.964596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054b5b7-61e6-4978-91a0-81c3743abf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:52.964874 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054b5b7-61e6-4978-91a0-81c3743abf9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:52.965633 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054b5b7-61e6-4978-91a0-81c3743abf9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:52.967887 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054b5b7-61e6-4978-91a0-81c3743abf9e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:52.985009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-90c7f034-0abf-4dbf-9e52-d5af7624e449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '692fee07747346539376d2aadf46732f'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:53.000329 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 901/1794] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:53.001556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054b5b7-61e6-4978-91a0-81c3743abf9e admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:53.005862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-90c7f034-0abf-4dbf-9e52-d5af7624e449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '692fee07747346539376d2aadf46732f'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:53.009339 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-90c7f034-0abf-4dbf-9e52-d5af7624e449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '692fee07747346539376d2aadf46732f'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:53.024907 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 894/1795] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:55:52 2022] DELETE /identity/v3/users/692fee07747346539376d2aadf46732f => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:53.026001 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7f034-0abf-4dbf-9e52-d5af7624e449 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:53.027983 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-90c7f034-0abf-4dbf-9e52-d5af7624e449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:53.040169 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054b5b7-61e6-4978-91a0-81c3743abf9e admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:53.077879 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:53.086305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:53.126721 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7f034-0abf-4dbf-9e52-d5af7624e449 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:53.131459 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255c2f3-b5d0-4233-ab42-515c738c0338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:53.132408 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255c2f3-b5d0-4233-ab42-515c738c0338 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:53.133271 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255c2f3-b5d0-4233-ab42-515c738c0338 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:53.133575 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255c2f3-b5d0-4233-ab42-515c738c0338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:53.135473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-2255c2f3-b5d0-4233-ab42-515c738c0338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:53.172974 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3530a1-97cc-4bac-937c-7c0738cc30f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:53.173874 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3530a1-97cc-4bac-937c-7c0738cc30f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:53.174214 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3530a1-97cc-4bac-937c-7c0738cc30f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:53.174527 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3530a1-97cc-4bac-937c-7c0738cc30f7 admin admin] PATH_INFO: `/v3/projects/b5587f24d2e740b1a8345a99fa9044b0/users/3d71b2f53fb841e2a2de12b889d26fd8/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:53.212486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3530a1-97cc-4bac-937c-7c0738cc30f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5587f24d2e740b1a8345a99fa9044b0, user_id=3d71b2f53fb841e2a2de12b889d26fd8, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:53.219956 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255c2f3-b5d0-4233-ab42-515c738c0338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:53.220261 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3530a1-97cc-4bac-937c-7c0738cc30f7 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:53.222329 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255c2f3-b5d0-4233-ab42-515c738c0338 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:53.237744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 895/1796] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:53.253096 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 902/1797] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:53 2022] PUT /identity/v3/projects/b5587f24d2e740b1a8345a99fa9044b0/users/3d71b2f53fb841e2a2de12b889d26fd8/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:55:53.254352 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255c2f3-b5d0-4233-ab42-515c738c0338 service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:53.257515 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-2255c2f3-b5d0-4233-ab42-515c738c0338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:53.289546 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255c2f3-b5d0-4233-ab42-515c738c0338 service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:53.484320 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5811ad1-55d2-4563-a8c0-e0cc88f8c37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:53.485289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5811ad1-55d2-4563-a8c0-e0cc88f8c37b admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:53.485727 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5811ad1-55d2-4563-a8c0-e0cc88f8c37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:53.486159 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5811ad1-55d2-4563-a8c0-e0cc88f8c37b admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:53.487038 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5811ad1-55d2-4563-a8c0-e0cc88f8c37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:53.488776 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5811ad1-55d2-4563-a8c0-e0cc88f8c37b admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:53.526131 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 896/1798] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:55:53.529597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3530a1-97cc-4bac-937c-7c0738cc30f7 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:53.545397 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3530a1-97cc-4bac-937c-7c0738cc30f7 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:53.558632 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bda25-8c24-41b1-a289-fc4643090eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:53.559585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bda25-8c24-41b1-a289-fc4643090eda admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:53.559961 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bda25-8c24-41b1-a289-fc4643090eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:53.560305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bda25-8c24-41b1-a289-fc4643090eda admin admin] PATH_INFO: `/v3/projects/b5587f24d2e740b1a8345a99fa9044b0/users/3d71b2f53fb841e2a2de12b889d26fd8/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:53.563024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7bda25-8c24-41b1-a289-fc4643090eda admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5587f24d2e740b1a8345a99fa9044b0, user_id=3d71b2f53fb841e2a2de12b889d26fd8, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:53.574346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7bda25-8c24-41b1-a289-fc4643090eda admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:53.588995 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 903/1799] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:53 2022] PUT /identity/v3/projects/b5587f24d2e740b1a8345a99fa9044b0/users/3d71b2f53fb841e2a2de12b889d26fd8/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:53.600037 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b646b8f-2e39-45af-b72f-ed7de8059a85 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:53.600322 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b646b8f-2e39-45af-b72f-ed7de8059a85 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:53.600579 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b646b8f-2e39-45af-b72f-ed7de8059a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:53.656728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-7b646b8f-2e39-45af-b72f-ed7de8059a85 None None] MFA Rules not processed for user `3d71b2f53fb841e2a2de12b889d26fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:53.658860 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-7b646b8f-2e39-45af-b72f-ed7de8059a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:53.839619 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:53.848391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 897/1800] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:53.865581 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bda25-8c24-41b1-a289-fc4643090eda admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:53.867871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1d7bda25-8c24-41b1-a289-fc4643090eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:54.132132 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bda25-8c24-41b1-a289-fc4643090eda admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:54.154401 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c543418-04ad-4f90-953b-f52a65e08d98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:54.154401 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c543418-04ad-4f90-953b-f52a65e08d98 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:54.154666 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c543418-04ad-4f90-953b-f52a65e08d98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:54.154796 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c543418-04ad-4f90-953b-f52a65e08d98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:54.227736 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c543418-04ad-4f90-953b-f52a65e08d98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:54.230012 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c543418-04ad-4f90-953b-f52a65e08d98 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:54.284742 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 904/1801] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:55.037979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b646b8f-2e39-45af-b72f-ed7de8059a85 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:55.041173 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-7b646b8f-2e39-45af-b72f-ed7de8059a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:55.158623 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c543418-04ad-4f90-953b-f52a65e08d98 service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:55.160742 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8c543418-04ad-4f90-953b-f52a65e08d98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:55.329721 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b646b8f-2e39-45af-b72f-ed7de8059a85 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:55.342144 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0c248-31d8-49db-bdd3-efa26e4dbddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:55.342917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0c248-31d8-49db-bdd3-efa26e4dbddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:55.343274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0c248-31d8-49db-bdd3-efa26e4dbddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:55.343705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0c248-31d8-49db-bdd3-efa26e4dbddc admin admin] PATH_INFO: `/v3/projects/81bf547bb55140c9b4f3be2070cac9be` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:55.349295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0c248-31d8-49db-bdd3-efa26e4dbddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=81bf547bb55140c9b4f3be2070cac9be)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:55.351636 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0c248-31d8-49db-bdd3-efa26e4dbddc admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:55.421842 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c543418-04ad-4f90-953b-f52a65e08d98 service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:55.433531 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c089bd8-6dee-4d43-ab83-167ce9ec96df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:55.435919 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c089bd8-6dee-4d43-ab83-167ce9ec96df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:55.436489 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c089bd8-6dee-4d43-ab83-167ce9ec96df admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:55.437074 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c089bd8-6dee-4d43-ab83-167ce9ec96df admin admin] PATH_INFO: `/v3/projects/2f51f80042bb46ac8deabcbbde87fdb2` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:55.442073 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c089bd8-6dee-4d43-ab83-167ce9ec96df admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f51f80042bb46ac8deabcbbde87fdb2)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:55.449960 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c089bd8-6dee-4d43-ab83-167ce9ec96df admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:55.542748 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:55.562223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-0c089bd8-6dee-4d43-ab83-167ce9ec96df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f51f80042bb46ac8deabcbbde87fdb2', 'request_id': 'req-0c089bd8-6dee-4d43-ab83-167ce9ec96df'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:55.577606 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-0c089bd8-6dee-4d43-ab83-167ce9ec96df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f51f80042bb46ac8deabcbbde87fdb2', 'request_id': 'req-0c089bd8-6dee-4d43-ab83-167ce9ec96df'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:55.590296 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-0c089bd8-6dee-4d43-ab83-167ce9ec96df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f51f80042bb46ac8deabcbbde87fdb2', 'request_id': 'req-0c089bd8-6dee-4d43-ab83-167ce9ec96df'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:55.612205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-b1f0c248-31d8-49db-bdd3-efa26e4dbddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81bf547bb55140c9b4f3be2070cac9be', 'request_id': 'req-b1f0c248-31d8-49db-bdd3-efa26e4dbddc'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:55.616407 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-0c089bd8-6dee-4d43-ab83-167ce9ec96df admin admin] The token cache is being invalidate because project 2f51f80042bb46ac8deabcbbde87fdb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:55:55.616708 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-0c089bd8-6dee-4d43-ab83-167ce9ec96df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:55.617638 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-0c089bd8-6dee-4d43-ab83-167ce9ec96df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:55.623530 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 905/1802] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:55:55 2022] DELETE /identity/v3/projects/2f51f80042bb46ac8deabcbbde87fdb2 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:55.626702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c089bd8-6dee-4d43-ab83-167ce9ec96df admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:55.628959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-b1f0c248-31d8-49db-bdd3-efa26e4dbddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81bf547bb55140c9b4f3be2070cac9be', 'request_id': 'req-b1f0c248-31d8-49db-bdd3-efa26e4dbddc'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:55.631489 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0c089bd8-6dee-4d43-ab83-167ce9ec96df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:55.646339 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-b1f0c248-31d8-49db-bdd3-efa26e4dbddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81bf547bb55140c9b4f3be2070cac9be', 'request_id': 'req-b1f0c248-31d8-49db-bdd3-efa26e4dbddc'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:55.682364 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-b1f0c248-31d8-49db-bdd3-efa26e4dbddc admin admin] The token cache is being invalidate because project 81bf547bb55140c9b4f3be2070cac9be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:55:55.682662 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-b1f0c248-31d8-49db-bdd3-efa26e4dbddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:55.683506 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-b1f0c248-31d8-49db-bdd3-efa26e4dbddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:55.687639 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 898/1803] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:55:55 2022] DELETE /identity/v3/projects/81bf547bb55140c9b4f3be2070cac9be => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:55.689138 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d53637-cd9a-46d6-9bef-49d0ecbc9223 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:55.689446 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d53637-cd9a-46d6-9bef-49d0ecbc9223 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:55.689707 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d53637-cd9a-46d6-9bef-49d0ecbc9223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:55.726593 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-f2d53637-cd9a-46d6-9bef-49d0ecbc9223 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:55.728809 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f2d53637-cd9a-46d6-9bef-49d0ecbc9223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:55.865881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 899/1804] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:55.867993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b0547-848d-4520-8acc-1e4071d975e7 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:55.868791 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b0547-848d-4520-8acc-1e4071d975e7 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:55.869370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b0547-848d-4520-8acc-1e4071d975e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:55.963718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-306b0547-848d-4520-8acc-1e4071d975e7 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:55.968884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-306b0547-848d-4520-8acc-1e4071d975e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:56.004037 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 900/1805] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:56.004037 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b0547-848d-4520-8acc-1e4071d975e7 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:56.004037 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-306b0547-848d-4520-8acc-1e4071d975e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:56.030798 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c089bd8-6dee-4d43-ab83-167ce9ec96df admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:56.043538 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9432f-f0d3-4816-83dc-653b394c08eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:56.044652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9432f-f0d3-4816-83dc-653b394c08eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:56.048145 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9432f-f0d3-4816-83dc-653b394c08eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:56.048600 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9432f-f0d3-4816-83dc-653b394c08eb admin admin] PATH_INFO: `/v3/users/47d5a87a0d614f89a5a1fb2c645ceafa` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:56.051493 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9432f-f0d3-4816-83dc-653b394c08eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d5a87a0d614f89a5a1fb2c645ceafa)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:56.068045 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b0547-848d-4520-8acc-1e4071d975e7 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:56.074222 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9432f-f0d3-4816-83dc-653b394c08eb admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:56.088095 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98da168-f46b-4ee4-b109-55e1b61986cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:56.088726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98da168-f46b-4ee4-b109-55e1b61986cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:56.088988 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98da168-f46b-4ee4-b109-55e1b61986cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:56.089366 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98da168-f46b-4ee4-b109-55e1b61986cb admin admin] PATH_INFO: `/v3/projects/ffcc1138f30b40a396aaeaf5cb7932e7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:56.094176 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98da168-f46b-4ee4-b109-55e1b61986cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffcc1138f30b40a396aaeaf5cb7932e7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:56.096416 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98da168-f46b-4ee4-b109-55e1b61986cb admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:56.161140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:56.194224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-faa9432f-f0d3-4816-83dc-653b394c08eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d5a87a0d614f89a5a1fb2c645ceafa'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:56.196486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-faa9432f-f0d3-4816-83dc-653b394c08eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d5a87a0d614f89a5a1fb2c645ceafa'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:56.205746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-faa9432f-f0d3-4816-83dc-653b394c08eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d5a87a0d614f89a5a1fb2c645ceafa'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:56.217924 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c98da168-f46b-4ee4-b109-55e1b61986cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffcc1138f30b40a396aaeaf5cb7932e7', 'request_id': 'req-c98da168-f46b-4ee4-b109-55e1b61986cb'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:56.220187 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-faa9432f-f0d3-4816-83dc-653b394c08eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d5a87a0d614f89a5a1fb2c645ceafa'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:56.221117 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-faa9432f-f0d3-4816-83dc-653b394c08eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d5a87a0d614f89a5a1fb2c645ceafa'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:56.229911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c98da168-f46b-4ee4-b109-55e1b61986cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffcc1138f30b40a396aaeaf5cb7932e7', 'request_id': 'req-c98da168-f46b-4ee4-b109-55e1b61986cb'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:56.269153 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 906/1806] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:55:55 2022] DELETE /identity/v3/users/47d5a87a0d614f89a5a1fb2c645ceafa => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:56.273842 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edcc26-a612-4d3e-a73e-524abff12150 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:56.281399 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edcc26-a612-4d3e-a73e-524abff12150 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:56.285870 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edcc26-a612-4d3e-a73e-524abff12150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:56.288452 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c98da168-f46b-4ee4-b109-55e1b61986cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffcc1138f30b40a396aaeaf5cb7932e7', 'request_id': 'req-c98da168-f46b-4ee4-b109-55e1b61986cb'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:56.308586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c98da168-f46b-4ee4-b109-55e1b61986cb admin admin] The token cache is being invalidate because project ffcc1138f30b40a396aaeaf5cb7932e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:55:56.310839 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c98da168-f46b-4ee4-b109-55e1b61986cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:56.316317 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c98da168-f46b-4ee4-b109-55e1b61986cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:56.323439 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 901/1807] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:55:55 2022] DELETE /identity/v3/projects/ffcc1138f30b40a396aaeaf5cb7932e7 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:56.324459 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a8808-305f-401d-a9e8-32d31a27767f None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:56.324748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a8808-305f-401d-a9e8-32d31a27767f None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:56.325017 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a8808-305f-401d-a9e8-32d31a27767f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:56.325481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f3edcc26-a612-4d3e-a73e-524abff12150 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:56.326751 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f3edcc26-a612-4d3e-a73e-524abff12150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:56.371806 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-4b5a8808-305f-401d-a9e8-32d31a27767f None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:56.373573 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-4b5a8808-305f-401d-a9e8-32d31a27767f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:56.429830 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:56.462196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 907/1808] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:56.464048 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c33f33-8149-494c-9fb9-c1c83d5e6ba3 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:56.464504 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c33f33-8149-494c-9fb9-c1c83d5e6ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:56.465008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c33f33-8149-494c-9fb9-c1c83d5e6ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:56.495212 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-84c33f33-8149-494c-9fb9-c1c83d5e6ba3 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:56.499458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-84c33f33-8149-494c-9fb9-c1c83d5e6ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:56.509975 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 908/1809] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:56.511248 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c33f33-8149-494c-9fb9-c1c83d5e6ba3 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:56.513785 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-84c33f33-8149-494c-9fb9-c1c83d5e6ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:56.531723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c33f33-8149-494c-9fb9-c1c83d5e6ba3 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:56.537785 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501ff1c-262e-44a0-86c6-7fd73a3f61f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:56.538827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501ff1c-262e-44a0-86c6-7fd73a3f61f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:56.539699 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501ff1c-262e-44a0-86c6-7fd73a3f61f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:56.539699 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501ff1c-262e-44a0-86c6-7fd73a3f61f6 admin admin] PATH_INFO: `/v3/users/ef56e7921b3f4bec976b058a6d92538c` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:56.541497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501ff1c-262e-44a0-86c6-7fd73a3f61f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef56e7921b3f4bec976b058a6d92538c)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:56.544554 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501ff1c-262e-44a0-86c6-7fd73a3f61f6 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:56.549118 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 902/1810] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:56.550871 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a8808-305f-401d-a9e8-32d31a27767f None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:56.584976 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a8808-305f-401d-a9e8-32d31a27767f None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:56.600689 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597ba06-5832-4de1-a2f3-eac7218bc31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:56.604231 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597ba06-5832-4de1-a2f3-eac7218bc31a admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:56.606185 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597ba06-5832-4de1-a2f3-eac7218bc31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:56.606783 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597ba06-5832-4de1-a2f3-eac7218bc31a admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:56.612189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597ba06-5832-4de1-a2f3-eac7218bc31a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:55:56.612744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597ba06-5832-4de1-a2f3-eac7218bc31a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:56.617972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597ba06-5832-4de1-a2f3-eac7218bc31a admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:56.659816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 903/1811] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:55:56.659816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597ba06-5832-4de1-a2f3-eac7218bc31a admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:56.682197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597ba06-5832-4de1-a2f3-eac7218bc31a admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:56.697936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b501ff1c-262e-44a0-86c6-7fd73a3f61f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef56e7921b3f4bec976b058a6d92538c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:56.697936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b501ff1c-262e-44a0-86c6-7fd73a3f61f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef56e7921b3f4bec976b058a6d92538c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:56.698100 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4c79c-adb2-4ae6-9c4b-404da21f39ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:56.698100 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4c79c-adb2-4ae6-9c4b-404da21f39ca admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:56.698100 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4c79c-adb2-4ae6-9c4b-404da21f39ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:56.698100 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4c79c-adb2-4ae6-9c4b-404da21f39ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:56.698400 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4c79c-adb2-4ae6-9c4b-404da21f39ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:55:56.698400 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4c79c-adb2-4ae6-9c4b-404da21f39ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:56.698400 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4c79c-adb2-4ae6-9c4b-404da21f39ca admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:56.721253 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b501ff1c-262e-44a0-86c6-7fd73a3f61f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef56e7921b3f4bec976b058a6d92538c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:56.763386 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b501ff1c-262e-44a0-86c6-7fd73a3f61f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef56e7921b3f4bec976b058a6d92538c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:56.764916 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b501ff1c-262e-44a0-86c6-7fd73a3f61f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef56e7921b3f4bec976b058a6d92538c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:56.781105 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 904/1812] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:55:56.782767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4c79c-adb2-4ae6-9c4b-404da21f39ca admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:56.790671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-5ba4c79c-adb2-4ae6-9c4b-404da21f39ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:56.807894 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 909/1813] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:55:56 2022] DELETE /identity/v3/users/ef56e7921b3f4bec976b058a6d92538c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:56.812807 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501ff1c-262e-44a0-86c6-7fd73a3f61f6 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:56.818676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b501ff1c-262e-44a0-86c6-7fd73a3f61f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:56.957599 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4c79c-adb2-4ae6-9c4b-404da21f39ca admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:57.003489 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501ff1c-262e-44a0-86c6-7fd73a3f61f6 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:57.032544 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab7c79-04e8-428d-a429-4b3fe4b1224f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:57.033544 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab7c79-04e8-428d-a429-4b3fe4b1224f admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:57.033942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab7c79-04e8-428d-a429-4b3fe4b1224f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:57.034457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab7c79-04e8-428d-a429-4b3fe4b1224f admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:57.035827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab7c79-04e8-428d-a429-4b3fe4b1224f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:57.041700 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab7c79-04e8-428d-a429-4b3fe4b1224f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:57.128428 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:57.157094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 910/1814] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:56 2022] POST /identity/v3/projects => generated 397 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:57.167654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab7c79-04e8-428d-a429-4b3fe4b1224f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:57.173357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-25ab7c79-04e8-428d-a429-4b3fe4b1224f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:57.194846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5291c20-dc98-42bd-accb-6d9db213521f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:57.196001 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5291c20-dc98-42bd-accb-6d9db213521f service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:57.201204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5291c20-dc98-42bd-accb-6d9db213521f service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:57.209516 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5291c20-dc98-42bd-accb-6d9db213521f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:57.214260 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e5291c20-dc98-42bd-accb-6d9db213521f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:57.254433 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5291c20-dc98-42bd-accb-6d9db213521f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:57.291723 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5291c20-dc98-42bd-accb-6d9db213521f service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:57.329976 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 905/1815] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:57.335200 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5291c20-dc98-42bd-accb-6d9db213521f service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:57.356713 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:57.358864 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5291c20-dc98-42bd-accb-6d9db213521f service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:57.411236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab7c79-04e8-428d-a429-4b3fe4b1224f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:57.440319 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd6c94-40dc-4639-8ec0-8bb712463c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:57.441317 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd6c94-40dc-4639-8ec0-8bb712463c95 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:57.441879 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd6c94-40dc-4639-8ec0-8bb712463c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:57.442295 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd6c94-40dc-4639-8ec0-8bb712463c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:57.443019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd6c94-40dc-4639-8ec0-8bb712463c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:57.446507 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd6c94-40dc-4639-8ec0-8bb712463c95 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:57.550269 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023262e-0b35-494c-9bc1-0f0aa2317e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:57.550555 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 911/1816] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:57 2022] POST /identity/v3/projects => generated 377 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:57.554386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023262e-0b35-494c-9bc1-0f0aa2317e7a admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:57.555131 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023262e-0b35-494c-9bc1-0f0aa2317e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:57.555377 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023262e-0b35-494c-9bc1-0f0aa2317e7a admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:57.555781 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20056eb0-96c3-40cb-bc24-4a2bc36befcf None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:57.556158 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20056eb0-96c3-40cb-bc24-4a2bc36befcf None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:57.557478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20056eb0-96c3-40cb-bc24-4a2bc36befcf None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:57.557955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023262e-0b35-494c-9bc1-0f0aa2317e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:57.559756 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 912/1817] 10.222.0.96 () {54 vars in 921 bytes} [Thu Jul 28 17:55:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:55:57.563215 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31bc9a-6d28-44d4-b80d-94d83a71a7d7 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:57.563955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023262e-0b35-494c-9bc1-0f0aa2317e7a admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:57.565546 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31bc9a-6d28-44d4-b80d-94d83a71a7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:57.568332 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31bc9a-6d28-44d4-b80d-94d83a71a7d7 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:57.570554 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 913/1818] 10.222.0.96 () {54 vars in 921 bytes} [Thu Jul 28 17:55:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:55:57.572835 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31bc9a-6d28-44d4-b80d-94d83a71a7d7 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:57.629294 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 906/1819] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:57 2022] POST /identity/v3/users => generated 299 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:57.630746 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023262e-0b35-494c-9bc1-0f0aa2317e7a admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:57.665684 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023262e-0b35-494c-9bc1-0f0aa2317e7a admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:57.757716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31bc9a-6d28-44d4-b80d-94d83a71a7d7 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:57.765990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f490fee-931d-4f8e-a231-040871303e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:57.766923 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f490fee-931d-4f8e-a231-040871303e12 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:57.767576 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f490fee-931d-4f8e-a231-040871303e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:57.767993 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f490fee-931d-4f8e-a231-040871303e12 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:57.769040 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f490fee-931d-4f8e-a231-040871303e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:57.772310 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f490fee-931d-4f8e-a231-040871303e12 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:57.808513 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826b5c7-d3b4-4de0-b25b-96b5803b1b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:57.809398 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826b5c7-d3b4-4de0-b25b-96b5803b1b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:57.809816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826b5c7-d3b4-4de0-b25b-96b5803b1b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:57.810225 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826b5c7-d3b4-4de0-b25b-96b5803b1b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:57.811467 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826b5c7-d3b4-4de0-b25b-96b5803b1b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:57.814104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826b5c7-d3b4-4de0-b25b-96b5803b1b79 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:57.829052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 907/1820] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:57.834596 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98678b36-de9d-40e4-b5c4-a4709c836027 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:57.835434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98678b36-de9d-40e4-b5c4-a4709c836027 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:57.835847 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98678b36-de9d-40e4-b5c4-a4709c836027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:57.858762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 914/1821] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:57 2022] POST /identity/v3/users => generated 289 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:57.868162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-98678b36-de9d-40e4-b5c4-a4709c836027 None None] MFA Rules not processed for user `5ac367247aa54671ae5c33d251017470`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:57.873137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-98678b36-de9d-40e4-b5c4-a4709c836027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:57.886311 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41700052-52f5-4a97-81a3-9f2443ceed45 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:57.894607 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41700052-52f5-4a97-81a3-9f2443ceed45 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:57.894913 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41700052-52f5-4a97-81a3-9f2443ceed45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:57.955669 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-41700052-52f5-4a97-81a3-9f2443ceed45 None None] MFA Rules not processed for user `5ac367247aa54671ae5c33d251017470`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:57.957578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-41700052-52f5-4a97-81a3-9f2443ceed45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:58.031008 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:58.047856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 908/1822] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Jul 28 17:55:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:58.049040 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98678b36-de9d-40e4-b5c4-a4709c836027 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:58.062867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98678b36-de9d-40e4-b5c4-a4709c836027 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:58.078203 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba71444-f890-41d8-b9ff-5b67661bdee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:58.079256 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba71444-f890-41d8-b9ff-5b67661bdee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:58.079371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba71444-f890-41d8-b9ff-5b67661bdee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:58.079572 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba71444-f890-41d8-b9ff-5b67661bdee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:58.080284 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba71444-f890-41d8-b9ff-5b67661bdee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:58.081942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba71444-f890-41d8-b9ff-5b67661bdee6 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:58.107158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 909/1823] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:58.108226 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba71444-f890-41d8-b9ff-5b67661bdee6 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:58.123902 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba71444-f890-41d8-b9ff-5b67661bdee6 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:58.139715 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1f31e-7c93-4cb5-9798-45d57855b9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:58.140708 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1f31e-7c93-4cb5-9798-45d57855b9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:58.141284 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1f31e-7c93-4cb5-9798-45d57855b9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:58.141743 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1f31e-7c93-4cb5-9798-45d57855b9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:58.143084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1f31e-7c93-4cb5-9798-45d57855b9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:58.145569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1f31e-7c93-4cb5-9798-45d57855b9a7 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:58.156032 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 915/1824] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Jul 28 17:55:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:58.157134 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41700052-52f5-4a97-81a3-9f2443ceed45 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:58.179544 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41700052-52f5-4a97-81a3-9f2443ceed45 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:58.184658 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 910/1825] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:58.196616 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a982cec-c67c-4cc0-95f3-c814c6278c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:58.197551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1f31e-7c93-4cb5-9798-45d57855b9a7 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:58.197705 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a982cec-c67c-4cc0-95f3-c814c6278c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:58.199132 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a982cec-c67c-4cc0-95f3-c814c6278c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:58.199484 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a982cec-c67c-4cc0-95f3-c814c6278c50 admin admin] PATH_INFO: `/v3/projects/3c380bc02a434e12b6f1b88ce29d8b4b/users/7c343523e8ed4136b11623e7e3a5f864/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:58.217013 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1f31e-7c93-4cb5-9798-45d57855b9a7 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:58.223878 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5238b0-3e31-420e-84c5-e4858192c31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:58.224759 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5238b0-3e31-420e-84c5-e4858192c31b admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:58.225201 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5238b0-3e31-420e-84c5-e4858192c31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:58.225925 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5238b0-3e31-420e-84c5-e4858192c31b admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:58.229911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5238b0-3e31-420e-84c5-e4858192c31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:58.232142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5238b0-3e31-420e-84c5-e4858192c31b admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:58.238907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a982cec-c67c-4cc0-95f3-c814c6278c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c380bc02a434e12b6f1b88ce29d8b4b, user_id=7c343523e8ed4136b11623e7e3a5f864, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:58.241673 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a982cec-c67c-4cc0-95f3-c814c6278c50 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:58.254626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 911/1826] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:58.261523 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5238b0-3e31-420e-84c5-e4858192c31b admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:58.293930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5238b0-3e31-420e-84c5-e4858192c31b admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:58.299992 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 916/1827] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:58 2022] PUT /identity/v3/projects/3c380bc02a434e12b6f1b88ce29d8b4b/users/7c343523e8ed4136b11623e7e3a5f864/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:58.310671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46085f-01fd-4ecc-8064-5da3d12015c3 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:58.311013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46085f-01fd-4ecc-8064-5da3d12015c3 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:58.311442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46085f-01fd-4ecc-8064-5da3d12015c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:58.359785 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-5a46085f-01fd-4ecc-8064-5da3d12015c3 None None] MFA Rules not processed for user `7c343523e8ed4136b11623e7e3a5f864`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:58.361589 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5a46085f-01fd-4ecc-8064-5da3d12015c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:58.384689 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:58.434381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840fc87-8cb0-4bde-ad24-c6ab93437e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:58.436819 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840fc87-8cb0-4bde-ad24-c6ab93437e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:58.439000 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840fc87-8cb0-4bde-ad24-c6ab93437e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:58.440067 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840fc87-8cb0-4bde-ad24-c6ab93437e05 admin admin] PATH_INFO: `/v3/projects/0d00ed6cad3b4e3c9003e96b83a50962/users/1571c7da86e34069906fa47053732a9a/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:58.483304 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840fc87-8cb0-4bde-ad24-c6ab93437e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d00ed6cad3b4e3c9003e96b83a50962, user_id=1571c7da86e34069906fa47053732a9a, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:58.495209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840fc87-8cb0-4bde-ad24-c6ab93437e05 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:58.552481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 912/1828] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:58 2022] PUT /identity/v3/projects/0d00ed6cad3b4e3c9003e96b83a50962/users/1571c7da86e34069906fa47053732a9a/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:58.569691 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93636f-a51b-4816-be9e-6ca95aa0aa6f None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:58.570483 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93636f-a51b-4816-be9e-6ca95aa0aa6f None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:58.571003 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93636f-a51b-4816-be9e-6ca95aa0aa6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:58.603873 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 917/1829] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:58.615283 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46085f-01fd-4ecc-8064-5da3d12015c3 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:58.647356 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46085f-01fd-4ecc-8064-5da3d12015c3 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:58.705991 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-df93636f-a51b-4816-be9e-6ca95aa0aa6f None None] MFA Rules not processed for user `1571c7da86e34069906fa47053732a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:55:58.707467 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-df93636f-a51b-4816-be9e-6ca95aa0aa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:58.781561 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee3c13-efa7-4a15-af77-c545e683f849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:58.782161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee3c13-efa7-4a15-af77-c545e683f849 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:58.782445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee3c13-efa7-4a15-af77-c545e683f849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:58.782721 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee3c13-efa7-4a15-af77-c545e683f849 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:58.783412 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee3c13-efa7-4a15-af77-c545e683f849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:58.786035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee3c13-efa7-4a15-af77-c545e683f849 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:58.845026 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 918/1830] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:58 2022] POST /identity/v3/projects => generated 401 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:58.846039 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee3c13-efa7-4a15-af77-c545e683f849 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:58.849394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b0ee3c13-efa7-4a15-af77-c545e683f849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:58.871956 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 913/1831] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:55:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:55:58.872999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93636f-a51b-4816-be9e-6ca95aa0aa6f None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:58.900471 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93636f-a51b-4816-be9e-6ca95aa0aa6f None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:58.961945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:59.006902 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333a3cf-3229-45cc-a8c2-4d2c09800175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:59.007865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333a3cf-3229-45cc-a8c2-4d2c09800175 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:59.008251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333a3cf-3229-45cc-a8c2-4d2c09800175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:59.008935 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333a3cf-3229-45cc-a8c2-4d2c09800175 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:59.010796 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333a3cf-3229-45cc-a8c2-4d2c09800175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:59.012837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333a3cf-3229-45cc-a8c2-4d2c09800175 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:59.057276 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee3c13-efa7-4a15-af77-c545e683f849 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:59.072595 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3cadf-b453-4dc2-9b5c-b5de6854d6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:59.073318 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3cadf-b453-4dc2-9b5c-b5de6854d6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:59.073601 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3cadf-b453-4dc2-9b5c-b5de6854d6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:59.073877 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3cadf-b453-4dc2-9b5c-b5de6854d6a6 admin admin] PATH_INFO: `/v3/projects/047c92930865416abf9826d66cef8840` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:59.075077 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3cadf-b453-4dc2-9b5c-b5de6854d6a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=047c92930865416abf9826d66cef8840)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:59.077023 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3cadf-b453-4dc2-9b5c-b5de6854d6a6 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:59.114061 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 914/1832] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:58 2022] POST /identity/v3/users => generated 307 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:59.115777 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333a3cf-3229-45cc-a8c2-4d2c09800175 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:59.161312 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333a3cf-3229-45cc-a8c2-4d2c09800175 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:59.173449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f9e46-aaf3-456c-b541-94515b89663d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:59.174840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f9e46-aaf3-456c-b541-94515b89663d admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:59.175284 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f9e46-aaf3-456c-b541-94515b89663d admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:59.175771 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f9e46-aaf3-456c-b541-94515b89663d admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:59.177031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f9e46-aaf3-456c-b541-94515b89663d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:59.180526 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f9e46-aaf3-456c-b541-94515b89663d admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:59.202872 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:59.244491 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 915/1833] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:55:59 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:59.244893 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f9e46-aaf3-456c-b541-94515b89663d admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:59.247416 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-801f9e46-aaf3-456c-b541-94515b89663d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:59.255625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fff3cadf-b453-4dc2-9b5c-b5de6854d6a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '047c92930865416abf9826d66cef8840', 'request_id': 'req-fff3cadf-b453-4dc2-9b5c-b5de6854d6a6'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:59.277182 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fff3cadf-b453-4dc2-9b5c-b5de6854d6a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '047c92930865416abf9826d66cef8840', 'request_id': 'req-fff3cadf-b453-4dc2-9b5c-b5de6854d6a6'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:59.298471 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fff3cadf-b453-4dc2-9b5c-b5de6854d6a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '047c92930865416abf9826d66cef8840', 'request_id': 'req-fff3cadf-b453-4dc2-9b5c-b5de6854d6a6'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:59.323441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fff3cadf-b453-4dc2-9b5c-b5de6854d6a6 admin admin] The token cache is being invalidate because project 047c92930865416abf9826d66cef8840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:55:59.323868 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fff3cadf-b453-4dc2-9b5c-b5de6854d6a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:59.327329 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fff3cadf-b453-4dc2-9b5c-b5de6854d6a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:59.329886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 919/1834] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:55:58 2022] DELETE /identity/v3/projects/047c92930865416abf9826d66cef8840 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:55:59.331748 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3cadf-b453-4dc2-9b5c-b5de6854d6a6 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:59.334666 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fff3cadf-b453-4dc2-9b5c-b5de6854d6a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:59.407268 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f9e46-aaf3-456c-b541-94515b89663d admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:59.422244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959415d-cb63-4148-8606-aea0ffc6220c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:59.422987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959415d-cb63-4148-8606-aea0ffc6220c service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:59.423307 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959415d-cb63-4148-8606-aea0ffc6220c service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:59.423744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959415d-cb63-4148-8606-aea0ffc6220c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:59.425795 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e959415d-cb63-4148-8606-aea0ffc6220c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:59.480701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959415d-cb63-4148-8606-aea0ffc6220c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:59.480701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959415d-cb63-4148-8606-aea0ffc6220c service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:59.512759 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 916/1835] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:59.514235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959415d-cb63-4148-8606-aea0ffc6220c service nova] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:59.515904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3cadf-b453-4dc2-9b5c-b5de6854d6a6 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:59.516452 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e959415d-cb63-4148-8606-aea0ffc6220c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:59.676973 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a716e-43a3-400a-8912-b4a674759495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:59.682238 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a716e-43a3-400a-8912-b4a674759495 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:59.682589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959415d-cb63-4148-8606-aea0ffc6220c service nova] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:59.683076 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a716e-43a3-400a-8912-b4a674759495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:59.683733 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a716e-43a3-400a-8912-b4a674759495 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:59.685098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a716e-43a3-400a-8912-b4a674759495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:59.690489 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa589bf-cf77-4d7a-894a-7458af6162c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:59.691170 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa589bf-cf77-4d7a-894a-7458af6162c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:59.691502 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa589bf-cf77-4d7a-894a-7458af6162c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:59.691775 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa589bf-cf77-4d7a-894a-7458af6162c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:59.692754 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a716e-43a3-400a-8912-b4a674759495 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:59.694943 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa589bf-cf77-4d7a-894a-7458af6162c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:59.697612 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa589bf-cf77-4d7a-894a-7458af6162c4 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:59.707210 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 920/1836] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:55:59.712156 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a716e-43a3-400a-8912-b4a674759495 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:59.717167 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f40a716e-43a3-400a-8912-b4a674759495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:59.733126 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 917/1837] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:55:59 2022] POST /identity/v3/users => generated 296 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:55:59.734082 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa589bf-cf77-4d7a-894a-7458af6162c4 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:59.745304 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-3aa589bf-cf77-4d7a-894a-7458af6162c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:59.760168 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a716e-43a3-400a-8912-b4a674759495 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:59.769168 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa589bf-cf77-4d7a-894a-7458af6162c4 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:59.776981 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b63d8b-d529-4939-99be-ddc7234356ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:59.777824 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b63d8b-d529-4939-99be-ddc7234356ec service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:59.778292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b63d8b-d529-4939-99be-ddc7234356ec service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:59.778658 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b63d8b-d529-4939-99be-ddc7234356ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:59.787118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316a6de-9291-4b75-bd0f-539d201ab0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:59.788485 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316a6de-9291-4b75-bd0f-539d201ab0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:59.788782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316a6de-9291-4b75-bd0f-539d201ab0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:59.789368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316a6de-9291-4b75-bd0f-539d201ab0da admin admin] PATH_INFO: `/v3/users/aca93f72c2fb41aa8184ce6f9d1f5d6f` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:59.792184 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316a6de-9291-4b75-bd0f-539d201ab0da admin admin] RBAC: Authorizing `identity:delete_user(user_id=aca93f72c2fb41aa8184ce6f9d1f5d6f)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:59.797146 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316a6de-9291-4b75-bd0f-539d201ab0da admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:59.804229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b4b63d8b-d529-4939-99be-ddc7234356ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:55:59.835605 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b63d8b-d529-4939-99be-ddc7234356ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:55:59.837882 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b63d8b-d529-4939-99be-ddc7234356ec service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:55:59.871808 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 918/1838] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:55:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:59.873429 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b63d8b-d529-4939-99be-ddc7234356ec service nova] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:55:59.922693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b63d8b-d529-4939-99be-ddc7234356ec service nova] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:55:59.934071 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a316a6de-9291-4b75-bd0f-539d201ab0da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aca93f72c2fb41aa8184ce6f9d1f5d6f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:59.936170 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a316a6de-9291-4b75-bd0f-539d201ab0da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aca93f72c2fb41aa8184ce6f9d1f5d6f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:59.936744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a50b7b-abec-4d92-8d60-66bff453ad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:55:59.938664 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a50b7b-abec-4d92-8d60-66bff453ad2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:55:59.944161 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a50b7b-abec-4d92-8d60-66bff453ad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:55:59.945029 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a50b7b-abec-4d92-8d60-66bff453ad2b admin admin] PATH_INFO: `/v3/projects/1e31891c2f5d435c9562ff00e6432685/users/6c509405450b4ada8e05524a163e8f69/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:55:59.951297 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:55:59.961718 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a316a6de-9291-4b75-bd0f-539d201ab0da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aca93f72c2fb41aa8184ce6f9d1f5d6f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:55:59.988247 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:00.008151 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a50b7b-abec-4d92-8d60-66bff453ad2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e31891c2f5d435c9562ff00e6432685, user_id=6c509405450b4ada8e05524a163e8f69, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:00.017818 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a316a6de-9291-4b75-bd0f-539d201ab0da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aca93f72c2fb41aa8184ce6f9d1f5d6f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:00.019972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a50b7b-abec-4d92-8d60-66bff453ad2b admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:00.020543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a316a6de-9291-4b75-bd0f-539d201ab0da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aca93f72c2fb41aa8184ce6f9d1f5d6f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:00.060751 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 919/1839] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:55:59 2022] PUT /identity/v3/projects/1e31891c2f5d435c9562ff00e6432685/users/6c509405450b4ada8e05524a163e8f69/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:00.061367 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 921/1840] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:55:59 2022] DELETE /identity/v3/users/aca93f72c2fb41aa8184ce6f9d1f5d6f => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:00.063516 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a50b7b-abec-4d92-8d60-66bff453ad2b admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:00.067693 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316a6de-9291-4b75-bd0f-539d201ab0da admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:00.068853 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-15a50b7b-abec-4d92-8d60-66bff453ad2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:00.069747 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a316a6de-9291-4b75-bd0f-539d201ab0da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:00.236655 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a50b7b-abec-4d92-8d60-66bff453ad2b admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:00.276372 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316a6de-9291-4b75-bd0f-539d201ab0da admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:00.293312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba998e11-31c1-4a3b-a185-15df89e99598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:00.294093 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba998e11-31c1-4a3b-a185-15df89e99598 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:00.294438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba998e11-31c1-4a3b-a185-15df89e99598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:00.294780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba998e11-31c1-4a3b-a185-15df89e99598 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:00.299866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba998e11-31c1-4a3b-a185-15df89e99598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:00.301653 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba998e11-31c1-4a3b-a185-15df89e99598 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:00.332943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 922/1841] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:56:00.337634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba998e11-31c1-4a3b-a185-15df89e99598 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:00.362732 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c3b2e-3f07-4d57-9fb1-c15c3d98d429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:00.364934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba998e11-31c1-4a3b-a185-15df89e99598 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:00.366334 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c3b2e-3f07-4d57-9fb1-c15c3d98d429 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:00.371439 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c3b2e-3f07-4d57-9fb1-c15c3d98d429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:00.373248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c3b2e-3f07-4d57-9fb1-c15c3d98d429 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:00.375336 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e212e3-85be-40aa-993f-bdd1cfbab0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:00.375639 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c3b2e-3f07-4d57-9fb1-c15c3d98d429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:00.376948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e212e3-85be-40aa-993f-bdd1cfbab0c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:00.377656 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e212e3-85be-40aa-993f-bdd1cfbab0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:00.378454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e212e3-85be-40aa-993f-bdd1cfbab0c8 admin admin] PATH_INFO: `/v3/projects/1e31891c2f5d435c9562ff00e6432685/users/6c509405450b4ada8e05524a163e8f69/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:00.380360 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c3b2e-3f07-4d57-9fb1-c15c3d98d429 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:00.386571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e212e3-85be-40aa-993f-bdd1cfbab0c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e31891c2f5d435c9562ff00e6432685, user_id=6c509405450b4ada8e05524a163e8f69, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:00.390429 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e212e3-85be-40aa-993f-bdd1cfbab0c8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:00.404168 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 920/1842] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:00.406095 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c3b2e-3f07-4d57-9fb1-c15c3d98d429 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:00.429117 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 923/1843] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:00 2022] PUT /identity/v3/projects/1e31891c2f5d435c9562ff00e6432685/users/6c509405450b4ada8e05524a163e8f69/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:56:00.442313 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b97274-670d-4d2b-80de-30d624b1479f None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:00.442769 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b97274-670d-4d2b-80de-30d624b1479f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:00.443217 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b97274-670d-4d2b-80de-30d624b1479f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:00.469779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c3b2e-3f07-4d57-9fb1-c15c3d98d429 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:00.616693 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-65b97274-670d-4d2b-80de-30d624b1479f None None] MFA Rules not processed for user `6c509405450b4ada8e05524a163e8f69`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:00.622038 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-65b97274-670d-4d2b-80de-30d624b1479f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:00.659469 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad536c-824f-4346-b1c2-1f0ae7d035bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:00.662060 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad536c-824f-4346-b1c2-1f0ae7d035bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:00.664407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad536c-824f-4346-b1c2-1f0ae7d035bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:00.665393 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad536c-824f-4346-b1c2-1f0ae7d035bf admin admin] PATH_INFO: `/v3/projects/7232488717a64da0812da330f8f3bd5a/users/5ce02619b26f48bc9fa5d1319ca24dfc/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:00.707111 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad536c-824f-4346-b1c2-1f0ae7d035bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7232488717a64da0812da330f8f3bd5a, user_id=5ce02619b26f48bc9fa5d1319ca24dfc, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:00.710260 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad536c-824f-4346-b1c2-1f0ae7d035bf admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:00.736726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 921/1844] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:00 2022] PUT /identity/v3/projects/7232488717a64da0812da330f8f3bd5a/users/5ce02619b26f48bc9fa5d1319ca24dfc/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:00.740586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad536c-824f-4346-b1c2-1f0ae7d035bf admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:00.745343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b4ad536c-824f-4346-b1c2-1f0ae7d035bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:00.756316 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 924/1845] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:00 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:56:00.760084 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b97274-670d-4d2b-80de-30d624b1479f None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:00.765582 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:00.776036 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b97274-670d-4d2b-80de-30d624b1479f None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:00.894588 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:00.932281 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8403c-8cea-4df8-a0cd-2c884e316306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:00.933936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8403c-8cea-4df8-a0cd-2c884e316306 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:00.934388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8403c-8cea-4df8-a0cd-2c884e316306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:00.934932 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8403c-8cea-4df8-a0cd-2c884e316306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:00.936631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8403c-8cea-4df8-a0cd-2c884e316306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:00.939037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8403c-8cea-4df8-a0cd-2c884e316306 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:00.953075 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 925/1846] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:00.954220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8403c-8cea-4df8-a0cd-2c884e316306 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:00.956047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-aff8403c-8cea-4df8-a0cd-2c884e316306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:00.972749 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad536c-824f-4346-b1c2-1f0ae7d035bf admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:00.983953 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70dbd7-286c-4e5f-bb98-78d28bf3ac81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:00.986377 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70dbd7-286c-4e5f-bb98-78d28bf3ac81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:00.987320 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70dbd7-286c-4e5f-bb98-78d28bf3ac81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:00.988407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70dbd7-286c-4e5f-bb98-78d28bf3ac81 admin admin] PATH_INFO: `/v3/projects/a3adba06576b4e4ebb0aad65698c7a54` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:00.992971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70dbd7-286c-4e5f-bb98-78d28bf3ac81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3adba06576b4e4ebb0aad65698c7a54)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:00.998031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70dbd7-286c-4e5f-bb98-78d28bf3ac81 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:01.081524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8403c-8cea-4df8-a0cd-2c884e316306 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:01.085739 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-aa70dbd7-286c-4e5f-bb98-78d28bf3ac81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3adba06576b4e4ebb0aad65698c7a54', 'request_id': 'req-aa70dbd7-286c-4e5f-bb98-78d28bf3ac81'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:01.107961 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-aa70dbd7-286c-4e5f-bb98-78d28bf3ac81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3adba06576b4e4ebb0aad65698c7a54', 'request_id': 'req-aa70dbd7-286c-4e5f-bb98-78d28bf3ac81'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:01.120626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-aa70dbd7-286c-4e5f-bb98-78d28bf3ac81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3adba06576b4e4ebb0aad65698c7a54', 'request_id': 'req-aa70dbd7-286c-4e5f-bb98-78d28bf3ac81'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:01.147308 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-aa70dbd7-286c-4e5f-bb98-78d28bf3ac81 admin admin] The token cache is being invalidate because project a3adba06576b4e4ebb0aad65698c7a54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:01.148353 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-aa70dbd7-286c-4e5f-bb98-78d28bf3ac81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:01.150128 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-aa70dbd7-286c-4e5f-bb98-78d28bf3ac81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:01.156725 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 922/1847] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:00 2022] DELETE /identity/v3/projects/a3adba06576b4e4ebb0aad65698c7a54 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:01.158600 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70dbd7-286c-4e5f-bb98-78d28bf3ac81 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:01.161885 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-aa70dbd7-286c-4e5f-bb98-78d28bf3ac81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:01.182318 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c57031-ca2c-4a9c-977a-2c96c4e8ecd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:01.183104 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c57031-ca2c-4a9c-977a-2c96c4e8ecd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:01.183289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c57031-ca2c-4a9c-977a-2c96c4e8ecd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:01.183516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c57031-ca2c-4a9c-977a-2c96c4e8ecd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:01.186088 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-73c57031-ca2c-4a9c-977a-2c96c4e8ecd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:01.253930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70dbd7-286c-4e5f-bb98-78d28bf3ac81 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:01.259201 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96aeae3-8f14-492d-9f04-75cfdd6e7312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:01.260047 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96aeae3-8f14-492d-9f04-75cfdd6e7312 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:01.260637 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96aeae3-8f14-492d-9f04-75cfdd6e7312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:01.261008 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96aeae3-8f14-492d-9f04-75cfdd6e7312 admin admin] PATH_INFO: `/v3/projects/7232488717a64da0812da330f8f3bd5a/users/5ce02619b26f48bc9fa5d1319ca24dfc/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:01.265381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96aeae3-8f14-492d-9f04-75cfdd6e7312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7232488717a64da0812da330f8f3bd5a, user_id=5ce02619b26f48bc9fa5d1319ca24dfc, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:01.268965 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96aeae3-8f14-492d-9f04-75cfdd6e7312 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:01.283194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 923/1848] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:01 2022] PUT /identity/v3/projects/7232488717a64da0812da330f8f3bd5a/users/5ce02619b26f48bc9fa5d1319ca24dfc/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:01.284389 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96aeae3-8f14-492d-9f04-75cfdd6e7312 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:01.286584 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-d96aeae3-8f14-492d-9f04-75cfdd6e7312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:01.336547 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:01.397228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96aeae3-8f14-492d-9f04-75cfdd6e7312 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:01.397482 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c57031-ca2c-4a9c-977a-2c96c4e8ecd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:01.403232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973afcb-0815-4a7d-b990-f0bbaa708aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:01.404052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973afcb-0815-4a7d-b990-f0bbaa708aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:01.404427 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973afcb-0815-4a7d-b990-f0bbaa708aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:01.404553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c57031-ca2c-4a9c-977a-2c96c4e8ecd8 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:01.404867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973afcb-0815-4a7d-b990-f0bbaa708aea admin admin] PATH_INFO: `/v3/users/3d71b2f53fb841e2a2de12b889d26fd8` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:01.406512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973afcb-0815-4a7d-b990-f0bbaa708aea admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d71b2f53fb841e2a2de12b889d26fd8)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:01.408583 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973afcb-0815-4a7d-b990-f0bbaa708aea admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:01.446677 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 926/1849] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:00 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:01.449936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede56ab8-e9d7-44aa-9f78-6fedde91a414 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:01.450230 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede56ab8-e9d7-44aa-9f78-6fedde91a414 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:01.451381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede56ab8-e9d7-44aa-9f78-6fedde91a414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:01.502961 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-ede56ab8-e9d7-44aa-9f78-6fedde91a414 None None] MFA Rules not processed for user `5ce02619b26f48bc9fa5d1319ca24dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:01.504286 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ede56ab8-e9d7-44aa-9f78-6fedde91a414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:01.562628 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-7973afcb-0815-4a7d-b990-f0bbaa708aea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d71b2f53fb841e2a2de12b889d26fd8'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:01.655200 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-7973afcb-0815-4a7d-b990-f0bbaa708aea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d71b2f53fb841e2a2de12b889d26fd8'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:01.702365 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-7973afcb-0815-4a7d-b990-f0bbaa708aea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d71b2f53fb841e2a2de12b889d26fd8'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:01.704290 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:01.728287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-7973afcb-0815-4a7d-b990-f0bbaa708aea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d71b2f53fb841e2a2de12b889d26fd8'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:01.730495 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-7973afcb-0815-4a7d-b990-f0bbaa708aea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d71b2f53fb841e2a2de12b889d26fd8'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:01.748264 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 924/1850] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:01 2022] DELETE /identity/v3/users/3d71b2f53fb841e2a2de12b889d26fd8 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:01.749230 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973afcb-0815-4a7d-b990-f0bbaa708aea admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:01.758768 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-7973afcb-0815-4a7d-b990-f0bbaa708aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:01.809895 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 927/1851] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:01.943781 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973afcb-0815-4a7d-b990-f0bbaa708aea admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:01.955818 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5452d-36d5-4dce-93fc-9b289bd51475 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:01.958951 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5452d-36d5-4dce-93fc-9b289bd51475 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:01.959345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5452d-36d5-4dce-93fc-9b289bd51475 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:01.960063 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5452d-36d5-4dce-93fc-9b289bd51475 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:01.966646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-5db5452d-36d5-4dce-93fc-9b289bd51475 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:02.001882 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede56ab8-e9d7-44aa-9f78-6fedde91a414 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:02.004420 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ede56ab8-e9d7-44aa-9f78-6fedde91a414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:02.116263 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5452d-36d5-4dce-93fc-9b289bd51475 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:02.122722 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5452d-36d5-4dce-93fc-9b289bd51475 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:02.143164 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 925/1852] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:02.154504 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5452d-36d5-4dce-93fc-9b289bd51475 service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:02.156596 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-5db5452d-36d5-4dce-93fc-9b289bd51475 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:02.168558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede56ab8-e9d7-44aa-9f78-6fedde91a414 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:02.177359 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d5812-8729-4582-a505-b1a7281c79ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:02.179463 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d5812-8729-4582-a505-b1a7281c79ec service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:02.179965 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d5812-8729-4582-a505-b1a7281c79ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:02.181574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d5812-8729-4582-a505-b1a7281c79ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:02.181706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:02.199110 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2d0d5812-8729-4582-a505-b1a7281c79ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:02.331696 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5452d-36d5-4dce-93fc-9b289bd51475 service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:02.344521 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3650c-b9f0-4e9c-9296-6ed4ee74181f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:02.345369 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3650c-b9f0-4e9c-9296-6ed4ee74181f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:02.345648 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3650c-b9f0-4e9c-9296-6ed4ee74181f admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:02.345922 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3650c-b9f0-4e9c-9296-6ed4ee74181f admin admin] PATH_INFO: `/v3/projects/7a788fb80bb349c584df29052b2389a2` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:02.349032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3650c-b9f0-4e9c-9296-6ed4ee74181f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a788fb80bb349c584df29052b2389a2)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:02.351017 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3650c-b9f0-4e9c-9296-6ed4ee74181f admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:02.359003 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d5812-8729-4582-a505-b1a7281c79ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:02.362107 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d5812-8729-4582-a505-b1a7281c79ec service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:02.374761 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 928/1853] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:56:02.413599 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-82b3650c-b9f0-4e9c-9296-6ed4ee74181f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a788fb80bb349c584df29052b2389a2', 'request_id': 'req-82b3650c-b9f0-4e9c-9296-6ed4ee74181f'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:02.425879 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-82b3650c-b9f0-4e9c-9296-6ed4ee74181f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a788fb80bb349c584df29052b2389a2', 'request_id': 'req-82b3650c-b9f0-4e9c-9296-6ed4ee74181f'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:02.438746 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-82b3650c-b9f0-4e9c-9296-6ed4ee74181f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a788fb80bb349c584df29052b2389a2', 'request_id': 'req-82b3650c-b9f0-4e9c-9296-6ed4ee74181f'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:02.455644 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-82b3650c-b9f0-4e9c-9296-6ed4ee74181f admin admin] The token cache is being invalidate because project 7a788fb80bb349c584df29052b2389a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:02.456293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-82b3650c-b9f0-4e9c-9296-6ed4ee74181f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:02.457044 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-82b3650c-b9f0-4e9c-9296-6ed4ee74181f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:02.459198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 926/1854] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:02 2022] DELETE /identity/v3/projects/7a788fb80bb349c584df29052b2389a2 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:56:02.468022 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba5d7b-f23d-4491-9bcb-1cc9748b6bc6 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:02.469096 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba5d7b-f23d-4491-9bcb-1cc9748b6bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:02.470330 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba5d7b-f23d-4491-9bcb-1cc9748b6bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:02.509925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-edba5d7b-f23d-4491-9bcb-1cc9748b6bc6 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:02.512109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-edba5d7b-f23d-4491-9bcb-1cc9748b6bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:02.607855 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 929/1855] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:02.615871 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18ed07-cb2a-4ced-8b5f-701118585a37 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:02.616181 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18ed07-cb2a-4ced-8b5f-701118585a37 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:02.616444 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18ed07-cb2a-4ced-8b5f-701118585a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:02.625704 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba5d7b-f23d-4491-9bcb-1cc9748b6bc6 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:02.627327 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-edba5d7b-f23d-4491-9bcb-1cc9748b6bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:02.646289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-4b18ed07-cb2a-4ced-8b5f-701118585a37 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:02.647516 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-4b18ed07-cb2a-4ced-8b5f-701118585a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:02.669237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba5d7b-f23d-4491-9bcb-1cc9748b6bc6 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:02.681825 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e51e1-195b-4f4e-8757-367d29265794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:02.684223 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 927/1856] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:02.685622 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18ed07-cb2a-4ced-8b5f-701118585a37 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:02.694607 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e51e1-195b-4f4e-8757-367d29265794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:02.695864 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e51e1-195b-4f4e-8757-367d29265794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:02.696502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e51e1-195b-4f4e-8757-367d29265794 admin admin] PATH_INFO: `/v3/projects/b5587f24d2e740b1a8345a99fa9044b0` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:02.698388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18ed07-cb2a-4ced-8b5f-701118585a37 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:02.700289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e51e1-195b-4f4e-8757-367d29265794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5587f24d2e740b1a8345a99fa9044b0)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:02.703774 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e51e1-195b-4f4e-8757-367d29265794 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:02.705520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b5531-eb10-4f12-ac1f-4da0a2a293db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:02.706192 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b5531-eb10-4f12-ac1f-4da0a2a293db admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:02.706429 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b5531-eb10-4f12-ac1f-4da0a2a293db admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:02.707007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b5531-eb10-4f12-ac1f-4da0a2a293db admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:02.707876 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b5531-eb10-4f12-ac1f-4da0a2a293db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:02.708291 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b5531-eb10-4f12-ac1f-4da0a2a293db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:02.714279 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b5531-eb10-4f12-ac1f-4da0a2a293db admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:02.736596 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 928/1857] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:56:02.741422 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b5531-eb10-4f12-ac1f-4da0a2a293db admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:02.753980 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b5531-eb10-4f12-ac1f-4da0a2a293db admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:02.760603 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf052a-cc0d-48e1-9949-849d7bea2680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:02.761601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf052a-cc0d-48e1-9949-849d7bea2680 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:02.762589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf052a-cc0d-48e1-9949-849d7bea2680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:02.762955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf052a-cc0d-48e1-9949-849d7bea2680 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:02.763840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf052a-cc0d-48e1-9949-849d7bea2680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:02.766277 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf052a-cc0d-48e1-9949-849d7bea2680 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:02.827908 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:02.860083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 929/1858] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:02 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:02.861792 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf052a-cc0d-48e1-9949-849d7bea2680 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:02.868719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ba5e51e1-195b-4f4e-8757-367d29265794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5587f24d2e740b1a8345a99fa9044b0', 'request_id': 'req-ba5e51e1-195b-4f4e-8757-367d29265794'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:02.877255 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ba5e51e1-195b-4f4e-8757-367d29265794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5587f24d2e740b1a8345a99fa9044b0', 'request_id': 'req-ba5e51e1-195b-4f4e-8757-367d29265794'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:02.900978 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ba5e51e1-195b-4f4e-8757-367d29265794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5587f24d2e740b1a8345a99fa9044b0', 'request_id': 'req-ba5e51e1-195b-4f4e-8757-367d29265794'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:02.932255 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ba5e51e1-195b-4f4e-8757-367d29265794 admin admin] The token cache is being invalidate because project b5587f24d2e740b1a8345a99fa9044b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:02.932255 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ba5e51e1-195b-4f4e-8757-367d29265794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:02.934630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ba5e51e1-195b-4f4e-8757-367d29265794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:02.938856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 930/1859] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:02 2022] DELETE /identity/v3/projects/b5587f24d2e740b1a8345a99fa9044b0 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:56:02.944861 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fc2ec-a590-499a-a413-86fe623608e8 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:02.946307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fc2ec-a590-499a-a413-86fe623608e8 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:02.946881 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fc2ec-a590-499a-a413-86fe623608e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:02.999387 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e38fc2ec-a590-499a-a413-86fe623608e8 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:03.000689 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e38fc2ec-a590-499a-a413-86fe623608e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:03.028453 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:03.043163 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf052a-cc0d-48e1-9949-849d7bea2680 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:03.058532 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839a5b6-3a32-44ea-94b6-2ded8a83ae01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:03.061403 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839a5b6-3a32-44ea-94b6-2ded8a83ae01 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:03.061879 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839a5b6-3a32-44ea-94b6-2ded8a83ae01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:03.065507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839a5b6-3a32-44ea-94b6-2ded8a83ae01 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:03.067762 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839a5b6-3a32-44ea-94b6-2ded8a83ae01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:03.071063 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839a5b6-3a32-44ea-94b6-2ded8a83ae01 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:03.115985 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 931/1860] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:03.124964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fc0c8-6b75-435c-a7b9-9186c4e7934b None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:03.125293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fc0c8-6b75-435c-a7b9-9186c4e7934b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:03.125584 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fc0c8-6b75-435c-a7b9-9186c4e7934b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:03.132259 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 930/1861] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:02 2022] POST /identity/v3/users => generated 294 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:03.136371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839a5b6-3a32-44ea-94b6-2ded8a83ae01 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:03.142605 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1839a5b6-3a32-44ea-94b6-2ded8a83ae01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:03.164893 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839a5b6-3a32-44ea-94b6-2ded8a83ae01 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:03.172807 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-046fc0c8-6b75-435c-a7b9-9186c4e7934b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:03.174914 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-046fc0c8-6b75-435c-a7b9-9186c4e7934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:03.177561 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69eae7-e80d-4247-9205-cd32455bd3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:03.178352 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69eae7-e80d-4247-9205-cd32455bd3ff admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:03.178628 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69eae7-e80d-4247-9205-cd32455bd3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:03.178900 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69eae7-e80d-4247-9205-cd32455bd3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:03.179643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69eae7-e80d-4247-9205-cd32455bd3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:03.181634 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69eae7-e80d-4247-9205-cd32455bd3ff admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:03.189100 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 932/1862] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:03.193716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fc0c8-6b75-435c-a7b9-9186c4e7934b None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:03.204114 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 931/1863] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:56:03.208239 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69eae7-e80d-4247-9205-cd32455bd3ff admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:03.210226 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fc0c8-6b75-435c-a7b9-9186c4e7934b None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:03.215941 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf8c28-e456-44de-b6ee-d6058367d93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:03.216734 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf8c28-e456-44de-b6ee-d6058367d93f admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:03.217135 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf8c28-e456-44de-b6ee-d6058367d93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:03.217425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf8c28-e456-44de-b6ee-d6058367d93f admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:03.218147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf8c28-e456-44de-b6ee-d6058367d93f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:03.218450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf8c28-e456-44de-b6ee-d6058367d93f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:03.220243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf8c28-e456-44de-b6ee-d6058367d93f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:03.223408 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69eae7-e80d-4247-9205-cd32455bd3ff admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:03.238565 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c69fb-3556-422e-81cd-f3c723765f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:03.239620 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c69fb-3556-422e-81cd-f3c723765f9b admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:03.240391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c69fb-3556-422e-81cd-f3c723765f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:03.241446 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c69fb-3556-422e-81cd-f3c723765f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:03.243167 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c69fb-3556-422e-81cd-f3c723765f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:03.246725 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 933/1864] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:56:03.248021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf8c28-e456-44de-b6ee-d6058367d93f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:03.252109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-46cf8c28-e456-44de-b6ee-d6058367d93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:03.252503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c69fb-3556-422e-81cd-f3c723765f9b admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:03.267322 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 932/1865] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:03.268541 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c69fb-3556-422e-81cd-f3c723765f9b admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:03.268656 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf8c28-e456-44de-b6ee-d6058367d93f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:03.274139 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f6e0a-db30-4813-bfe4-60f321a0a254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:03.275379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f6e0a-db30-4813-bfe4-60f321a0a254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:03.275604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f6e0a-db30-4813-bfe4-60f321a0a254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:03.275945 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f6e0a-db30-4813-bfe4-60f321a0a254 admin admin] PATH_INFO: `/v3/users/281f0535eb1543aeb731200585fe4998` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:03.277424 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f6e0a-db30-4813-bfe4-60f321a0a254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=281f0535eb1543aeb731200585fe4998)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:03.282165 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c69fb-3556-422e-81cd-f3c723765f9b admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:03.289895 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d46557-5822-40e7-97fd-4819c7328298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:03.290944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d46557-5822-40e7-97fd-4819c7328298 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:03.291423 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f6e0a-db30-4813-bfe4-60f321a0a254 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:03.291699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d46557-5822-40e7-97fd-4819c7328298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:03.292189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d46557-5822-40e7-97fd-4819c7328298 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:03.293109 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d46557-5822-40e7-97fd-4819c7328298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:03.295592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d46557-5822-40e7-97fd-4819c7328298 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:03.336149 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 933/1866] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:03 2022] POST /identity/v3/projects => generated 361 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:03.336149 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d46557-5822-40e7-97fd-4819c7328298 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:03.355993 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f47f6e0a-db30-4813-bfe4-60f321a0a254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '281f0535eb1543aeb731200585fe4998'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:03.356796 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f47f6e0a-db30-4813-bfe4-60f321a0a254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '281f0535eb1543aeb731200585fe4998'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:03.365346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f47f6e0a-db30-4813-bfe4-60f321a0a254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '281f0535eb1543aeb731200585fe4998'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:03.380516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f47f6e0a-db30-4813-bfe4-60f321a0a254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '281f0535eb1543aeb731200585fe4998'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:03.381649 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f47f6e0a-db30-4813-bfe4-60f321a0a254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '281f0535eb1543aeb731200585fe4998'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:03.400654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 934/1867] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:03 2022] DELETE /identity/v3/users/281f0535eb1543aeb731200585fe4998 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:03.400654 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f6e0a-db30-4813-bfe4-60f321a0a254 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:03.402130 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f47f6e0a-db30-4813-bfe4-60f321a0a254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:03.403973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d46557-5822-40e7-97fd-4819c7328298 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:03.413785 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:03.475734 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35330ccf-c83a-41ca-90ba-4c98370e5963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:03.476339 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35330ccf-c83a-41ca-90ba-4c98370e5963 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:03.476675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35330ccf-c83a-41ca-90ba-4c98370e5963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:03.476951 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35330ccf-c83a-41ca-90ba-4c98370e5963 admin admin] PATH_INFO: `/v3/projects/cc19452614ec4cca89122f64fe479b2f/users/80505191cb754782a2cd740fd24e215f/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:03.479639 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f6e0a-db30-4813-bfe4-60f321a0a254 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:03.484261 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407aab0-59bf-401d-a862-dd55acb728e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:03.484893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407aab0-59bf-401d-a862-dd55acb728e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:03.485208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407aab0-59bf-401d-a862-dd55acb728e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:03.485491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407aab0-59bf-401d-a862-dd55acb728e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:03.486155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407aab0-59bf-401d-a862-dd55acb728e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:03.488092 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407aab0-59bf-401d-a862-dd55acb728e8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:03.493566 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35330ccf-c83a-41ca-90ba-4c98370e5963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc19452614ec4cca89122f64fe479b2f, user_id=80505191cb754782a2cd740fd24e215f, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:03.496215 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35330ccf-c83a-41ca-90ba-4c98370e5963 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:03.512368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 934/1868] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:03 2022] PUT /identity/v3/projects/cc19452614ec4cca89122f64fe479b2f/users/80505191cb754782a2cd740fd24e215f/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:03.516068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 935/1869] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:03 2022] POST /identity/v3/users => generated 281 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:03.517349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ebd0f-5725-485b-9f50-c9a4fb165327 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:03.517640 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ebd0f-5725-485b-9f50-c9a4fb165327 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:03.517921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ebd0f-5725-485b-9f50-c9a4fb165327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:03.523084 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407aab0-59bf-401d-a862-dd55acb728e8 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:03.533046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407aab0-59bf-401d-a862-dd55acb728e8 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:03.536508 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-863ebd0f-5725-485b-9f50-c9a4fb165327 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:03.537750 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-863ebd0f-5725-485b-9f50-c9a4fb165327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:03.567635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:03.596795 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7896578-782f-49ed-b739-e91c7f28d934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:03.597735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7896578-782f-49ed-b739-e91c7f28d934 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:03.598018 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7896578-782f-49ed-b739-e91c7f28d934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:03.598293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7896578-782f-49ed-b739-e91c7f28d934 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:03.598989 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7896578-782f-49ed-b739-e91c7f28d934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:03.600606 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7896578-782f-49ed-b739-e91c7f28d934 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:03.607734 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 935/1870] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:03.609425 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dc4d0-6ed2-4194-a4e8-62326eb3f025 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:03.609709 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dc4d0-6ed2-4194-a4e8-62326eb3f025 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:03.610035 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dc4d0-6ed2-4194-a4e8-62326eb3f025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:03.616954 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 936/1871] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:56:03.621051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7896578-782f-49ed-b739-e91c7f28d934 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:03.624118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c7896578-782f-49ed-b739-e91c7f28d934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:03.640548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-eb9dc4d0-6ed2-4194-a4e8-62326eb3f025 None None] MFA Rules not processed for user `80505191cb754782a2cd740fd24e215f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:03.642715 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-eb9dc4d0-6ed2-4194-a4e8-62326eb3f025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:03.687006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7896578-782f-49ed-b739-e91c7f28d934 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:03.691390 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85f3e2-b386-40d1-9949-4a4921ee7f4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:03.692038 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85f3e2-b386-40d1-9949-4a4921ee7f4a service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:03.692318 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85f3e2-b386-40d1-9949-4a4921ee7f4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:03.692591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85f3e2-b386-40d1-9949-4a4921ee7f4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:03.702526 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85f3e2-b386-40d1-9949-4a4921ee7f4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:03.704042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85f3e2-b386-40d1-9949-4a4921ee7f4a service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:03.708563 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 936/1872] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:03.709618 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dc4d0-6ed2-4194-a4e8-62326eb3f025 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:03.717482 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 937/1873] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:03.718212 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85f3e2-b386-40d1-9949-4a4921ee7f4a service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:03.719870 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-be85f3e2-b386-40d1-9949-4a4921ee7f4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:03.728456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dc4d0-6ed2-4194-a4e8-62326eb3f025 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:03.734650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dcf2a-00d5-400b-a14f-059443930469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:03.735279 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dcf2a-00d5-400b-a14f-059443930469 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:03.735558 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dcf2a-00d5-400b-a14f-059443930469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:03.735829 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dcf2a-00d5-400b-a14f-059443930469 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:03.736527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dcf2a-00d5-400b-a14f-059443930469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:03.737306 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85f3e2-b386-40d1-9949-4a4921ee7f4a service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:03.738497 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dcf2a-00d5-400b-a14f-059443930469 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:03.743118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a7cf6-ec2f-4493-887f-c9166d346db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:03.743912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a7cf6-ec2f-4493-887f-c9166d346db9 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:03.744431 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a7cf6-ec2f-4493-887f-c9166d346db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:03.747766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a7cf6-ec2f-4493-887f-c9166d346db9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:03.749693 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a7cf6-ec2f-4493-887f-c9166d346db9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:03.751664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a7cf6-ec2f-4493-887f-c9166d346db9 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:03.757765 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 937/1874] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:03.759569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dcf2a-00d5-400b-a14f-059443930469 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:03.773312 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dcf2a-00d5-400b-a14f-059443930469 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:03.781633 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b427d7-62a3-4658-a65d-7ecb7fd69b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:03.784998 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b427d7-62a3-4658-a65d-7ecb7fd69b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:03.785313 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b427d7-62a3-4658-a65d-7ecb7fd69b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:03.787498 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b427d7-62a3-4658-a65d-7ecb7fd69b3a admin admin] PATH_INFO: `/v3/projects/cd13a157dd024765ac7bb25bc11378fe/users/ea89efa00eee4623b875fb74721b77c8/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:03.800263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 938/1875] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:03 2022] POST /identity/v3/projects => generated 387 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:03.801876 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a7cf6-ec2f-4493-887f-c9166d346db9 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:03.826161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:03.831261 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b427d7-62a3-4658-a65d-7ecb7fd69b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd13a157dd024765ac7bb25bc11378fe, user_id=ea89efa00eee4623b875fb74721b77c8, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:03.839317 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b427d7-62a3-4658-a65d-7ecb7fd69b3a admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:03.874372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 938/1876] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:03 2022] PUT /identity/v3/projects/cd13a157dd024765ac7bb25bc11378fe/users/ea89efa00eee4623b875fb74721b77c8/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:03.875950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf681c4-f817-4007-8f40-413720a4f2a1 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:03.876235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf681c4-f817-4007-8f40-413720a4f2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:03.876509 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf681c4-f817-4007-8f40-413720a4f2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:03.938666 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-fdf681c4-f817-4007-8f40-413720a4f2a1 None None] MFA Rules not processed for user `ea89efa00eee4623b875fb74721b77c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:03.941134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-fdf681c4-f817-4007-8f40-413720a4f2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:03.966933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a7cf6-ec2f-4493-887f-c9166d346db9 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:04.036208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 939/1877] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:04.051990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe22e1f-6995-463c-b441-05bc283e1aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:04.052631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe22e1f-6995-463c-b441-05bc283e1aef admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:04.052914 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe22e1f-6995-463c-b441-05bc283e1aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:04.053241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe22e1f-6995-463c-b441-05bc283e1aef admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:04.053916 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe22e1f-6995-463c-b441-05bc283e1aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:04.056878 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe22e1f-6995-463c-b441-05bc283e1aef admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:04.099042 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf681c4-f817-4007-8f40-413720a4f2a1 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:04.101506 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-fdf681c4-f817-4007-8f40-413720a4f2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:04.103485 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 939/1878] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:03 2022] POST /identity/v3/users => generated 300 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:56:04.107274 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe22e1f-6995-463c-b441-05bc283e1aef admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:04.123012 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe22e1f-6995-463c-b441-05bc283e1aef admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:04.126969 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:04.135729 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9aeae-8dcb-409b-971c-d302139943d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:04.136858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9aeae-8dcb-409b-971c-d302139943d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:04.136968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9aeae-8dcb-409b-971c-d302139943d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:04.137412 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9aeae-8dcb-409b-971c-d302139943d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:04.138184 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9aeae-8dcb-409b-971c-d302139943d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:04.140751 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9aeae-8dcb-409b-971c-d302139943d9 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:04.162851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 940/1879] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:04.166965 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9aeae-8dcb-409b-971c-d302139943d9 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:04.168667 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f4b9aeae-8dcb-409b-971c-d302139943d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:04.180164 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf681c4-f817-4007-8f40-413720a4f2a1 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:04.181954 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9aeae-8dcb-409b-971c-d302139943d9 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:04.185957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b48b78-66f4-4a72-9aa3-f679d9eef462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:04.186825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b48b78-66f4-4a72-9aa3-f679d9eef462 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:04.187392 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b48b78-66f4-4a72-9aa3-f679d9eef462 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:04.187844 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec30c3f-3256-4cda-9dd8-01c4808d306d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:04.188388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b48b78-66f4-4a72-9aa3-f679d9eef462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:04.188545 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec30c3f-3256-4cda-9dd8-01c4808d306d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:04.188831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec30c3f-3256-4cda-9dd8-01c4808d306d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:04.189287 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec30c3f-3256-4cda-9dd8-01c4808d306d admin admin] PATH_INFO: `/v3/projects/b6ee8a2c8c3a45db840ef797597e3d82` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:04.190479 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec30c3f-3256-4cda-9dd8-01c4808d306d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ee8a2c8c3a45db840ef797597e3d82)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:04.191418 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-57b48b78-66f4-4a72-9aa3-f679d9eef462 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:04.192394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec30c3f-3256-4cda-9dd8-01c4808d306d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:04.253257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-dec30c3f-3256-4cda-9dd8-01c4808d306d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ee8a2c8c3a45db840ef797597e3d82', 'request_id': 'req-dec30c3f-3256-4cda-9dd8-01c4808d306d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:04.260834 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-dec30c3f-3256-4cda-9dd8-01c4808d306d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ee8a2c8c3a45db840ef797597e3d82', 'request_id': 'req-dec30c3f-3256-4cda-9dd8-01c4808d306d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:04.268702 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b48b78-66f4-4a72-9aa3-f679d9eef462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:04.270204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b48b78-66f4-4a72-9aa3-f679d9eef462 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:04.270709 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-dec30c3f-3256-4cda-9dd8-01c4808d306d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ee8a2c8c3a45db840ef797597e3d82', 'request_id': 'req-dec30c3f-3256-4cda-9dd8-01c4808d306d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:04.281361 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 940/1880] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:56:04.282209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b48b78-66f4-4a72-9aa3-f679d9eef462 service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:04.283422 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-dec30c3f-3256-4cda-9dd8-01c4808d306d admin admin] The token cache is being invalidate because project b6ee8a2c8c3a45db840ef797597e3d82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:04.283862 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-dec30c3f-3256-4cda-9dd8-01c4808d306d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:04.284529 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-dec30c3f-3256-4cda-9dd8-01c4808d306d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:04.286238 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 941/1881] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:04 2022] DELETE /identity/v3/projects/b6ee8a2c8c3a45db840ef797597e3d82 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:04.287110 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec30c3f-3256-4cda-9dd8-01c4808d306d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:04.290222 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-dec30c3f-3256-4cda-9dd8-01c4808d306d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:04.297442 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b48b78-66f4-4a72-9aa3-f679d9eef462 service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:04.324333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:04.380946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec30c3f-3256-4cda-9dd8-01c4808d306d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:04.384920 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c2489-2cab-4414-ad6a-60fe876814d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:04.385746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c2489-2cab-4414-ad6a-60fe876814d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:04.386026 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c2489-2cab-4414-ad6a-60fe876814d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:04.386474 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c2489-2cab-4414-ad6a-60fe876814d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:04.388504 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f6632-187f-4419-8c77-1cdb82fa080e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:04.389415 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f6632-187f-4419-8c77-1cdb82fa080e admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:04.389822 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f6632-187f-4419-8c77-1cdb82fa080e admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:04.390304 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f6632-187f-4419-8c77-1cdb82fa080e admin admin] PATH_INFO: `/v3/projects/c681132c880248ab9425b1f6b679d3b4/users/41e44f8122184115aec61343e7e202bc/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:04.391038 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-061c2489-2cab-4414-ad6a-60fe876814d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:04.412756 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f6632-187f-4419-8c77-1cdb82fa080e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c681132c880248ab9425b1f6b679d3b4, user_id=41e44f8122184115aec61343e7e202bc, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:04.417338 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f6632-187f-4419-8c77-1cdb82fa080e admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:04.440626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 941/1882] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:04 2022] PUT /identity/v3/projects/c681132c880248ab9425b1f6b679d3b4/users/41e44f8122184115aec61343e7e202bc/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:04.443772 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f6632-187f-4419-8c77-1cdb82fa080e admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:04.448011 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ee3f6632-187f-4419-8c77-1cdb82fa080e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:04.511937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c2489-2cab-4414-ad6a-60fe876814d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:04.513596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c2489-2cab-4414-ad6a-60fe876814d0 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:04.525465 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 942/1883] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:04.527535 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c2489-2cab-4414-ad6a-60fe876814d0 service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:04.529491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-061c2489-2cab-4414-ad6a-60fe876814d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:04.538731 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:04.573367 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c2489-2cab-4414-ad6a-60fe876814d0 service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:04.584516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6297f4-d9a9-4c89-9dc6-1c33a2319722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:04.586477 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6297f4-d9a9-4c89-9dc6-1c33a2319722 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:04.587376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6297f4-d9a9-4c89-9dc6-1c33a2319722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:04.587733 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6297f4-d9a9-4c89-9dc6-1c33a2319722 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:04.588385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6297f4-d9a9-4c89-9dc6-1c33a2319722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:04.589420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f6632-187f-4419-8c77-1cdb82fa080e admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:04.591819 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6297f4-d9a9-4c89-9dc6-1c33a2319722 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:04.607728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6a789-b461-4fe3-aabb-6a53b9e940e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:04.608848 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6a789-b461-4fe3-aabb-6a53b9e940e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:04.609253 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6a789-b461-4fe3-aabb-6a53b9e940e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:04.609630 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6a789-b461-4fe3-aabb-6a53b9e940e3 admin admin] PATH_INFO: `/v3/users/7b7716818a7f4a7594463c7e5dd810be` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:04.610542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 943/1884] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:04.611397 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6a789-b461-4fe3-aabb-6a53b9e940e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b7716818a7f4a7594463c7e5dd810be)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:04.611589 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6297f4-d9a9-4c89-9dc6-1c33a2319722 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:04.613967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6a789-b461-4fe3-aabb-6a53b9e940e3 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:04.614959 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ef6297f4-d9a9-4c89-9dc6-1c33a2319722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:04.629595 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6297f4-d9a9-4c89-9dc6-1c33a2319722 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:04.635136 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fca65d-13f1-40bc-bd31-b6d22810bb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:04.635897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fca65d-13f1-40bc-bd31-b6d22810bb91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:04.636125 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fca65d-13f1-40bc-bd31-b6d22810bb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:04.636403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fca65d-13f1-40bc-bd31-b6d22810bb91 admin admin] PATH_INFO: `/v3/users/ea89efa00eee4623b875fb74721b77c8` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:04.637800 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fca65d-13f1-40bc-bd31-b6d22810bb91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea89efa00eee4623b875fb74721b77c8)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:04.641486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fca65d-13f1-40bc-bd31-b6d22810bb91 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:04.706971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f4c6a789-b461-4fe3-aabb-6a53b9e940e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b7716818a7f4a7594463c7e5dd810be'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:04.738201 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f4c6a789-b461-4fe3-aabb-6a53b9e940e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b7716818a7f4a7594463c7e5dd810be'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:04.738718 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b9fca65d-13f1-40bc-bd31-b6d22810bb91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea89efa00eee4623b875fb74721b77c8'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:04.744338 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b9fca65d-13f1-40bc-bd31-b6d22810bb91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea89efa00eee4623b875fb74721b77c8'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:04.748200 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f4c6a789-b461-4fe3-aabb-6a53b9e940e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b7716818a7f4a7594463c7e5dd810be'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:04.755858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b9fca65d-13f1-40bc-bd31-b6d22810bb91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea89efa00eee4623b875fb74721b77c8'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:04.756879 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f4c6a789-b461-4fe3-aabb-6a53b9e940e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b7716818a7f4a7594463c7e5dd810be'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:04.758919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f4c6a789-b461-4fe3-aabb-6a53b9e940e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b7716818a7f4a7594463c7e5dd810be'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:04.768261 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 942/1885] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:04 2022] DELETE /identity/v3/users/7b7716818a7f4a7594463c7e5dd810be => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:04.771812 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b9fca65d-13f1-40bc-bd31-b6d22810bb91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea89efa00eee4623b875fb74721b77c8'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:04.772213 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6a789-b461-4fe3-aabb-6a53b9e940e3 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:04.772516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b9fca65d-13f1-40bc-bd31-b6d22810bb91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea89efa00eee4623b875fb74721b77c8'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:04.774018 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f4c6a789-b461-4fe3-aabb-6a53b9e940e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:04.803384 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 944/1886] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:04 2022] DELETE /identity/v3/users/ea89efa00eee4623b875fb74721b77c8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:04.810172 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb210d61-0cb7-4993-a3f6-46442760daeb None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:04.810502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb210d61-0cb7-4993-a3f6-46442760daeb None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:04.810776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb210d61-0cb7-4993-a3f6-46442760daeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:04.839515 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-fb210d61-0cb7-4993-a3f6-46442760daeb None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:04.840762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fb210d61-0cb7-4993-a3f6-46442760daeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:04.874378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6a789-b461-4fe3-aabb-6a53b9e940e3 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:04.881562 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:04.925343 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 945/1887] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:56:04.933609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb210d61-0cb7-4993-a3f6-46442760daeb None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:04.935455 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fb210d61-0cb7-4993-a3f6-46442760daeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:04.967476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dd0e2-3ced-4e24-a097-f4e10f4d38ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:04.967476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dd0e2-3ced-4e24-a097-f4e10f4d38ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:04.967476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dd0e2-3ced-4e24-a097-f4e10f4d38ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:04.978565 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dd0e2-3ced-4e24-a097-f4e10f4d38ae admin admin] PATH_INFO: `/v3/projects/c681132c880248ab9425b1f6b679d3b4/users/41e44f8122184115aec61343e7e202bc/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:04.983616 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dd0e2-3ced-4e24-a097-f4e10f4d38ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c681132c880248ab9425b1f6b679d3b4, user_id=41e44f8122184115aec61343e7e202bc, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:04.990966 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dd0e2-3ced-4e24-a097-f4e10f4d38ae admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:05.005448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 943/1888] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:04 2022] PUT /identity/v3/projects/c681132c880248ab9425b1f6b679d3b4/users/41e44f8122184115aec61343e7e202bc/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:05.017144 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128e2be-a756-4caf-a70e-e36151ceec2a None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:05.020711 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128e2be-a756-4caf-a70e-e36151ceec2a None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:05.021196 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128e2be-a756-4caf-a70e-e36151ceec2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:05.033203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb210d61-0cb7-4993-a3f6-46442760daeb None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:05.054229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:05.065577 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-3128e2be-a756-4caf-a70e-e36151ceec2a None None] MFA Rules not processed for user `41e44f8122184115aec61343e7e202bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:05.071174 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-3128e2be-a756-4caf-a70e-e36151ceec2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:05.094821 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5054e-d2f8-4d5d-b7be-e3f8a34d88c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:05.095532 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5054e-d2f8-4d5d-b7be-e3f8a34d88c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:05.095796 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5054e-d2f8-4d5d-b7be-e3f8a34d88c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:05.096009 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5054e-d2f8-4d5d-b7be-e3f8a34d88c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:05.174623 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5054e-d2f8-4d5d-b7be-e3f8a34d88c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:05.176272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5054e-d2f8-4d5d-b7be-e3f8a34d88c4 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:05.179892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 944/1889] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:56:05.185499 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128e2be-a756-4caf-a70e-e36151ceec2a None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:05.187051 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-3128e2be-a756-4caf-a70e-e36151ceec2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:05.189431 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 946/1890] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:05.217541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5054e-d2f8-4d5d-b7be-e3f8a34d88c4 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:05.219740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f2d5054e-d2f8-4d5d-b7be-e3f8a34d88c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:05.248655 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5054e-d2f8-4d5d-b7be-e3f8a34d88c4 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:05.254290 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f66bf7-ef1f-4e1b-828a-81c1d53d05f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:05.254992 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f66bf7-ef1f-4e1b-828a-81c1d53d05f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:05.255275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f66bf7-ef1f-4e1b-828a-81c1d53d05f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:05.255576 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f66bf7-ef1f-4e1b-828a-81c1d53d05f1 admin admin] PATH_INFO: `/v3/projects/1e4c86e44a544c9cb22de2ed99002e23` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:05.256753 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f66bf7-ef1f-4e1b-828a-81c1d53d05f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e4c86e44a544c9cb22de2ed99002e23)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:05.258833 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f66bf7-ef1f-4e1b-828a-81c1d53d05f1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:05.277475 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128e2be-a756-4caf-a70e-e36151ceec2a None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:05.281601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfd6b6-a5f3-44a9-ab9a-730366fa0e2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:05.282421 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfd6b6-a5f3-44a9-ab9a-730366fa0e2f service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:05.282644 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfd6b6-a5f3-44a9-ab9a-730366fa0e2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:05.282958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfd6b6-a5f3-44a9-ab9a-730366fa0e2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:05.294514 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfd6b6-a5f3-44a9-ab9a-730366fa0e2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:05.296524 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfd6b6-a5f3-44a9-ab9a-730366fa0e2f service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:05.308511 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 945/1891] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:05.312060 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:05.325188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-89f66bf7-ef1f-4e1b-828a-81c1d53d05f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e4c86e44a544c9cb22de2ed99002e23', 'request_id': 'req-89f66bf7-ef1f-4e1b-828a-81c1d53d05f1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:05.333697 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-89f66bf7-ef1f-4e1b-828a-81c1d53d05f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e4c86e44a544c9cb22de2ed99002e23', 'request_id': 'req-89f66bf7-ef1f-4e1b-828a-81c1d53d05f1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:05.349600 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-89f66bf7-ef1f-4e1b-828a-81c1d53d05f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e4c86e44a544c9cb22de2ed99002e23', 'request_id': 'req-89f66bf7-ef1f-4e1b-828a-81c1d53d05f1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:05.361981 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-89f66bf7-ef1f-4e1b-828a-81c1d53d05f1 admin admin] The token cache is being invalidate because project 1e4c86e44a544c9cb22de2ed99002e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:05.362402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-89f66bf7-ef1f-4e1b-828a-81c1d53d05f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:05.363131 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-89f66bf7-ef1f-4e1b-828a-81c1d53d05f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:05.365004 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 947/1892] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:05 2022] DELETE /identity/v3/projects/1e4c86e44a544c9cb22de2ed99002e23 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:05.369948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeeed2-a1ee-42b4-a644-dd1531b19824 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:05.370461 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeeed2-a1ee-42b4-a644-dd1531b19824 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:05.370928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeeed2-a1ee-42b4-a644-dd1531b19824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:05.392444 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-34eeeed2-a1ee-42b4-a644-dd1531b19824 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:05.393701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-34eeeed2-a1ee-42b4-a644-dd1531b19824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:05.459919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 946/1893] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:05.468337 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4d99a-9f3b-4499-b945-df32100bd421 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:05.469405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4d99a-9f3b-4499-b945-df32100bd421 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:05.469405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4d99a-9f3b-4499-b945-df32100bd421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:05.493106 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-2ab4d99a-9f3b-4499-b945-df32100bd421 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:05.494767 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2ab4d99a-9f3b-4499-b945-df32100bd421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:05.509701 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 948/1894] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:05.510847 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eeeed2-a1ee-42b4-a644-dd1531b19824 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:05.521838 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eeeed2-a1ee-42b4-a644-dd1531b19824 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:05.538389 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebb6c5-9ad3-47d3-8fc9-b6031a2704a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:05.539794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebb6c5-9ad3-47d3-8fc9-b6031a2704a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:05.540270 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebb6c5-9ad3-47d3-8fc9-b6031a2704a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:05.540717 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebb6c5-9ad3-47d3-8fc9-b6031a2704a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:05.541704 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebb6c5-9ad3-47d3-8fc9-b6031a2704a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:05.542220 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebb6c5-9ad3-47d3-8fc9-b6031a2704a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:05.544094 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebb6c5-9ad3-47d3-8fc9-b6031a2704a4 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:05.562610 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 947/1895] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:56:05.567500 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4d99a-9f3b-4499-b945-df32100bd421 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:05.579385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4d99a-9f3b-4499-b945-df32100bd421 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:05.587580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecd30d-bcdf-47b0-9f27-f7ff1bb9cf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:05.588234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecd30d-bcdf-47b0-9f27-f7ff1bb9cf99 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:05.588712 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecd30d-bcdf-47b0-9f27-f7ff1bb9cf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:05.588996 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecd30d-bcdf-47b0-9f27-f7ff1bb9cf99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:05.589855 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecd30d-bcdf-47b0-9f27-f7ff1bb9cf99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:05.592569 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecd30d-bcdf-47b0-9f27-f7ff1bb9cf99 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:05.666719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 949/1896] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:05 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:05.671236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebb6c5-9ad3-47d3-8fc9-b6031a2704a4 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:05.696054 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebb6c5-9ad3-47d3-8fc9-b6031a2704a4 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:05.720451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecd30d-bcdf-47b0-9f27-f7ff1bb9cf99 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:05.722852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-43ecd30d-bcdf-47b0-9f27-f7ff1bb9cf99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:05.763144 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:05.825584 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314149b-c026-48c5-b7c8-518c32d42767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:05.826492 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314149b-c026-48c5-b7c8-518c32d42767 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:05.828726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314149b-c026-48c5-b7c8-518c32d42767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:05.829212 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314149b-c026-48c5-b7c8-518c32d42767 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:05.830014 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314149b-c026-48c5-b7c8-518c32d42767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:05.833243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314149b-c026-48c5-b7c8-518c32d42767 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:05.865388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 948/1897] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:05 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:56:05.866297 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314149b-c026-48c5-b7c8-518c32d42767 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:05.879602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecd30d-bcdf-47b0-9f27-f7ff1bb9cf99 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:05.884396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314149b-c026-48c5-b7c8-518c32d42767 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:05.893864 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020c497-9e69-44cc-a4a0-f5f5462ce723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:05.894609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020c497-9e69-44cc-a4a0-f5f5462ce723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:05.894911 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020c497-9e69-44cc-a4a0-f5f5462ce723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:05.895188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020c497-9e69-44cc-a4a0-f5f5462ce723 admin admin] PATH_INFO: `/v3/projects/cd13a157dd024765ac7bb25bc11378fe` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:05.896428 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020c497-9e69-44cc-a4a0-f5f5462ce723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd13a157dd024765ac7bb25bc11378fe)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:05.897622 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3049e-2d23-48dd-89ed-36a772824989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:05.898278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3049e-2d23-48dd-89ed-36a772824989 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:05.898505 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020c497-9e69-44cc-a4a0-f5f5462ce723 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:05.898591 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3049e-2d23-48dd-89ed-36a772824989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:05.898854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3049e-2d23-48dd-89ed-36a772824989 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:05.899784 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3049e-2d23-48dd-89ed-36a772824989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:05.901604 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3049e-2d23-48dd-89ed-36a772824989 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:05.922223 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 949/1898] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:05.923172 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3049e-2d23-48dd-89ed-36a772824989 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:05.938188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3049e-2d23-48dd-89ed-36a772824989 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:05.949518 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4de031-7c34-41d6-b6b0-53d32e84a4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:05.950186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4de031-7c34-41d6-b6b0-53d32e84a4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:05.950445 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4de031-7c34-41d6-b6b0-53d32e84a4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:05.950716 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4de031-7c34-41d6-b6b0-53d32e84a4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:05.951541 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4de031-7c34-41d6-b6b0-53d32e84a4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:05.953663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4de031-7c34-41d6-b6b0-53d32e84a4b3 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:05.975806 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 950/1899] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:05.977945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4de031-7c34-41d6-b6b0-53d32e84a4b3 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:05.996462 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9020c497-9e69-44cc-a4a0-f5f5462ce723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd13a157dd024765ac7bb25bc11378fe', 'request_id': 'req-9020c497-9e69-44cc-a4a0-f5f5462ce723'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:06.001749 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4de031-7c34-41d6-b6b0-53d32e84a4b3 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:06.005604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9020c497-9e69-44cc-a4a0-f5f5462ce723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd13a157dd024765ac7bb25bc11378fe', 'request_id': 'req-9020c497-9e69-44cc-a4a0-f5f5462ce723'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:06.016919 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9020c497-9e69-44cc-a4a0-f5f5462ce723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd13a157dd024765ac7bb25bc11378fe', 'request_id': 'req-9020c497-9e69-44cc-a4a0-f5f5462ce723'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:06.038729 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9020c497-9e69-44cc-a4a0-f5f5462ce723 admin admin] The token cache is being invalidate because project cd13a157dd024765ac7bb25bc11378fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:06.039391 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9020c497-9e69-44cc-a4a0-f5f5462ce723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:06.041250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9020c497-9e69-44cc-a4a0-f5f5462ce723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:06.043533 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 950/1900] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:05 2022] DELETE /identity/v3/projects/cd13a157dd024765ac7bb25bc11378fe => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:56:06.049207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fe4ee-46e7-4ed1-8026-398e1c3a6d93 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:06.050164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fe4ee-46e7-4ed1-8026-398e1c3a6d93 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:06.050624 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fe4ee-46e7-4ed1-8026-398e1c3a6d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:06.075022 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-014fe4ee-46e7-4ed1-8026-398e1c3a6d93 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:06.076278 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-014fe4ee-46e7-4ed1-8026-398e1c3a6d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:06.097391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1f234-064e-4ea9-b073-c9d7260dbe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:06.098424 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1f234-064e-4ea9-b073-c9d7260dbe9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:06.099066 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1f234-064e-4ea9-b073-c9d7260dbe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:06.099387 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1f234-064e-4ea9-b073-c9d7260dbe9f admin admin] PATH_INFO: `/v3/projects/23b36c26f27a47358ea05d99a3d3414f/users/1a455d54478649d7a5cb8550c01c1957/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:06.119021 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1f234-064e-4ea9-b073-c9d7260dbe9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b36c26f27a47358ea05d99a3d3414f, user_id=1a455d54478649d7a5cb8550c01c1957, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:06.121751 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1f234-064e-4ea9-b073-c9d7260dbe9f admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:06.124051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:06.180636 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 951/1901] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:05 2022] PUT /identity/v3/projects/23b36c26f27a47358ea05d99a3d3414f/users/1a455d54478649d7a5cb8550c01c1957/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:56:06.191180 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a290a10-486b-4c2b-a889-650793a8452e None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:06.191573 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a290a10-486b-4c2b-a889-650793a8452e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:06.191871 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a290a10-486b-4c2b-a889-650793a8452e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:06.205550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 951/1902] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:56:06.214599 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5397b-5dbc-434a-bae3-ba6abb29c109 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:06.215029 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5397b-5dbc-434a-bae3-ba6abb29c109 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:06.215450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5397b-5dbc-434a-bae3-ba6abb29c109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:06.243415 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-71b5397b-5dbc-434a-bae3-ba6abb29c109 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:06.245214 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-71b5397b-5dbc-434a-bae3-ba6abb29c109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:06.245380 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-1a290a10-486b-4c2b-a889-650793a8452e None None] MFA Rules not processed for user `1a455d54478649d7a5cb8550c01c1957`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:06.248019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1a290a10-486b-4c2b-a889-650793a8452e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:06.347170 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 952/1903] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:56:06.353904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 952/1904] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:06.355252 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5397b-5dbc-434a-bae3-ba6abb29c109 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:06.355611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a290a10-486b-4c2b-a889-650793a8452e None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:06.359629 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-71b5397b-5dbc-434a-bae3-ba6abb29c109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:06.368694 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:06.381680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a290a10-486b-4c2b-a889-650793a8452e None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:06.384622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5397b-5dbc-434a-bae3-ba6abb29c109 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:06.388523 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2acfdf-791f-436b-bff2-b6f62c07e135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:06.389343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2acfdf-791f-436b-bff2-b6f62c07e135 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:06.389982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2acfdf-791f-436b-bff2-b6f62c07e135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:06.390367 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2acfdf-791f-436b-bff2-b6f62c07e135 admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:06.391292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2acfdf-791f-436b-bff2-b6f62c07e135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:06.391987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2acfdf-791f-436b-bff2-b6f62c07e135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:06.393572 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2acfdf-791f-436b-bff2-b6f62c07e135 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:06.405806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf1223-a5a2-44ad-8a97-bdd1ae59aadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:06.407552 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf1223-a5a2-44ad-8a97-bdd1ae59aadb admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:06.408014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf1223-a5a2-44ad-8a97-bdd1ae59aadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:06.408423 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf1223-a5a2-44ad-8a97-bdd1ae59aadb admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:06.410124 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf1223-a5a2-44ad-8a97-bdd1ae59aadb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:06.410906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 953/1905] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:56:06.412488 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf1223-a5a2-44ad-8a97-bdd1ae59aadb admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:06.427376 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2acfdf-791f-436b-bff2-b6f62c07e135 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:06.455867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2acfdf-791f-436b-bff2-b6f62c07e135 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:06.468516 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5623242-c190-4720-9152-d233478ee286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:06.469656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5623242-c190-4720-9152-d233478ee286 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:06.472312 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5623242-c190-4720-9152-d233478ee286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:06.472831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5623242-c190-4720-9152-d233478ee286 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:06.477976 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5623242-c190-4720-9152-d233478ee286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:06.479835 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 953/1906] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:06 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:06.480724 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf1223-a5a2-44ad-8a97-bdd1ae59aadb admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:06.481149 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5623242-c190-4720-9152-d233478ee286 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:06.482805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-86cf1223-a5a2-44ad-8a97-bdd1ae59aadb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:06.532875 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 954/1907] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:06 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:06.535792 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5623242-c190-4720-9152-d233478ee286 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:06.592210 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf1223-a5a2-44ad-8a97-bdd1ae59aadb admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:06.678832 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:06.695409 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a8ba5-8180-4d17-bf09-a48b33eb0a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:06.696388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a8ba5-8180-4d17-bf09-a48b33eb0a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:06.697227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a8ba5-8180-4d17-bf09-a48b33eb0a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:06.697815 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a8ba5-8180-4d17-bf09-a48b33eb0a9a admin admin] PATH_INFO: `/v3/users/7c343523e8ed4136b11623e7e3a5f864` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:06.699991 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a8ba5-8180-4d17-bf09-a48b33eb0a9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c343523e8ed4136b11623e7e3a5f864)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:06.703713 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a8ba5-8180-4d17-bf09-a48b33eb0a9a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:06.711552 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5623242-c190-4720-9152-d233478ee286 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:06.720584 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005ea3e-2d6b-44e8-bc7a-f0f57a6570a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:06.720778 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005ea3e-2d6b-44e8-bc7a-f0f57a6570a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:06.722045 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005ea3e-2d6b-44e8-bc7a-f0f57a6570a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:06.722344 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005ea3e-2d6b-44e8-bc7a-f0f57a6570a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:06.723435 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005ea3e-2d6b-44e8-bc7a-f0f57a6570a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:06.727288 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005ea3e-2d6b-44e8-bc7a-f0f57a6570a0 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:06.762173 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 955/1908] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:06 2022] POST /identity/v3/users => generated 300 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:06.763261 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005ea3e-2d6b-44e8-bc7a-f0f57a6570a0 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:06.774720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-858a8ba5-8180-4d17-bf09-a48b33eb0a9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c343523e8ed4136b11623e7e3a5f864'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:06.775637 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-858a8ba5-8180-4d17-bf09-a48b33eb0a9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c343523e8ed4136b11623e7e3a5f864'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:06.777938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005ea3e-2d6b-44e8-bc7a-f0f57a6570a0 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:06.785324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae42bb-639d-41dd-8a16-ac273c74eb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:06.785696 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-858a8ba5-8180-4d17-bf09-a48b33eb0a9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c343523e8ed4136b11623e7e3a5f864'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:06.786345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae42bb-639d-41dd-8a16-ac273c74eb4b admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:06.789025 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae42bb-639d-41dd-8a16-ac273c74eb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:06.789025 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae42bb-639d-41dd-8a16-ac273c74eb4b admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:06.790300 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae42bb-639d-41dd-8a16-ac273c74eb4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:06.792823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae42bb-639d-41dd-8a16-ac273c74eb4b admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:06.808083 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-858a8ba5-8180-4d17-bf09-a48b33eb0a9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c343523e8ed4136b11623e7e3a5f864'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:06.809923 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-858a8ba5-8180-4d17-bf09-a48b33eb0a9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c343523e8ed4136b11623e7e3a5f864'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:06.822315 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 956/1909] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:06 2022] POST /identity/v3/users => generated 289 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:06.823642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae42bb-639d-41dd-8a16-ac273c74eb4b admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:06.826743 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-2eae42bb-639d-41dd-8a16-ac273c74eb4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:06.833514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 954/1910] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:06 2022] DELETE /identity/v3/users/7c343523e8ed4136b11623e7e3a5f864 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:06.834567 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a8ba5-8180-4d17-bf09-a48b33eb0a9a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:06.836101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-858a8ba5-8180-4d17-bf09-a48b33eb0a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:06.842390 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae42bb-639d-41dd-8a16-ac273c74eb4b admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:06.924304 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a8ba5-8180-4d17-bf09-a48b33eb0a9a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:06.930490 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016c955-057a-4b05-963e-b63da36db454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:06.931224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016c955-057a-4b05-963e-b63da36db454 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:06.931784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016c955-057a-4b05-963e-b63da36db454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:06.931913 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016c955-057a-4b05-963e-b63da36db454 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:06.932640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016c955-057a-4b05-963e-b63da36db454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:06.934397 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016c955-057a-4b05-963e-b63da36db454 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:06.944864 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7738dc-88f0-4ecf-8871-5ec90afda3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:06.946168 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7738dc-88f0-4ecf-8871-5ec90afda3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:06.946695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7738dc-88f0-4ecf-8871-5ec90afda3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:06.946972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7738dc-88f0-4ecf-8871-5ec90afda3ef admin admin] PATH_INFO: `/v3/users/80505191cb754782a2cd740fd24e215f` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:06.948721 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7738dc-88f0-4ecf-8871-5ec90afda3ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=80505191cb754782a2cd740fd24e215f)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:06.951153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7738dc-88f0-4ecf-8871-5ec90afda3ef admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:06.952356 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 955/1911] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:06.953458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016c955-057a-4b05-963e-b63da36db454 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:06.956049 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6016c955-057a-4b05-963e-b63da36db454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:07.000831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016c955-057a-4b05-963e-b63da36db454 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:07.008245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d130e-0e5d-43c6-80a8-995478c43eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:07.008881 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d130e-0e5d-43c6-80a8-995478c43eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:07.009215 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d130e-0e5d-43c6-80a8-995478c43eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:07.009570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d130e-0e5d-43c6-80a8-995478c43eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:07.012083 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d130e-0e5d-43c6-80a8-995478c43eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:07.021139 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d130e-0e5d-43c6-80a8-995478c43eb9 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:07.025420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-db7738dc-88f0-4ecf-8871-5ec90afda3ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80505191cb754782a2cd740fd24e215f'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:07.029235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=87,keystone:INSERT=7,keystone:DELETE=6 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:07.033806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 956/1912] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:07.036814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964b972-36c9-4d14-988c-18fde2efd7a3 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:07.037325 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964b972-36c9-4d14-988c-18fde2efd7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:07.037605 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964b972-36c9-4d14-988c-18fde2efd7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:07.048927 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-db7738dc-88f0-4ecf-8871-5ec90afda3ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80505191cb754782a2cd740fd24e215f'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:07.060925 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-db7738dc-88f0-4ecf-8871-5ec90afda3ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80505191cb754782a2cd740fd24e215f'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:07.062865 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7964b972-36c9-4d14-988c-18fde2efd7a3 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:07.064603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7964b972-36c9-4d14-988c-18fde2efd7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:07.075036 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 957/1913] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:07.076172 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964b972-36c9-4d14-988c-18fde2efd7a3 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:07.085802 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-db7738dc-88f0-4ecf-8871-5ec90afda3ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80505191cb754782a2cd740fd24e215f'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:07.087100 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-db7738dc-88f0-4ecf-8871-5ec90afda3ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80505191cb754782a2cd740fd24e215f'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:07.106239 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 957/1914] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:06 2022] DELETE /identity/v3/users/80505191cb754782a2cd740fd24e215f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:07.106764 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964b972-36c9-4d14-988c-18fde2efd7a3 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:07.107497 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7738dc-88f0-4ecf-8871-5ec90afda3ef admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:07.109849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-db7738dc-88f0-4ecf-8871-5ec90afda3ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:07.178318 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:07.193287 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e33aa4-fce7-4c0b-a13e-e62a119c903c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:07.194165 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e33aa4-fce7-4c0b-a13e-e62a119c903c admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:07.194453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e33aa4-fce7-4c0b-a13e-e62a119c903c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:07.194734 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e33aa4-fce7-4c0b-a13e-e62a119c903c admin admin] PATH_INFO: `/v3/projects/b72f06589b8746debb272376682a1247/users/2326ae3700f44bbc8a465a35449ed256/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:07.196956 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7738dc-88f0-4ecf-8871-5ec90afda3ef admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:07.202224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af934316-88e2-48e0-add4-5267f893b39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:07.202993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af934316-88e2-48e0-add4-5267f893b39f admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:07.203361 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af934316-88e2-48e0-add4-5267f893b39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:07.203830 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af934316-88e2-48e0-add4-5267f893b39f admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:07.204638 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af934316-88e2-48e0-add4-5267f893b39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:07.206828 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af934316-88e2-48e0-add4-5267f893b39f admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:07.217556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e33aa4-fce7-4c0b-a13e-e62a119c903c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72f06589b8746debb272376682a1247, user_id=2326ae3700f44bbc8a465a35449ed256, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:07.218144 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 958/1915] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:07.219326 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af934316-88e2-48e0-add4-5267f893b39f admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:07.220778 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e33aa4-fce7-4c0b-a13e-e62a119c903c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:07.220900 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-af934316-88e2-48e0-add4-5267f893b39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:07.242160 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 958/1916] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:07 2022] PUT /identity/v3/projects/b72f06589b8746debb272376682a1247/users/2326ae3700f44bbc8a465a35449ed256/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:07.243871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8e2ce-75db-4597-845a-d426395847cc None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:07.244168 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8e2ce-75db-4597-845a-d426395847cc None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:07.244442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8e2ce-75db-4597-845a-d426395847cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:07.265720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-eaf8e2ce-75db-4597-845a-d426395847cc None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:07.267240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-eaf8e2ce-75db-4597-845a-d426395847cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:07.291181 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af934316-88e2-48e0-add4-5267f893b39f admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:07.337009 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 959/1917] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:07.337009 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8e2ce-75db-4597-845a-d426395847cc None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:07.345888 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a0bdd-45ad-4b20-881c-b1414e04504d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:07.346885 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a0bdd-45ad-4b20-881c-b1414e04504d service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:07.347232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a0bdd-45ad-4b20-881c-b1414e04504d service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:07.347602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a0bdd-45ad-4b20-881c-b1414e04504d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:07.349680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6b9a0bdd-45ad-4b20-881c-b1414e04504d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:07.354356 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8e2ce-75db-4597-845a-d426395847cc None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:07.364926 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a0bdd-45ad-4b20-881c-b1414e04504d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:07.366422 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a0bdd-45ad-4b20-881c-b1414e04504d service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:07.369813 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f333b2-e204-4830-bc9f-c808e0032cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:07.370602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f333b2-e204-4830-bc9f-c808e0032cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:07.370915 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f333b2-e204-4830-bc9f-c808e0032cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:07.371237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f333b2-e204-4830-bc9f-c808e0032cdf admin admin] PATH_INFO: `/v3/projects/03df4d79d7e04b7f9c8a2ef97588b582/users/a73fc7895dd142a7a89da7cf83bb629e/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:07.386624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 959/1918] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:07.387344 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a0bdd-45ad-4b20-881c-b1414e04504d service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:07.388806 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6b9a0bdd-45ad-4b20-881c-b1414e04504d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:07.390556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f333b2-e204-4830-bc9f-c808e0032cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=03df4d79d7e04b7f9c8a2ef97588b582, user_id=a73fc7895dd142a7a89da7cf83bb629e, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:07.393380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f333b2-e204-4830-bc9f-c808e0032cdf admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:07.401803 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a0bdd-45ad-4b20-881c-b1414e04504d service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:07.407213 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf4f15-d8b2-4dce-a97a-0ef5ded6f66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:07.408081 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf4f15-d8b2-4dce-a97a-0ef5ded6f66d admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:07.408353 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf4f15-d8b2-4dce-a97a-0ef5ded6f66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:07.408632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf4f15-d8b2-4dce-a97a-0ef5ded6f66d admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:07.409475 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf4f15-d8b2-4dce-a97a-0ef5ded6f66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:07.419505 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 960/1919] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:07 2022] PUT /identity/v3/projects/03df4d79d7e04b7f9c8a2ef97588b582/users/a73fc7895dd142a7a89da7cf83bb629e/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:07.419982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf4f15-d8b2-4dce-a97a-0ef5ded6f66d admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:07.420059 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f333b2-e204-4830-bc9f-c808e0032cdf admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:07.431686 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 960/1920] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:07.433347 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2170de-6b51-4092-b74f-c86e3819110c None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:07.433695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2170de-6b51-4092-b74f-c86e3819110c None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:07.434034 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2170de-6b51-4092-b74f-c86e3819110c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:07.447169 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:07.478701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-5d2170de-6b51-4092-b74f-c86e3819110c None None] MFA Rules not processed for user `a73fc7895dd142a7a89da7cf83bb629e`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:07.480152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-5d2170de-6b51-4092-b74f-c86e3819110c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:07.502633 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f333b2-e204-4830-bc9f-c808e0032cdf admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:07.508309 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edd113-d7d6-4a2f-839d-a6db3237796b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:07.508973 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edd113-d7d6-4a2f-839d-a6db3237796b service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:07.509429 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edd113-d7d6-4a2f-839d-a6db3237796b service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:07.509708 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edd113-d7d6-4a2f-839d-a6db3237796b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:07.578192 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 961/1921] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:07.578192 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2170de-6b51-4092-b74f-c86e3819110c None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:07.612622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edd113-d7d6-4a2f-839d-a6db3237796b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:07.614390 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edd113-d7d6-4a2f-839d-a6db3237796b service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:07.636990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 961/1922] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:07.638197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edd113-d7d6-4a2f-839d-a6db3237796b service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:07.642970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:07.649834 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edd113-d7d6-4a2f-839d-a6db3237796b service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:07.660872 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beef1df-f3eb-4d0e-ac14-1c7deab88567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:07.662131 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beef1df-f3eb-4d0e-ac14-1c7deab88567 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:07.663481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beef1df-f3eb-4d0e-ac14-1c7deab88567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:07.664022 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beef1df-f3eb-4d0e-ac14-1c7deab88567 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:07.665392 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beef1df-f3eb-4d0e-ac14-1c7deab88567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:07.668072 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beef1df-f3eb-4d0e-ac14-1c7deab88567 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:07.696313 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2170de-6b51-4092-b74f-c86e3819110c None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:07.705364 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0907b-cec0-48a9-94e8-83c8bf8ec7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:07.706731 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0907b-cec0-48a9-94e8-83c8bf8ec7d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:07.707221 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0907b-cec0-48a9-94e8-83c8bf8ec7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:07.709198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0907b-cec0-48a9-94e8-83c8bf8ec7d5 admin admin] PATH_INFO: `/v3/projects/b72f06589b8746debb272376682a1247/users/2326ae3700f44bbc8a465a35449ed256/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:07.714297 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0907b-cec0-48a9-94e8-83c8bf8ec7d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72f06589b8746debb272376682a1247, user_id=2326ae3700f44bbc8a465a35449ed256, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:07.718945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0907b-cec0-48a9-94e8-83c8bf8ec7d5 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:07.743636 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 962/1923] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:07 2022] PUT /identity/v3/projects/b72f06589b8746debb272376682a1247/users/2326ae3700f44bbc8a465a35449ed256/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:07.748172 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 962/1924] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:07 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:07.751368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0907b-cec0-48a9-94e8-83c8bf8ec7d5 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:07.756599 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea519d-08f9-4653-97b1-70d99e0895a5 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:07.757387 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea519d-08f9-4653-97b1-70d99e0895a5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:07.758340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea519d-08f9-4653-97b1-70d99e0895a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:07.829030 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-74ea519d-08f9-4653-97b1-70d99e0895a5 None None] MFA Rules not processed for user `2326ae3700f44bbc8a465a35449ed256`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:07.830468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-74ea519d-08f9-4653-97b1-70d99e0895a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:07.924914 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 963/1925] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:07.925958 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea519d-08f9-4653-97b1-70d99e0895a5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:07.927812 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-74ea519d-08f9-4653-97b1-70d99e0895a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:07.949347 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0907b-cec0-48a9-94e8-83c8bf8ec7d5 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:08.036058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:08.054518 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea519d-08f9-4653-97b1-70d99e0895a5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:08.067422 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9d30f-f40c-4975-830e-6934e8ff9756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:08.068948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9d30f-f40c-4975-830e-6934e8ff9756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:08.069255 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9d30f-f40c-4975-830e-6934e8ff9756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:08.069531 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9d30f-f40c-4975-830e-6934e8ff9756 admin admin] PATH_INFO: `/v3/projects/3c380bc02a434e12b6f1b88ce29d8b4b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:08.071752 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9d30f-f40c-4975-830e-6934e8ff9756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c380bc02a434e12b6f1b88ce29d8b4b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:08.073729 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9d30f-f40c-4975-830e-6934e8ff9756 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:08.086591 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118ed5a-bb8b-49b3-9c0f-8f9a25921437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:08.087491 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118ed5a-bb8b-49b3-9c0f-8f9a25921437 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:08.087912 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118ed5a-bb8b-49b3-9c0f-8f9a25921437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:08.089106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118ed5a-bb8b-49b3-9c0f-8f9a25921437 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:08.089953 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118ed5a-bb8b-49b3-9c0f-8f9a25921437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:08.092880 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118ed5a-bb8b-49b3-9c0f-8f9a25921437 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:08.129255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 963/1926] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:07 2022] POST /identity/v3/users => generated 288 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:08.129255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118ed5a-bb8b-49b3-9c0f-8f9a25921437 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:08.131973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e118ed5a-bb8b-49b3-9c0f-8f9a25921437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:08.142554 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-43e9d30f-f40c-4975-830e-6934e8ff9756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c380bc02a434e12b6f1b88ce29d8b4b', 'request_id': 'req-43e9d30f-f40c-4975-830e-6934e8ff9756'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.155463 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-43e9d30f-f40c-4975-830e-6934e8ff9756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c380bc02a434e12b6f1b88ce29d8b4b', 'request_id': 'req-43e9d30f-f40c-4975-830e-6934e8ff9756'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.164017 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-43e9d30f-f40c-4975-830e-6934e8ff9756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c380bc02a434e12b6f1b88ce29d8b4b', 'request_id': 'req-43e9d30f-f40c-4975-830e-6934e8ff9756'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.174946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:08.194720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-43e9d30f-f40c-4975-830e-6934e8ff9756 admin admin] The token cache is being invalidate because project 3c380bc02a434e12b6f1b88ce29d8b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:08.195027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-43e9d30f-f40c-4975-830e-6934e8ff9756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.196850 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-43e9d30f-f40c-4975-830e-6934e8ff9756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.200089 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 964/1927] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:07 2022] DELETE /identity/v3/projects/3c380bc02a434e12b6f1b88ce29d8b4b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:08.204149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9d30f-f40c-4975-830e-6934e8ff9756 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:08.206578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-43e9d30f-f40c-4975-830e-6934e8ff9756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:08.224992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118ed5a-bb8b-49b3-9c0f-8f9a25921437 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:08.280621 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9d30f-f40c-4975-830e-6934e8ff9756 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:08.281916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af582ab9-d198-495c-abde-8eab825f16ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:08.282673 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af582ab9-d198-495c-abde-8eab825f16ba service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:08.283003 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af582ab9-d198-495c-abde-8eab825f16ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:08.283561 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af582ab9-d198-495c-abde-8eab825f16ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:08.285186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-af582ab9-d198-495c-abde-8eab825f16ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:08.285608 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df92f69-a13c-41d8-804b-bee891ee1cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:08.286308 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df92f69-a13c-41d8-804b-bee891ee1cba admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:08.286859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df92f69-a13c-41d8-804b-bee891ee1cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:08.293272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df92f69-a13c-41d8-804b-bee891ee1cba admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:08.294661 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df92f69-a13c-41d8-804b-bee891ee1cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:08.296837 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df92f69-a13c-41d8-804b-bee891ee1cba admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:08.312403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 965/1928] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:08.313309 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df92f69-a13c-41d8-804b-bee891ee1cba admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:08.315005 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2df92f69-a13c-41d8-804b-bee891ee1cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:08.328293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df92f69-a13c-41d8-804b-bee891ee1cba admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:08.334104 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1153e-8bcc-4206-bd73-613ff5cec655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:08.335272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1153e-8bcc-4206-bd73-613ff5cec655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:08.335861 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1153e-8bcc-4206-bd73-613ff5cec655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:08.336162 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1153e-8bcc-4206-bd73-613ff5cec655 admin admin] PATH_INFO: `/v3/projects/cc19452614ec4cca89122f64fe479b2f` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:08.337502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1153e-8bcc-4206-bd73-613ff5cec655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc19452614ec4cca89122f64fe479b2f)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:08.339434 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1153e-8bcc-4206-bd73-613ff5cec655 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:08.369195 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af582ab9-d198-495c-abde-8eab825f16ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:08.371056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af582ab9-d198-495c-abde-8eab825f16ba service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:08.383123 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 964/1929] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:08.384031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af582ab9-d198-495c-abde-8eab825f16ba service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:08.385464 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-af582ab9-d198-495c-abde-8eab825f16ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:08.391988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-daa1153e-8bcc-4206-bd73-613ff5cec655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc19452614ec4cca89122f64fe479b2f', 'request_id': 'req-daa1153e-8bcc-4206-bd73-613ff5cec655'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.401149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-daa1153e-8bcc-4206-bd73-613ff5cec655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc19452614ec4cca89122f64fe479b2f', 'request_id': 'req-daa1153e-8bcc-4206-bd73-613ff5cec655'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.406294 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af582ab9-d198-495c-abde-8eab825f16ba service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:08.420657 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-daa1153e-8bcc-4206-bd73-613ff5cec655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc19452614ec4cca89122f64fe479b2f', 'request_id': 'req-daa1153e-8bcc-4206-bd73-613ff5cec655'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.434000 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-daa1153e-8bcc-4206-bd73-613ff5cec655 admin admin] The token cache is being invalidate because project cc19452614ec4cca89122f64fe479b2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:08.434363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-daa1153e-8bcc-4206-bd73-613ff5cec655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.435103 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-daa1153e-8bcc-4206-bd73-613ff5cec655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.437450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 966/1930] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:08 2022] DELETE /identity/v3/projects/cc19452614ec4cca89122f64fe479b2f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:08.438467 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1153e-8bcc-4206-bd73-613ff5cec655 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:08.440309 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-daa1153e-8bcc-4206-bd73-613ff5cec655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:08.450898 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:08.487684 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75f7ec-f50e-4bf9-8f34-bf694e34c934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:08.488446 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75f7ec-f50e-4bf9-8f34-bf694e34c934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:08.488831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75f7ec-f50e-4bf9-8f34-bf694e34c934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:08.489396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75f7ec-f50e-4bf9-8f34-bf694e34c934 admin admin] PATH_INFO: `/v3/users/6c509405450b4ada8e05524a163e8f69` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:08.490717 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75f7ec-f50e-4bf9-8f34-bf694e34c934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c509405450b4ada8e05524a163e8f69)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:08.492994 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75f7ec-f50e-4bf9-8f34-bf694e34c934 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:08.519675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1153e-8bcc-4206-bd73-613ff5cec655 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:08.525044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f908b-4e45-4eee-933f-69c1f96c1de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:08.525782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f908b-4e45-4eee-933f-69c1f96c1de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:08.526158 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f908b-4e45-4eee-933f-69c1f96c1de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:08.526638 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f908b-4e45-4eee-933f-69c1f96c1de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:08.527865 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f908b-4e45-4eee-933f-69c1f96c1de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:08.530701 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f908b-4e45-4eee-933f-69c1f96c1de7 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:08.545118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 967/1931] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:08.545118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f908b-4e45-4eee-933f-69c1f96c1de7 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:08.545118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-027f908b-4e45-4eee-933f-69c1f96c1de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:08.548341 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-9b75f7ec-f50e-4bf9-8f34-bf694e34c934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c509405450b4ada8e05524a163e8f69'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.557684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f908b-4e45-4eee-933f-69c1f96c1de7 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:08.560732 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-9b75f7ec-f50e-4bf9-8f34-bf694e34c934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c509405450b4ada8e05524a163e8f69'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.562292 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ae7bd-a79b-4cac-a0c9-faec4edd0daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:08.562934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ae7bd-a79b-4cac-a0c9-faec4edd0daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:08.563232 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ae7bd-a79b-4cac-a0c9-faec4edd0daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:08.563505 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ae7bd-a79b-4cac-a0c9-faec4edd0daf admin admin] PATH_INFO: `/v3/users/41e44f8122184115aec61343e7e202bc` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:08.564673 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ae7bd-a79b-4cac-a0c9-faec4edd0daf admin admin] RBAC: Authorizing `identity:delete_user(user_id=41e44f8122184115aec61343e7e202bc)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:08.566731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ae7bd-a79b-4cac-a0c9-faec4edd0daf admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:08.569674 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-9b75f7ec-f50e-4bf9-8f34-bf694e34c934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c509405450b4ada8e05524a163e8f69'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.571926 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:08.577907 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-9b75f7ec-f50e-4bf9-8f34-bf694e34c934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c509405450b4ada8e05524a163e8f69'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.578672 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-9b75f7ec-f50e-4bf9-8f34-bf694e34c934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c509405450b4ada8e05524a163e8f69'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.594035 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 965/1932] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:08 2022] DELETE /identity/v3/users/6c509405450b4ada8e05524a163e8f69 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:08.597094 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75f7ec-f50e-4bf9-8f34-bf694e34c934 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:08.597094 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9b75f7ec-f50e-4bf9-8f34-bf694e34c934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:08.644389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7f9ae7bd-a79b-4cac-a0c9-faec4edd0daf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41e44f8122184115aec61343e7e202bc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.645107 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7f9ae7bd-a79b-4cac-a0c9-faec4edd0daf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41e44f8122184115aec61343e7e202bc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.653367 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7f9ae7bd-a79b-4cac-a0c9-faec4edd0daf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41e44f8122184115aec61343e7e202bc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.672872 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7f9ae7bd-a79b-4cac-a0c9-faec4edd0daf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41e44f8122184115aec61343e7e202bc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.674014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7f9ae7bd-a79b-4cac-a0c9-faec4edd0daf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41e44f8122184115aec61343e7e202bc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.689700 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 968/1933] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:08 2022] DELETE /identity/v3/users/41e44f8122184115aec61343e7e202bc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:08.690766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ae7bd-a79b-4cac-a0c9-faec4edd0daf admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:08.691227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75f7ec-f50e-4bf9-8f34-bf694e34c934 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:08.693109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7f9ae7bd-a79b-4cac-a0c9-faec4edd0daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:08.793197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:08.800843 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ae7bd-a79b-4cac-a0c9-faec4edd0daf admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:08.804497 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61343d41-f6d4-4851-b4f1-cc6695ece827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:08.805898 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61343d41-f6d4-4851-b4f1-cc6695ece827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:08.806416 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61343d41-f6d4-4851-b4f1-cc6695ece827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:08.808210 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61343d41-f6d4-4851-b4f1-cc6695ece827 admin admin] PATH_INFO: `/v3/users/1a455d54478649d7a5cb8550c01c1957` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:08.810304 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3e3e1-d6f0-4d3e-9162-2c27ac5059a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:08.812084 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3e3e1-d6f0-4d3e-9162-2c27ac5059a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:08.812367 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3e3e1-d6f0-4d3e-9162-2c27ac5059a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:08.812493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61343d41-f6d4-4851-b4f1-cc6695ece827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a455d54478649d7a5cb8550c01c1957)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:08.813441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3e3e1-d6f0-4d3e-9162-2c27ac5059a3 admin admin] PATH_INFO: `/v3/projects/00bf08c0dd204306a959bade34345cb8/users/0e388e9879b54662a2d153811db6f2fc/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:08.814729 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61343d41-f6d4-4851-b4f1-cc6695ece827 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:08.838395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3e3e1-d6f0-4d3e-9162-2c27ac5059a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00bf08c0dd204306a959bade34345cb8, user_id=0e388e9879b54662a2d153811db6f2fc, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:08.843540 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3e3e1-d6f0-4d3e-9162-2c27ac5059a3 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:08.867064 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 969/1934] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:08 2022] PUT /identity/v3/projects/00bf08c0dd204306a959bade34345cb8/users/0e388e9879b54662a2d153811db6f2fc/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:08.867064 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3e3e1-d6f0-4d3e-9162-2c27ac5059a3 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:08.871108 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f2f3e3e1-d6f0-4d3e-9162-2c27ac5059a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:08.884102 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-61343d41-f6d4-4851-b4f1-cc6695ece827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a455d54478649d7a5cb8550c01c1957'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.901609 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-61343d41-f6d4-4851-b4f1-cc6695ece827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a455d54478649d7a5cb8550c01c1957'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.911966 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-61343d41-f6d4-4851-b4f1-cc6695ece827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a455d54478649d7a5cb8550c01c1957'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.920549 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-61343d41-f6d4-4851-b4f1-cc6695ece827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a455d54478649d7a5cb8550c01c1957'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.921705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-61343d41-f6d4-4851-b4f1-cc6695ece827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a455d54478649d7a5cb8550c01c1957'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:08.933618 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 966/1935] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:08 2022] DELETE /identity/v3/users/1a455d54478649d7a5cb8550c01c1957 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:08.937270 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89418b-b2c1-466c-a36f-a08d887eec5e None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:08.937670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89418b-b2c1-466c-a36f-a08d887eec5e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:08.938042 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89418b-b2c1-466c-a36f-a08d887eec5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:08.975499 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-7d89418b-b2c1-466c-a36f-a08d887eec5e None None] MFA Rules not processed for user `0e388e9879b54662a2d153811db6f2fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:08.977306 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3e3e1-d6f0-4d3e-9162-2c27ac5059a3 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:08.979882 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-7d89418b-b2c1-466c-a36f-a08d887eec5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:08.996300 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:09.086198 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d5014-67d7-443e-a591-934667ca400c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:09.087382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d5014-67d7-443e-a591-934667ca400c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:09.087764 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d5014-67d7-443e-a591-934667ca400c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:09.088209 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d5014-67d7-443e-a591-934667ca400c admin admin] PATH_INFO: `/v3/users/1571c7da86e34069906fa47053732a9a` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:09.090196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d5014-67d7-443e-a591-934667ca400c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1571c7da86e34069906fa47053732a9a)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:09.097005 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d5014-67d7-443e-a591-934667ca400c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:09.125640 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 967/1936] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:09.130109 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955e7d7-9da6-47a9-b075-4c66d2eaa328 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:09.130109 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955e7d7-9da6-47a9-b075-4c66d2eaa328 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:09.130109 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955e7d7-9da6-47a9-b075-4c66d2eaa328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:09.153261 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-2955e7d7-9da6-47a9-b075-4c66d2eaa328 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:09.154595 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-2955e7d7-9da6-47a9-b075-4c66d2eaa328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:09.168476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 968/1937] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:09.168476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955e7d7-9da6-47a9-b075-4c66d2eaa328 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:09.168476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-2955e7d7-9da6-47a9-b075-4c66d2eaa328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:09.184913 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5d0d5014-67d7-443e-a591-934667ca400c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1571c7da86e34069906fa47053732a9a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:09.185789 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5d0d5014-67d7-443e-a591-934667ca400c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1571c7da86e34069906fa47053732a9a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:09.194375 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955e7d7-9da6-47a9-b075-4c66d2eaa328 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:09.198051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5d0d5014-67d7-443e-a591-934667ca400c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1571c7da86e34069906fa47053732a9a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:09.200975 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547aa70-543c-4ab5-8ff4-c8058244813e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:09.201868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547aa70-543c-4ab5-8ff4-c8058244813e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:09.202608 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547aa70-543c-4ab5-8ff4-c8058244813e admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:09.203023 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547aa70-543c-4ab5-8ff4-c8058244813e admin admin] PATH_INFO: `/v3/projects/1e31891c2f5d435c9562ff00e6432685` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:09.204494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547aa70-543c-4ab5-8ff4-c8058244813e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e31891c2f5d435c9562ff00e6432685)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:09.206684 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547aa70-543c-4ab5-8ff4-c8058244813e admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:09.219637 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5d0d5014-67d7-443e-a591-934667ca400c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1571c7da86e34069906fa47053732a9a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:09.221202 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5d0d5014-67d7-443e-a591-934667ca400c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1571c7da86e34069906fa47053732a9a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:09.249981 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 970/1938] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:08 2022] DELETE /identity/v3/users/1571c7da86e34069906fa47053732a9a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:09.251461 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d5014-67d7-443e-a591-934667ca400c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:09.253718 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5d0d5014-67d7-443e-a591-934667ca400c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:09.287412 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e547aa70-543c-4ab5-8ff4-c8058244813e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e31891c2f5d435c9562ff00e6432685', 'request_id': 'req-e547aa70-543c-4ab5-8ff4-c8058244813e'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:09.292473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:09.303005 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e547aa70-543c-4ab5-8ff4-c8058244813e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e31891c2f5d435c9562ff00e6432685', 'request_id': 'req-e547aa70-543c-4ab5-8ff4-c8058244813e'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:09.315429 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e547aa70-543c-4ab5-8ff4-c8058244813e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e31891c2f5d435c9562ff00e6432685', 'request_id': 'req-e547aa70-543c-4ab5-8ff4-c8058244813e'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:09.339805 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e547aa70-543c-4ab5-8ff4-c8058244813e admin admin] The token cache is being invalidate because project 1e31891c2f5d435c9562ff00e6432685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:09.340262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e547aa70-543c-4ab5-8ff4-c8058244813e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:09.345544 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e547aa70-543c-4ab5-8ff4-c8058244813e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:09.349490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 969/1939] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:09 2022] DELETE /identity/v3/projects/1e31891c2f5d435c9562ff00e6432685 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:09.350698 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547aa70-543c-4ab5-8ff4-c8058244813e admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:09.354359 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e547aa70-543c-4ab5-8ff4-c8058244813e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:09.356635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d5014-67d7-443e-a591-934667ca400c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:09.416090 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:09.447107 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63bf63-dfba-4076-a48f-0a55711afd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:09.447903 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63bf63-dfba-4076-a48f-0a55711afd1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:09.448285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63bf63-dfba-4076-a48f-0a55711afd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:09.449161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63bf63-dfba-4076-a48f-0a55711afd1a admin admin] PATH_INFO: `/v3/projects/c681132c880248ab9425b1f6b679d3b4` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:09.450666 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63bf63-dfba-4076-a48f-0a55711afd1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c681132c880248ab9425b1f6b679d3b4)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:09.454185 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63bf63-dfba-4076-a48f-0a55711afd1a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:09.456632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547aa70-543c-4ab5-8ff4-c8058244813e admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:09.466670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e0c79-085a-47a0-9031-d28956ca7715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:09.467351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e0c79-085a-47a0-9031-d28956ca7715 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:09.467619 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e0c79-085a-47a0-9031-d28956ca7715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:09.468312 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e0c79-085a-47a0-9031-d28956ca7715 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:09.468573 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e0c79-085a-47a0-9031-d28956ca7715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:09.470927 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e0c79-085a-47a0-9031-d28956ca7715 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:09.539853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-2c63bf63-dfba-4076-a48f-0a55711afd1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c681132c880248ab9425b1f6b679d3b4', 'request_id': 'req-2c63bf63-dfba-4076-a48f-0a55711afd1a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:09.543198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 970/1940] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:09 2022] POST /identity/v3/projects => generated 375 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:09.544164 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e0c79-085a-47a0-9031-d28956ca7715 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:09.545836 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-bc3e0c79-085a-47a0-9031-d28956ca7715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:09.550898 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-2c63bf63-dfba-4076-a48f-0a55711afd1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c681132c880248ab9425b1f6b679d3b4', 'request_id': 'req-2c63bf63-dfba-4076-a48f-0a55711afd1a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:09.564487 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-2c63bf63-dfba-4076-a48f-0a55711afd1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c681132c880248ab9425b1f6b679d3b4', 'request_id': 'req-2c63bf63-dfba-4076-a48f-0a55711afd1a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:09.582780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-2c63bf63-dfba-4076-a48f-0a55711afd1a admin admin] The token cache is being invalidate because project c681132c880248ab9425b1f6b679d3b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:09.583075 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-2c63bf63-dfba-4076-a48f-0a55711afd1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:09.583989 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-2c63bf63-dfba-4076-a48f-0a55711afd1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:09.586197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 971/1941] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:09 2022] DELETE /identity/v3/projects/c681132c880248ab9425b1f6b679d3b4 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:09.589855 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b82601-1fd0-46bc-b5a7-9907ec6f48ac None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:09.589855 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b82601-1fd0-46bc-b5a7-9907ec6f48ac None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:09.589855 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b82601-1fd0-46bc-b5a7-9907ec6f48ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:09.620832 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-35b82601-1fd0-46bc-b5a7-9907ec6f48ac None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:09.623743 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-35b82601-1fd0-46bc-b5a7-9907ec6f48ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:09.639324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e0c79-085a-47a0-9031-d28956ca7715 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:09.648711 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697b460-5dae-4555-b51b-d5142f90cf56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:09.649775 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697b460-5dae-4555-b51b-d5142f90cf56 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:09.650065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697b460-5dae-4555-b51b-d5142f90cf56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:09.650347 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697b460-5dae-4555-b51b-d5142f90cf56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:09.652460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-5697b460-5dae-4555-b51b-d5142f90cf56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:09.710148 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 972/1942] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:09.712188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7c04d-2e03-4704-a105-dc9bb1ac5d83 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:09.712659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7c04d-2e03-4704-a105-dc9bb1ac5d83 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:09.713262 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7c04d-2e03-4704-a105-dc9bb1ac5d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:09.739986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-8fb7c04d-2e03-4704-a105-dc9bb1ac5d83 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:09.741633 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8fb7c04d-2e03-4704-a105-dc9bb1ac5d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:09.756652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 973/1943] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:09.757673 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697b460-5dae-4555-b51b-d5142f90cf56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:09.758484 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f608ae-0b59-45a4-9fa2-74e25e10051b None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:09.758869 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f608ae-0b59-45a4-9fa2-74e25e10051b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:09.759197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f608ae-0b59-45a4-9fa2-74e25e10051b None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:09.760151 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697b460-5dae-4555-b51b-d5142f90cf56 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:09.760963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 974/1944] 10.222.0.96 () {54 vars in 921 bytes} [Thu Jul 28 17:56:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:09.761756 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f608ae-0b59-45a4-9fa2-74e25e10051b None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:09.763549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-47f608ae-0b59-45a4-9fa2-74e25e10051b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:09.771373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 971/1945] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:09.772560 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295fcec-f4c6-4b45-8d47-591655e91f3b None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:09.772836 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295fcec-f4c6-4b45-8d47-591655e91f3b None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:09.773160 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295fcec-f4c6-4b45-8d47-591655e91f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:09.781274 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f608ae-0b59-45a4-9fa2-74e25e10051b None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:09.787907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06e94e-8261-4746-87a1-1795585082fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:09.788763 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06e94e-8261-4746-87a1-1795585082fd admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:09.789176 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06e94e-8261-4746-87a1-1795585082fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:09.789461 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06e94e-8261-4746-87a1-1795585082fd admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:09.790290 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06e94e-8261-4746-87a1-1795585082fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:09.793979 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06e94e-8261-4746-87a1-1795585082fd admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:09.798450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-2295fcec-f4c6-4b45-8d47-591655e91f3b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:09.799902 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-2295fcec-f4c6-4b45-8d47-591655e91f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:09.810920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 972/1946] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:09.812064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295fcec-f4c6-4b45-8d47-591655e91f3b None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:09.818810 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-2295fcec-f4c6-4b45-8d47-591655e91f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:09.829567 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 975/1947] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:09 2022] POST /identity/v3/users => generated 294 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:09.831036 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698395a-4266-4906-b2ec-22c24afebcef None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:09.831323 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698395a-4266-4906-b2ec-22c24afebcef None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:09.832026 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698395a-4266-4906-b2ec-22c24afebcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:09.843760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295fcec-f4c6-4b45-8d47-591655e91f3b None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:09.850571 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d2b08-d27d-4e09-9759-a6ca633d0d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:09.851703 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d2b08-d27d-4e09-9759-a6ca633d0d51 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:09.851703 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d2b08-d27d-4e09-9759-a6ca633d0d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:09.851971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d2b08-d27d-4e09-9759-a6ca633d0d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:09.860854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-3698395a-4266-4906-b2ec-22c24afebcef None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:09.862130 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3698395a-4266-4906-b2ec-22c24afebcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:09.864241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d2b08-d27d-4e09-9759-a6ca633d0d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:09.865800 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d2b08-d27d-4e09-9759-a6ca633d0d51 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:09.870618 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:09.880147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 973/1948] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:09.881140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47803d9-bffb-4128-abaf-e6d9ebd56d96 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:09.881349 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 976/1949] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:09.881943 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47803d9-bffb-4128-abaf-e6d9ebd56d96 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:09.882235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47803d9-bffb-4128-abaf-e6d9ebd56d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:09.885542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1b2a0-6dd5-447f-940a-9b6c93b47571 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:09.887959 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1b2a0-6dd5-447f-940a-9b6c93b47571 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:09.888293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1b2a0-6dd5-447f-940a-9b6c93b47571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:09.910957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-e47803d9-bffb-4128-abaf-e6d9ebd56d96 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:09.914449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e47803d9-bffb-4128-abaf-e6d9ebd56d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:09.929429 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-dfa1b2a0-6dd5-447f-940a-9b6c93b47571 None None] MFA Rules not processed for user `5ac367247aa54671ae5c33d251017470`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:09.933208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 974/1950] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:09.933208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47803d9-bffb-4128-abaf-e6d9ebd56d96 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:09.935660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-dfa1b2a0-6dd5-447f-940a-9b6c93b47571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:09.946968 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47803d9-bffb-4128-abaf-e6d9ebd56d96 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:09.956526 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e43e2d-4bd2-421f-b871-6456142c3730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:09.956526 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e43e2d-4bd2-421f-b871-6456142c3730 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:09.956526 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e43e2d-4bd2-421f-b871-6456142c3730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:09.956526 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e43e2d-4bd2-421f-b871-6456142c3730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:09.957113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e43e2d-4bd2-421f-b871-6456142c3730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:09.958905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e43e2d-4bd2-421f-b871-6456142c3730 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:09.977015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 975/1951] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:09.978289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e43e2d-4bd2-421f-b871-6456142c3730 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:09.997716 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e43e2d-4bd2-421f-b871-6456142c3730 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:10.004989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d4d7d-02dc-4b43-8629-a17d839f9324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:10.005935 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d4d7d-02dc-4b43-8629-a17d839f9324 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:10.006234 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d4d7d-02dc-4b43-8629-a17d839f9324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:10.006553 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d4d7d-02dc-4b43-8629-a17d839f9324 admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:10.007386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d4d7d-02dc-4b43-8629-a17d839f9324 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:10.008269 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d4d7d-02dc-4b43-8629-a17d839f9324 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:10.010615 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d4d7d-02dc-4b43-8629-a17d839f9324 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:10.025644 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:10.045575 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 976/1952] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:56:10.046727 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d4d7d-02dc-4b43-8629-a17d839f9324 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:10.058157 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d4d7d-02dc-4b43-8629-a17d839f9324 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:10.065683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a278-1a11-45b9-b2d8-bb129068a00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:10.066361 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a278-1a11-45b9-b2d8-bb129068a00b admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:10.066648 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a278-1a11-45b9-b2d8-bb129068a00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:10.066918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a278-1a11-45b9-b2d8-bb129068a00b admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:10.067866 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8a278-1a11-45b9-b2d8-bb129068a00b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:10.068045 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8a278-1a11-45b9-b2d8-bb129068a00b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:10.069866 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8a278-1a11-45b9-b2d8-bb129068a00b admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:10.090221 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 977/1953] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:56:10.091165 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a278-1a11-45b9-b2d8-bb129068a00b admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:10.099254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 977/1954] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Jul 28 17:56:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:10.100132 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1b2a0-6dd5-447f-940a-9b6c93b47571 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:10.104438 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a278-1a11-45b9-b2d8-bb129068a00b admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:10.112284 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd59f8f-a1b5-456e-a895-67ccc0d91212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:10.113380 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd59f8f-a1b5-456e-a895-67ccc0d91212 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:10.113913 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd59f8f-a1b5-456e-a895-67ccc0d91212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:10.114335 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd59f8f-a1b5-456e-a895-67ccc0d91212 admin admin] PATH_INFO: `/v3/projects/a760136358014ab1a16a115b5ddd6b52/users/9a43c54016ef48a6b36fe0de42ab131e/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:10.147485 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1b2a0-6dd5-447f-940a-9b6c93b47571 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:10.159964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2dc04-5abb-4901-bf60-af93073a6d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:10.160890 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2dc04-5abb-4901-bf60-af93073a6d83 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:10.161239 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2dc04-5abb-4901-bf60-af93073a6d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:10.161517 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2dc04-5abb-4901-bf60-af93073a6d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:10.162215 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd59f8f-a1b5-456e-a895-67ccc0d91212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a760136358014ab1a16a115b5ddd6b52, user_id=9a43c54016ef48a6b36fe0de42ab131e, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:10.162382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2dc04-5abb-4901-bf60-af93073a6d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:10.164756 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2dc04-5abb-4901-bf60-af93073a6d83 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:10.165890 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd59f8f-a1b5-456e-a895-67ccc0d91212 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:10.192906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 978/1955] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:10 2022] PUT /identity/v3/projects/a760136358014ab1a16a115b5ddd6b52/users/9a43c54016ef48a6b36fe0de42ab131e/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:10.194324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd59f8f-a1b5-456e-a895-67ccc0d91212 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:10.217526 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 978/1956] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:10 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:10.217526 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2dc04-5abb-4901-bf60-af93073a6d83 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:10.217830 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-24a2dc04-5abb-4901-bf60-af93073a6d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:10.285011 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd59f8f-a1b5-456e-a895-67ccc0d91212 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:10.346843 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2dc04-5abb-4901-bf60-af93073a6d83 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:10.366386 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa956ffe-8d3d-4620-99a1-8d0e1f26a01f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:10.367369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa956ffe-8d3d-4620-99a1-8d0e1f26a01f service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:10.367766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa956ffe-8d3d-4620-99a1-8d0e1f26a01f service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:10.368119 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa956ffe-8d3d-4620-99a1-8d0e1f26a01f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:10.379182 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa956ffe-8d3d-4620-99a1-8d0e1f26a01f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:10.381111 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa956ffe-8d3d-4620-99a1-8d0e1f26a01f service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:10.398154 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 979/1957] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:10.409834 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bc992-c676-475b-909f-ad7b270ec6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:10.411102 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bc992-c676-475b-909f-ad7b270ec6ac admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:10.411685 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa956ffe-8d3d-4620-99a1-8d0e1f26a01f service nova] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:10.412585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bc992-c676-475b-909f-ad7b270ec6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:10.413089 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bc992-c676-475b-909f-ad7b270ec6ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:10.414197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bc992-c676-475b-909f-ad7b270ec6ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:10.417645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bc992-c676-475b-909f-ad7b270ec6ac admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:10.427005 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa956ffe-8d3d-4620-99a1-8d0e1f26a01f service nova] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:10.435041 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de34138-a0e4-4690-b07b-dfb899883008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:10.435687 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de34138-a0e4-4690-b07b-dfb899883008 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:10.435972 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de34138-a0e4-4690-b07b-dfb899883008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:10.436255 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de34138-a0e4-4690-b07b-dfb899883008 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:10.436985 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de34138-a0e4-4690-b07b-dfb899883008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:10.441045 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de34138-a0e4-4690-b07b-dfb899883008 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:10.453793 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 980/1958] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:10.457502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de34138-a0e4-4690-b07b-dfb899883008 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:10.468239 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 979/1959] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:10 2022] POST /identity/v3/projects => generated 383 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:10.469941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bc992-c676-475b-909f-ad7b270ec6ac admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:10.475146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-eb8bc992-c676-475b-909f-ad7b270ec6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:10.475613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de34138-a0e4-4690-b07b-dfb899883008 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:10.516158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:10.614097 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bc992-c676-475b-909f-ad7b270ec6ac admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:10.626670 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05d738-46a5-4500-a662-ea4b4ad35f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:10.627608 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05d738-46a5-4500-a662-ea4b4ad35f6e admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:10.628191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05d738-46a5-4500-a662-ea4b4ad35f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:10.628594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05d738-46a5-4500-a662-ea4b4ad35f6e admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:10.629526 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05d738-46a5-4500-a662-ea4b4ad35f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:10.631730 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05d738-46a5-4500-a662-ea4b4ad35f6e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:10.647056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd1a55-266c-495f-b914-48cf9e2ce868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:10.648559 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd1a55-266c-495f-b914-48cf9e2ce868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:10.649733 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd1a55-266c-495f-b914-48cf9e2ce868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:10.650942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd1a55-266c-495f-b914-48cf9e2ce868 admin admin] PATH_INFO: `/v3/projects/0d00ed6cad3b4e3c9003e96b83a50962` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:10.652733 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd1a55-266c-495f-b914-48cf9e2ce868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d00ed6cad3b4e3c9003e96b83a50962)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:10.655434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd1a55-266c-495f-b914-48cf9e2ce868 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:10.666507 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 981/1960] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:10 2022] POST /identity/v3/users => generated 291 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:10.671822 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05d738-46a5-4500-a662-ea4b4ad35f6e admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:10.691112 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05d738-46a5-4500-a662-ea4b4ad35f6e admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:10.696467 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b72058-55f1-43f7-b60c-c26c9c85364e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:10.698392 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b72058-55f1-43f7-b60c-c26c9c85364e admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:10.698694 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b72058-55f1-43f7-b60c-c26c9c85364e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:10.705833 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b72058-55f1-43f7-b60c-c26c9c85364e admin admin] PATH_INFO: `/v3/projects/a760136358014ab1a16a115b5ddd6b52/users/9a43c54016ef48a6b36fe0de42ab131e/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:10.715469 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b72058-55f1-43f7-b60c-c26c9c85364e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a760136358014ab1a16a115b5ddd6b52, user_id=9a43c54016ef48a6b36fe0de42ab131e, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:10.718511 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b72058-55f1-43f7-b60c-c26c9c85364e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:10.727161 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:10.736128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 982/1961] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:10 2022] PUT /identity/v3/projects/a760136358014ab1a16a115b5ddd6b52/users/9a43c54016ef48a6b36fe0de42ab131e/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:10.747185 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b72058-55f1-43f7-b60c-c26c9c85364e admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:10.782230 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5cfd1a55-266c-495f-b914-48cf9e2ce868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d00ed6cad3b4e3c9003e96b83a50962', 'request_id': 'req-5cfd1a55-266c-495f-b914-48cf9e2ce868'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:10.811205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5cfd1a55-266c-495f-b914-48cf9e2ce868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d00ed6cad3b4e3c9003e96b83a50962', 'request_id': 'req-5cfd1a55-266c-495f-b914-48cf9e2ce868'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:10.821229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5cfd1a55-266c-495f-b914-48cf9e2ce868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d00ed6cad3b4e3c9003e96b83a50962', 'request_id': 'req-5cfd1a55-266c-495f-b914-48cf9e2ce868'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:10.833983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b72058-55f1-43f7-b60c-c26c9c85364e admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:10.840677 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e537d-252b-4865-80b3-f97e954252ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:10.841622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e537d-252b-4865-80b3-f97e954252ac admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:10.841873 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e537d-252b-4865-80b3-f97e954252ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:10.842263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e537d-252b-4865-80b3-f97e954252ac admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:10.843665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e537d-252b-4865-80b3-f97e954252ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:10.845822 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e537d-252b-4865-80b3-f97e954252ac admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:10.860103 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5cfd1a55-266c-495f-b914-48cf9e2ce868 admin admin] The token cache is being invalidate because project 0d00ed6cad3b4e3c9003e96b83a50962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:10.860417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5cfd1a55-266c-495f-b914-48cf9e2ce868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:10.861343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5cfd1a55-266c-495f-b914-48cf9e2ce868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:10.865286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 980/1962] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:10 2022] DELETE /identity/v3/projects/0d00ed6cad3b4e3c9003e96b83a50962 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:10.865286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd1a55-266c-495f-b914-48cf9e2ce868 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:10.866901 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-5cfd1a55-266c-495f-b914-48cf9e2ce868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:10.877271 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 983/1963] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:10 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:10.878408 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e537d-252b-4865-80b3-f97e954252ac admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:10.880159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8a8e537d-252b-4865-80b3-f97e954252ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:10.893195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e537d-252b-4865-80b3-f97e954252ac admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:10.898562 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9941a-c4b4-4fce-891d-868435ab00e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:10.899705 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9941a-c4b4-4fce-891d-868435ab00e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:10.900044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9941a-c4b4-4fce-891d-868435ab00e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:10.900393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9941a-c4b4-4fce-891d-868435ab00e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:10.901218 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9941a-c4b4-4fce-891d-868435ab00e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:10.902948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9941a-c4b4-4fce-891d-868435ab00e0 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:10.914338 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 984/1964] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:10.916031 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a32bb4-471c-4826-8a0d-20513c7f1616 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:10.916394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a32bb4-471c-4826-8a0d-20513c7f1616 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:10.916744 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a32bb4-471c-4826-8a0d-20513c7f1616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:10.948445 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd1a55-266c-495f-b914-48cf9e2ce868 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:10.948693 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e9a32bb4-471c-4826-8a0d-20513c7f1616 None None] MFA Rules not processed for user `9a43c54016ef48a6b36fe0de42ab131e`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:10.950026 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e9a32bb4-471c-4826-8a0d-20513c7f1616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:10.953741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6178a-0be8-465d-ae90-975c2f06704c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:10.954598 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6178a-0be8-465d-ae90-975c2f06704c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:10.954945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6178a-0be8-465d-ae90-975c2f06704c admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:10.955288 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6178a-0be8-465d-ae90-975c2f06704c admin admin] PATH_INFO: `/v3/projects/23b36c26f27a47358ea05d99a3d3414f` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:10.957471 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6178a-0be8-465d-ae90-975c2f06704c admin admin] RBAC: Authorizing `identity:delete_project(project_id=23b36c26f27a47358ea05d99a3d3414f)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:10.959771 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6178a-0be8-465d-ae90-975c2f06704c admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:11.031196 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-6fc6178a-0be8-465d-ae90-975c2f06704c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23b36c26f27a47358ea05d99a3d3414f', 'request_id': 'req-6fc6178a-0be8-465d-ae90-975c2f06704c'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:11.036737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:11.040883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 985/1965] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:11.044317 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-6fc6178a-0be8-465d-ae90-975c2f06704c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23b36c26f27a47358ea05d99a3d3414f', 'request_id': 'req-6fc6178a-0be8-465d-ae90-975c2f06704c'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:11.046181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a32bb4-471c-4826-8a0d-20513c7f1616 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:11.050319 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e9a32bb4-471c-4826-8a0d-20513c7f1616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:11.059952 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-6fc6178a-0be8-465d-ae90-975c2f06704c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23b36c26f27a47358ea05d99a3d3414f', 'request_id': 'req-6fc6178a-0be8-465d-ae90-975c2f06704c'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:11.068685 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a32bb4-471c-4826-8a0d-20513c7f1616 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:11.072651 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-6fc6178a-0be8-465d-ae90-975c2f06704c admin admin] The token cache is being invalidate because project 23b36c26f27a47358ea05d99a3d3414f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:11.073422 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-6fc6178a-0be8-465d-ae90-975c2f06704c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:11.074239 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-6fc6178a-0be8-465d-ae90-975c2f06704c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:11.076248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 981/1966] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:10 2022] DELETE /identity/v3/projects/23b36c26f27a47358ea05d99a3d3414f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:11.079690 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6178a-0be8-465d-ae90-975c2f06704c admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:11.081083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6fc6178a-0be8-465d-ae90-975c2f06704c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:11.140140 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95f96d-d36b-41f6-b69c-5f61f0f8dc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:11.140719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95f96d-d36b-41f6-b69c-5f61f0f8dc46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:11.141193 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95f96d-d36b-41f6-b69c-5f61f0f8dc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:11.141544 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95f96d-d36b-41f6-b69c-5f61f0f8dc46 admin admin] PATH_INFO: `/v3/users/5ce02619b26f48bc9fa5d1319ca24dfc` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:11.142887 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95f96d-d36b-41f6-b69c-5f61f0f8dc46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ce02619b26f48bc9fa5d1319ca24dfc)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:11.145073 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95f96d-d36b-41f6-b69c-5f61f0f8dc46 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:11.152000 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:11.154862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6178a-0be8-465d-ae90-975c2f06704c admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:11.160553 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48363b-c4ac-4a2b-93dc-fe77151072c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:11.161899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48363b-c4ac-4a2b-93dc-fe77151072c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:11.162252 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48363b-c4ac-4a2b-93dc-fe77151072c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:11.162644 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48363b-c4ac-4a2b-93dc-fe77151072c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:11.163259 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48363b-c4ac-4a2b-93dc-fe77151072c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:11.165481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48363b-c4ac-4a2b-93dc-fe77151072c0 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:11.175653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 982/1967] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:11.177289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48363b-c4ac-4a2b-93dc-fe77151072c0 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:11.178312 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-af48363b-c4ac-4a2b-93dc-fe77151072c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:11.191156 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48363b-c4ac-4a2b-93dc-fe77151072c0 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:11.196269 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf8ccc-4bcd-48ac-aafb-9c4cd450abbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:11.196948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf8ccc-4bcd-48ac-aafb-9c4cd450abbc admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:11.197239 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf8ccc-4bcd-48ac-aafb-9c4cd450abbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:11.197519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf8ccc-4bcd-48ac-aafb-9c4cd450abbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:11.198220 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf8ccc-4bcd-48ac-aafb-9c4cd450abbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:11.199827 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf8ccc-4bcd-48ac-aafb-9c4cd450abbc admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:11.200353 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ae95f96d-d36b-41f6-b69c-5f61f0f8dc46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ce02619b26f48bc9fa5d1319ca24dfc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:11.201101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ae95f96d-d36b-41f6-b69c-5f61f0f8dc46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ce02619b26f48bc9fa5d1319ca24dfc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:11.208197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ae95f96d-d36b-41f6-b69c-5f61f0f8dc46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ce02619b26f48bc9fa5d1319ca24dfc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:11.209985 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 983/1968] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:11.211349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf8ccc-4bcd-48ac-aafb-9c4cd450abbc admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:11.213008 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-5edf8ccc-4bcd-48ac-aafb-9c4cd450abbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:11.221453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ae95f96d-d36b-41f6-b69c-5f61f0f8dc46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ce02619b26f48bc9fa5d1319ca24dfc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:11.222179 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ae95f96d-d36b-41f6-b69c-5f61f0f8dc46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ce02619b26f48bc9fa5d1319ca24dfc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:11.240082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 986/1969] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:11 2022] DELETE /identity/v3/users/5ce02619b26f48bc9fa5d1319ca24dfc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:11.240920 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95f96d-d36b-41f6-b69c-5f61f0f8dc46 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:11.242483 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ae95f96d-d36b-41f6-b69c-5f61f0f8dc46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:11.282037 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf8ccc-4bcd-48ac-aafb-9c4cd450abbc admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:11.322269 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95f96d-d36b-41f6-b69c-5f61f0f8dc46 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:11.328113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b331c-9e6e-4c60-93f5-35212e8cb311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:11.328974 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b331c-9e6e-4c60-93f5-35212e8cb311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:11.329293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b331c-9e6e-4c60-93f5-35212e8cb311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:11.329561 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b331c-9e6e-4c60-93f5-35212e8cb311 admin admin] PATH_INFO: `/v3/users/2326ae3700f44bbc8a465a35449ed256` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:11.330949 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b331c-9e6e-4c60-93f5-35212e8cb311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2326ae3700f44bbc8a465a35449ed256)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:11.332916 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b331c-9e6e-4c60-93f5-35212e8cb311 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:11.340523 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5073a-7dee-43b1-ad6a-b488bce9c1d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:11.341405 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5073a-7dee-43b1-ad6a-b488bce9c1d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:11.341515 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5073a-7dee-43b1-ad6a-b488bce9c1d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:11.341691 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5073a-7dee-43b1-ad6a-b488bce9c1d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:11.343725 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-01c5073a-7dee-43b1-ad6a-b488bce9c1d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:11.387922 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:11.393440 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f58b331c-9e6e-4c60-93f5-35212e8cb311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2326ae3700f44bbc8a465a35449ed256'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:11.394307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f58b331c-9e6e-4c60-93f5-35212e8cb311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2326ae3700f44bbc8a465a35449ed256'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:11.402563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f58b331c-9e6e-4c60-93f5-35212e8cb311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2326ae3700f44bbc8a465a35449ed256'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:11.417481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f58b331c-9e6e-4c60-93f5-35212e8cb311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2326ae3700f44bbc8a465a35449ed256'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:11.418237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f58b331c-9e6e-4c60-93f5-35212e8cb311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2326ae3700f44bbc8a465a35449ed256'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:11.423928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5073a-7dee-43b1-ad6a-b488bce9c1d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:11.425459 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5073a-7dee-43b1-ad6a-b488bce9c1d1 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:11.436411 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 987/1970] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:11 2022] DELETE /identity/v3/users/2326ae3700f44bbc8a465a35449ed256 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:11.437230 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 984/1971] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:11.437624 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b331c-9e6e-4c60-93f5-35212e8cb311 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:11.438811 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5073a-7dee-43b1-ad6a-b488bce9c1d1 service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:11.441592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-01c5073a-7dee-43b1-ad6a-b488bce9c1d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:11.448082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f58b331c-9e6e-4c60-93f5-35212e8cb311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:11.458075 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:11.463449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5073a-7dee-43b1-ad6a-b488bce9c1d1 service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:11.573568 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6c198-975e-4ff8-a21f-22dfbd0578cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:11.574326 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6c198-975e-4ff8-a21f-22dfbd0578cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:11.576190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6c198-975e-4ff8-a21f-22dfbd0578cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:11.576608 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6c198-975e-4ff8-a21f-22dfbd0578cc admin admin] PATH_INFO: `/v3/projects/c08eb44f6d8a49a4aff91220df0c38ed/users/765fba80852c4ef085eb9fdcf8546fab/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:11.595607 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b331c-9e6e-4c60-93f5-35212e8cb311 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:11.603840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6c198-975e-4ff8-a21f-22dfbd0578cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c08eb44f6d8a49a4aff91220df0c38ed, user_id=765fba80852c4ef085eb9fdcf8546fab, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:11.606662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548ae2e-6e69-41cd-a27a-ed613b0400f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:11.607215 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6c198-975e-4ff8-a21f-22dfbd0578cc admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:11.607424 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548ae2e-6e69-41cd-a27a-ed613b0400f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:11.607635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548ae2e-6e69-41cd-a27a-ed613b0400f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:11.607849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548ae2e-6e69-41cd-a27a-ed613b0400f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:11.608551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548ae2e-6e69-41cd-a27a-ed613b0400f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:11.611916 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548ae2e-6e69-41cd-a27a-ed613b0400f3 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:11.626040 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 985/1972] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:11 2022] PUT /identity/v3/projects/c08eb44f6d8a49a4aff91220df0c38ed/users/765fba80852c4ef085eb9fdcf8546fab/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:11.627194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6c198-975e-4ff8-a21f-22dfbd0578cc admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:11.630051 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-80c6c198-975e-4ff8-a21f-22dfbd0578cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:11.643598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 988/1973] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:11.643598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbea8a-864f-47dc-a7a3-463b0ae1bb6c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:11.643598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbea8a-864f-47dc-a7a3-463b0ae1bb6c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:11.643598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbea8a-864f-47dc-a7a3-463b0ae1bb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:11.694069 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-03cbea8a-864f-47dc-a7a3-463b0ae1bb6c None None] MFA Rules not processed for user `765fba80852c4ef085eb9fdcf8546fab`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:11.696661 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-03cbea8a-864f-47dc-a7a3-463b0ae1bb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:11.736761 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6c198-975e-4ff8-a21f-22dfbd0578cc admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:11.742580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f269d-7363-4b64-ad81-8cc430e708af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:11.742580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f269d-7363-4b64-ad81-8cc430e708af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:11.742900 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f269d-7363-4b64-ad81-8cc430e708af admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:11.743145 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f269d-7363-4b64-ad81-8cc430e708af admin admin] PATH_INFO: `/v3/projects/7232488717a64da0812da330f8f3bd5a` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:11.744410 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f269d-7363-4b64-ad81-8cc430e708af admin admin] RBAC: Authorizing `identity:delete_project(project_id=7232488717a64da0812da330f8f3bd5a)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:11.746570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f269d-7363-4b64-ad81-8cc430e708af admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:11.806512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 989/1974] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:11.806512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbea8a-864f-47dc-a7a3-463b0ae1bb6c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:11.822363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbea8a-864f-47dc-a7a3-463b0ae1bb6c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:11.836325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-196f269d-7363-4b64-ad81-8cc430e708af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7232488717a64da0812da330f8f3bd5a', 'request_id': 'req-196f269d-7363-4b64-ad81-8cc430e708af'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:11.855875 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-196f269d-7363-4b64-ad81-8cc430e708af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7232488717a64da0812da330f8f3bd5a', 'request_id': 'req-196f269d-7363-4b64-ad81-8cc430e708af'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:11.863883 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-196f269d-7363-4b64-ad81-8cc430e708af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7232488717a64da0812da330f8f3bd5a', 'request_id': 'req-196f269d-7363-4b64-ad81-8cc430e708af'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:11.867798 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:11.907651 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-196f269d-7363-4b64-ad81-8cc430e708af admin admin] The token cache is being invalidate because project 7232488717a64da0812da330f8f3bd5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:11.922016 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-196f269d-7363-4b64-ad81-8cc430e708af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:11.922016 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-196f269d-7363-4b64-ad81-8cc430e708af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:11.924618 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 986/1975] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:11 2022] DELETE /identity/v3/projects/7232488717a64da0812da330f8f3bd5a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:11.925518 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f269d-7363-4b64-ad81-8cc430e708af admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:11.926947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-196f269d-7363-4b64-ad81-8cc430e708af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:11.950569 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f5524-6b97-4470-a910-a04089833f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:11.952525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f5524-6b97-4470-a910-a04089833f91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:11.952830 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f5524-6b97-4470-a910-a04089833f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:11.953149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f5524-6b97-4470-a910-a04089833f91 admin admin] PATH_INFO: `/v3/projects/3bb19b405f43400aba9cbec0e797daba/users/095b016f76d743ad87d7140a91afe8bf/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:11.988608 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f5524-6b97-4470-a910-a04089833f91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb19b405f43400aba9cbec0e797daba, user_id=095b016f76d743ad87d7140a91afe8bf, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:11.992152 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f5524-6b97-4470-a910-a04089833f91 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:12.029325 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 990/1976] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:11 2022] PUT /identity/v3/projects/3bb19b405f43400aba9cbec0e797daba/users/095b016f76d743ad87d7140a91afe8bf/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:12.029325 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f5524-6b97-4470-a910-a04089833f91 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:12.031016 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-561f5524-6b97-4470-a910-a04089833f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:12.064056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f269d-7363-4b64-ad81-8cc430e708af admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:12.065477 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:12.153610 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f5524-6b97-4470-a910-a04089833f91 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:12.160898 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857dd6e9-33bd-44ef-80e8-a3d4f1eadc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:12.161806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dd6e9-33bd-44ef-80e8-a3d4f1eadc3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.162236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dd6e9-33bd-44ef-80e8-a3d4f1eadc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.162656 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dd6e9-33bd-44ef-80e8-a3d4f1eadc3c admin admin] PATH_INFO: `/v3/projects/b72f06589b8746debb272376682a1247` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.164082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857dd6e9-33bd-44ef-80e8-a3d4f1eadc3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b72f06589b8746debb272376682a1247)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:12.164649 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6157a-297b-43e1-8877-f2b6877fe5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:12.165561 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6157a-297b-43e1-8877-f2b6877fe5ca admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.165939 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6157a-297b-43e1-8877-f2b6877fe5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.166509 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6157a-297b-43e1-8877-f2b6877fe5ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.166891 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857dd6e9-33bd-44ef-80e8-a3d4f1eadc3c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:12.167522 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6157a-297b-43e1-8877-f2b6877fe5ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:12.170686 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6157a-297b-43e1-8877-f2b6877fe5ca admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:12.212159 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 987/1977] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:11 2022] POST /identity/v3/projects => generated 383 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:12.214188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f39144-ba06-4d09-b916-b648ebc3b55a None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.214661 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f39144-ba06-4d09-b916-b648ebc3b55a None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.215043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f39144-ba06-4d09-b916-b648ebc3b55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.240365 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-857dd6e9-33bd-44ef-80e8-a3d4f1eadc3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b72f06589b8746debb272376682a1247', 'request_id': 'req-857dd6e9-33bd-44ef-80e8-a3d4f1eadc3c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:12.244169 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-06f39144-ba06-4d09-b916-b648ebc3b55a None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:12.245894 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-06f39144-ba06-4d09-b916-b648ebc3b55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:12.250257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-857dd6e9-33bd-44ef-80e8-a3d4f1eadc3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b72f06589b8746debb272376682a1247', 'request_id': 'req-857dd6e9-33bd-44ef-80e8-a3d4f1eadc3c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:12.261092 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-857dd6e9-33bd-44ef-80e8-a3d4f1eadc3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b72f06589b8746debb272376682a1247', 'request_id': 'req-857dd6e9-33bd-44ef-80e8-a3d4f1eadc3c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:12.276452 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-857dd6e9-33bd-44ef-80e8-a3d4f1eadc3c admin admin] The token cache is being invalidate because project b72f06589b8746debb272376682a1247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:12.276747 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-857dd6e9-33bd-44ef-80e8-a3d4f1eadc3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:12.277983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-857dd6e9-33bd-44ef-80e8-a3d4f1eadc3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:12.280036 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 991/1978] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:12 2022] DELETE /identity/v3/projects/b72f06589b8746debb272376682a1247 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:12.281658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22925c8c-8fba-4511-bb84-a5ab52e0a00a None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.281945 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22925c8c-8fba-4511-bb84-a5ab52e0a00a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.282225 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22925c8c-8fba-4511-bb84-a5ab52e0a00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.323143 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-22925c8c-8fba-4511-bb84-a5ab52e0a00a None None] MFA Rules not processed for user `095b016f76d743ad87d7140a91afe8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:12.324898 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-22925c8c-8fba-4511-bb84-a5ab52e0a00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:12.346962 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 988/1979] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:12.347828 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f39144-ba06-4d09-b916-b648ebc3b55a None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:12.349416 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-06f39144-ba06-4d09-b916-b648ebc3b55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:12.362685 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f39144-ba06-4d09-b916-b648ebc3b55a None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:12.367797 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f18f5-a5a3-45a2-9f8f-76039fd52ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:12.368543 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f18f5-a5a3-45a2-9f8f-76039fd52ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.368893 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f18f5-a5a3-45a2-9f8f-76039fd52ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.369273 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f18f5-a5a3-45a2-9f8f-76039fd52ee4 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.370036 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f18f5-a5a3-45a2-9f8f-76039fd52ee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:12.371953 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f18f5-a5a3-45a2-9f8f-76039fd52ee4 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:12.396190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 989/1980] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:12 2022] POST /identity/v3/users => generated 298 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:12.397976 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647d41e-762e-4957-a3d8-ee960d5bb59c None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.398382 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647d41e-762e-4957-a3d8-ee960d5bb59c None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.398771 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647d41e-762e-4957-a3d8-ee960d5bb59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.402556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 992/1981] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:12.404229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d769c38-6f36-40e8-9a48-eda4b16406e9 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.404522 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d769c38-6f36-40e8-9a48-eda4b16406e9 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.404802 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d769c38-6f36-40e8-9a48-eda4b16406e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.419970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:12.425959 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7d769c38-6f36-40e8-9a48-eda4b16406e9 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:12.426849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-a647d41e-762e-4957-a3d8-ee960d5bb59c None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:12.427447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7d769c38-6f36-40e8-9a48-eda4b16406e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:12.428534 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-a647d41e-762e-4957-a3d8-ee960d5bb59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:12.439668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 993/1982] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:12.440807 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 990/1983] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:12.441083 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d769c38-6f36-40e8-9a48-eda4b16406e9 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:12.441702 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647d41e-762e-4957-a3d8-ee960d5bb59c None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:12.449551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-a647d41e-762e-4957-a3d8-ee960d5bb59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:12.454483 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d769c38-6f36-40e8-9a48-eda4b16406e9 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:12.461668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe406852-21f3-4414-a446-e8d9469f5995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:12.462020 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe406852-21f3-4414-a446-e8d9469f5995 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.462288 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe406852-21f3-4414-a446-e8d9469f5995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.462570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe406852-21f3-4414-a446-e8d9469f5995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.466261 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647d41e-762e-4957-a3d8-ee960d5bb59c None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:12.470134 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe406852-21f3-4414-a446-e8d9469f5995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:12.471597 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31279be-f56a-46c8-b8b5-1e6624a6ea4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:12.472256 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31279be-f56a-46c8-b8b5-1e6624a6ea4a admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.472540 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31279be-f56a-46c8-b8b5-1e6624a6ea4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.472815 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31279be-f56a-46c8-b8b5-1e6624a6ea4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.473566 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31279be-f56a-46c8-b8b5-1e6624a6ea4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:12.474434 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe406852-21f3-4414-a446-e8d9469f5995 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:12.475495 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31279be-f56a-46c8-b8b5-1e6624a6ea4a admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:12.493930 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 994/1984] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:12.495188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe406852-21f3-4414-a446-e8d9469f5995 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:12.512615 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 991/1985] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:12 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:12.513878 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe406852-21f3-4414-a446-e8d9469f5995 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:12.516882 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d258eab-1de9-4141-a25f-65ee2dd82fef None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.517324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d258eab-1de9-4141-a25f-65ee2dd82fef None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.517610 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d258eab-1de9-4141-a25f-65ee2dd82fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.528327 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:12.539015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-5d258eab-1de9-4141-a25f-65ee2dd82fef None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:12.541375 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-5d258eab-1de9-4141-a25f-65ee2dd82fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:12.599198 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53270886-5786-49d1-bed0-9d82723d48f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:12.599842 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53270886-5786-49d1-bed0-9d82723d48f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.600122 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53270886-5786-49d1-bed0-9d82723d48f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.600405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53270886-5786-49d1-bed0-9d82723d48f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.601160 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53270886-5786-49d1-bed0-9d82723d48f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:12.601604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53270886-5786-49d1-bed0-9d82723d48f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:12.603316 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53270886-5786-49d1-bed0-9d82723d48f4 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:12.607112 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 992/1986] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:12.608092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d258eab-1de9-4141-a25f-65ee2dd82fef None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:12.618521 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 995/1987] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:56:12.619397 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53270886-5786-49d1-bed0-9d82723d48f4 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:12.619673 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d258eab-1de9-4141-a25f-65ee2dd82fef None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:12.628673 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b2d7f-cd9a-4ae4-acbe-0a3fe8306708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:12.629419 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b2d7f-cd9a-4ae4-acbe-0a3fe8306708 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.629705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b2d7f-cd9a-4ae4-acbe-0a3fe8306708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.629985 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b2d7f-cd9a-4ae4-acbe-0a3fe8306708 admin admin] PATH_INFO: `/v3/projects/2c5666e4f3ab4e4999351e772418707f/users/9ea2a862b2bc4a3caf9428aac84950a9/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.647783 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53270886-5786-49d1-bed0-9d82723d48f4 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:12.649617 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b2d7f-cd9a-4ae4-acbe-0a3fe8306708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5666e4f3ab4e4999351e772418707f, user_id=9ea2a862b2bc4a3caf9428aac84950a9, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:12.652378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b2d7f-cd9a-4ae4-acbe-0a3fe8306708 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:12.653459 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f66f70-069a-4a04-aae9-47aa1af316f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:12.654040 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f66f70-069a-4a04-aae9-47aa1af316f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.654594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f66f70-069a-4a04-aae9-47aa1af316f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.654884 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f66f70-069a-4a04-aae9-47aa1af316f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.655627 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f66f70-069a-4a04-aae9-47aa1af316f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:12.657688 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f66f70-069a-4a04-aae9-47aa1af316f9 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:12.668587 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 993/1988] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:12 2022] PUT /identity/v3/projects/2c5666e4f3ab4e4999351e772418707f/users/9ea2a862b2bc4a3caf9428aac84950a9/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:12.669965 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b2d7f-cd9a-4ae4-acbe-0a3fe8306708 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:12.686551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 996/1989] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:12 2022] POST /identity/v3/users => generated 298 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:12.687414 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f66f70-069a-4a04-aae9-47aa1af316f9 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:12.699580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f66f70-069a-4a04-aae9-47aa1af316f9 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:12.750088 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b2d7f-cd9a-4ae4-acbe-0a3fe8306708 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:12.758800 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738064eb-2281-4a02-9da3-dd8f98f26c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:12.760583 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738064eb-2281-4a02-9da3-dd8f98f26c43 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.760869 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738064eb-2281-4a02-9da3-dd8f98f26c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.761163 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738064eb-2281-4a02-9da3-dd8f98f26c43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.761871 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738064eb-2281-4a02-9da3-dd8f98f26c43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:12.762206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738064eb-2281-4a02-9da3-dd8f98f26c43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:12.764084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738064eb-2281-4a02-9da3-dd8f98f26c43 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:12.781050 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 994/1990] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:56:12.782736 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d7651-8f12-445f-8f72-d79041bf9064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:12.783038 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738064eb-2281-4a02-9da3-dd8f98f26c43 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:12.785225 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d7651-8f12-445f-8f72-d79041bf9064 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.785935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d7651-8f12-445f-8f72-d79041bf9064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.786494 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d7651-8f12-445f-8f72-d79041bf9064 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.787402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d7651-8f12-445f-8f72-d79041bf9064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:12.791477 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d7651-8f12-445f-8f72-d79041bf9064 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:12.798984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738064eb-2281-4a02-9da3-dd8f98f26c43 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:12.803515 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043618e-040b-40df-b181-5c124f949f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:12.804135 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043618e-040b-40df-b181-5c124f949f7a admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.804447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043618e-040b-40df-b181-5c124f949f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.804933 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043618e-040b-40df-b181-5c124f949f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.805715 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043618e-040b-40df-b181-5c124f949f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:12.807461 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043618e-040b-40df-b181-5c124f949f7a admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:12.819780 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 995/1991] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:12.820482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043618e-040b-40df-b181-5c124f949f7a admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:12.826714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 997/1992] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:12 2022] POST /identity/v3/projects => generated 379 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:12.827750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d7651-8f12-445f-8f72-d79041bf9064 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:12.830377 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043618e-040b-40df-b181-5c124f949f7a admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:12.866410 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:12.891042 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70127f2-1a92-4d5a-a5ad-b67a71bff0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:12.891675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70127f2-1a92-4d5a-a5ad-b67a71bff0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.891953 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70127f2-1a92-4d5a-a5ad-b67a71bff0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.892226 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70127f2-1a92-4d5a-a5ad-b67a71bff0a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.892437 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d7651-8f12-445f-8f72-d79041bf9064 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:12.892925 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70127f2-1a92-4d5a-a5ad-b67a71bff0a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:12.894783 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70127f2-1a92-4d5a-a5ad-b67a71bff0a9 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:12.897052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfccea-837d-43ff-ae43-2ed6cac4d2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:12.897691 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfccea-837d-43ff-ae43-2ed6cac4d2ca admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.897972 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfccea-837d-43ff-ae43-2ed6cac4d2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.898380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfccea-837d-43ff-ae43-2ed6cac4d2ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.899106 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfccea-837d-43ff-ae43-2ed6cac4d2ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:12.901027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfccea-837d-43ff-ae43-2ed6cac4d2ca admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:12.909363 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 996/1993] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:12.909363 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70127f2-1a92-4d5a-a5ad-b67a71bff0a9 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:12.917635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70127f2-1a92-4d5a-a5ad-b67a71bff0a9 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:12.924013 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f0b2b-aefc-496c-95a5-5c2f9e3b8b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:12.924513 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:12.924694 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f0b2b-aefc-496c-95a5-5c2f9e3b8b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:12.924969 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f0b2b-aefc-496c-95a5-5c2f9e3b8b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:12.925513 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f0b2b-aefc-496c-95a5-5c2f9e3b8b42 admin admin] PATH_INFO: `/v3/projects/2c5666e4f3ab4e4999351e772418707f/users/9ea2a862b2bc4a3caf9428aac84950a9/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:12.927564 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f0b2b-aefc-496c-95a5-5c2f9e3b8b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5666e4f3ab4e4999351e772418707f, user_id=9ea2a862b2bc4a3caf9428aac84950a9, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:12.930705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f0b2b-aefc-496c-95a5-5c2f9e3b8b42 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:12.932613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 998/1994] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:12 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:12.933603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfccea-837d-43ff-ae43-2ed6cac4d2ca admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:12.944351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 997/1995] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:12 2022] PUT /identity/v3/projects/2c5666e4f3ab4e4999351e772418707f/users/9ea2a862b2bc4a3caf9428aac84950a9/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:12.945437 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f0b2b-aefc-496c-95a5-5c2f9e3b8b42 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:12.998139 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfccea-837d-43ff-ae43-2ed6cac4d2ca admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:13.016115 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f0b2b-aefc-496c-95a5-5c2f9e3b8b42 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:13.025929 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aba932-f291-4309-8089-e37fcab7de5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:13.026846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aba932-f291-4309-8089-e37fcab7de5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:13.027130 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aba932-f291-4309-8089-e37fcab7de5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:13.027453 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aba932-f291-4309-8089-e37fcab7de5c admin admin] PATH_INFO: `/v3/projects/9e13cfe94f3d4f0f95cc7d6bca2fb68e/users/ab3f3cce115d47f6a279b5db9afd2eac/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:13.043610 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aba932-f291-4309-8089-e37fcab7de5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e13cfe94f3d4f0f95cc7d6bca2fb68e, user_id=ab3f3cce115d47f6a279b5db9afd2eac, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:13.046316 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aba932-f291-4309-8089-e37fcab7de5c admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:13.061442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b15f03-d2fb-4f64-bc87-b0d2d7a73f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:13.062156 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b15f03-d2fb-4f64-bc87-b0d2d7a73f48 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:13.062508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b15f03-d2fb-4f64-bc87-b0d2d7a73f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:13.062854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b15f03-d2fb-4f64-bc87-b0d2d7a73f48 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:13.063589 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b15f03-d2fb-4f64-bc87-b0d2d7a73f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:13.065986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b15f03-d2fb-4f64-bc87-b0d2d7a73f48 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:13.070817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 998/1996] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:12 2022] PUT /identity/v3/projects/9e13cfe94f3d4f0f95cc7d6bca2fb68e/users/ab3f3cce115d47f6a279b5db9afd2eac/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:13.071392 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aba932-f291-4309-8089-e37fcab7de5c admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:13.096160 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 999/1997] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:12 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:13.098608 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ab158-31ca-4465-b77a-0a7fcda2e180 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:13.098901 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ab158-31ca-4465-b77a-0a7fcda2e180 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:13.099271 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ab158-31ca-4465-b77a-0a7fcda2e180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:13.134123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b23ab158-31ca-4465-b77a-0a7fcda2e180 None None] MFA Rules not processed for user `9ea2a862b2bc4a3caf9428aac84950a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:13.135629 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b23ab158-31ca-4465-b77a-0a7fcda2e180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:13.146064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aba932-f291-4309-8089-e37fcab7de5c admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:13.152002 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad2e5d-4c85-4445-88ad-2e2bf28a2af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:13.152660 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad2e5d-4c85-4445-88ad-2e2bf28a2af6 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:13.153006 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad2e5d-4c85-4445-88ad-2e2bf28a2af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:13.153623 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad2e5d-4c85-4445-88ad-2e2bf28a2af6 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:13.154368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad2e5d-4c85-4445-88ad-2e2bf28a2af6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:13.156598 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad2e5d-4c85-4445-88ad-2e2bf28a2af6 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:13.190093 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 999/1998] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:13 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:13.190761 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad2e5d-4c85-4445-88ad-2e2bf28a2af6 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:13.210031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad2e5d-4c85-4445-88ad-2e2bf28a2af6 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:13.216110 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0f279-2b03-407c-986c-3c6fa0d25f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:13.216826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0f279-2b03-407c-986c-3c6fa0d25f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:13.217145 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0f279-2b03-407c-986c-3c6fa0d25f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:13.218460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0f279-2b03-407c-986c-3c6fa0d25f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:13.220142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0f279-2b03-407c-986c-3c6fa0d25f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:13.236459 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0f279-2b03-407c-986c-3c6fa0d25f91 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:13.244119 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1000/1999] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:13.245585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ab158-31ca-4465-b77a-0a7fcda2e180 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:13.265104 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ab158-31ca-4465-b77a-0a7fcda2e180 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:13.270257 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1000/2000] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:13.270631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bfd60-ee21-46f1-a366-53e4ce0a665a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:13.271275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bfd60-ee21-46f1-a366-53e4ce0a665a admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:13.271598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bfd60-ee21-46f1-a366-53e4ce0a665a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:13.271780 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0f279-2b03-407c-986c-3c6fa0d25f91 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:13.271886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bfd60-ee21-46f1-a366-53e4ce0a665a admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:13.272633 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bfd60-ee21-46f1-a366-53e4ce0a665a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:13.275271 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bfd60-ee21-46f1-a366-53e4ce0a665a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:13.292922 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1001/2001] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:13.293861 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bfd60-ee21-46f1-a366-53e4ce0a665a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:13.296399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0f279-2b03-407c-986c-3c6fa0d25f91 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:13.296527 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c31bfd60-ee21-46f1-a366-53e4ce0a665a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:13.322098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a61d29-8b24-47b8-8977-2a47641e14fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:13.322806 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a61d29-8b24-47b8-8977-2a47641e14fa admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:13.323082 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a61d29-8b24-47b8-8977-2a47641e14fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:13.323357 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a61d29-8b24-47b8-8977-2a47641e14fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:13.324075 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a61d29-8b24-47b8-8977-2a47641e14fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:13.326061 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a61d29-8b24-47b8-8977-2a47641e14fa admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:13.329113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:13.351609 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1001/2002] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:13.352591 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a61d29-8b24-47b8-8977-2a47641e14fa admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:13.376764 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a61d29-8b24-47b8-8977-2a47641e14fa admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:13.387971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e812681-3248-4278-89e1-2b78683fd9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:13.388679 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e812681-3248-4278-89e1-2b78683fd9b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:13.388993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e812681-3248-4278-89e1-2b78683fd9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:13.389361 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e812681-3248-4278-89e1-2b78683fd9b8 admin admin] PATH_INFO: `/v3/projects/9e13cfe94f3d4f0f95cc7d6bca2fb68e/users/ab3f3cce115d47f6a279b5db9afd2eac/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:13.395074 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bfd60-ee21-46f1-a366-53e4ce0a665a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:13.397209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e812681-3248-4278-89e1-2b78683fd9b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e13cfe94f3d4f0f95cc7d6bca2fb68e, user_id=ab3f3cce115d47f6a279b5db9afd2eac, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:13.399588 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26dc7e-fc88-4fef-9479-fc5adcea4807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:13.400196 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e812681-3248-4278-89e1-2b78683fd9b8 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:13.400437 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26dc7e-fc88-4fef-9479-fc5adcea4807 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:13.400812 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26dc7e-fc88-4fef-9479-fc5adcea4807 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:13.401229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26dc7e-fc88-4fef-9479-fc5adcea4807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:13.412718 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26dc7e-fc88-4fef-9479-fc5adcea4807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:13.421453 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:13.421633 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26dc7e-fc88-4fef-9479-fc5adcea4807 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:13.440404 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1002/2003] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:13 2022] PUT /identity/v3/projects/9e13cfe94f3d4f0f95cc7d6bca2fb68e/users/ab3f3cce115d47f6a279b5db9afd2eac/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:13.441482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e812681-3248-4278-89e1-2b78683fd9b8 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:13.446781 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1002/2004] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:13.453405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26dc7e-fc88-4fef-9479-fc5adcea4807 service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:13.480566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26dc7e-fc88-4fef-9479-fc5adcea4807 service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:13.530179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e812681-3248-4278-89e1-2b78683fd9b8 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:13.548076 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1463a4-7b51-48c7-a55d-3adb0a8be9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:13.548076 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1463a4-7b51-48c7-a55d-3adb0a8be9ad admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:13.548076 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1463a4-7b51-48c7-a55d-3adb0a8be9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:13.548076 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1463a4-7b51-48c7-a55d-3adb0a8be9ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:13.548442 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1463a4-7b51-48c7-a55d-3adb0a8be9ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:13.548442 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1463a4-7b51-48c7-a55d-3adb0a8be9ad admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:13.564565 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1003/2005] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:13.568492 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1463a4-7b51-48c7-a55d-3adb0a8be9ad admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:13.570572 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6e1463a4-7b51-48c7-a55d-3adb0a8be9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:13.589397 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505aaf8-d44c-40fd-88af-4c16fb428820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:13.590166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505aaf8-d44c-40fd-88af-4c16fb428820 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:13.590523 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505aaf8-d44c-40fd-88af-4c16fb428820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:13.590868 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505aaf8-d44c-40fd-88af-4c16fb428820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:13.592384 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505aaf8-d44c-40fd-88af-4c16fb428820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:13.594429 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505aaf8-d44c-40fd-88af-4c16fb428820 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:13.606521 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1003/2006] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:13.607971 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b8056-356c-48ed-9eb1-66945ca29122 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:13.608258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b8056-356c-48ed-9eb1-66945ca29122 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:13.608532 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b8056-356c-48ed-9eb1-66945ca29122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:13.642263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-4c7b8056-356c-48ed-9eb1-66945ca29122 None None] MFA Rules not processed for user `ab3f3cce115d47f6a279b5db9afd2eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:13.643753 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4c7b8056-356c-48ed-9eb1-66945ca29122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:13.659012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1463a4-7b51-48c7-a55d-3adb0a8be9ad admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:13.662652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555d3a7-9f80-451a-812e-58bc33eb0ae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:13.663343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555d3a7-9f80-451a-812e-58bc33eb0ae8 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:13.663556 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555d3a7-9f80-451a-812e-58bc33eb0ae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:13.663977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555d3a7-9f80-451a-812e-58bc33eb0ae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:13.666329 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-0555d3a7-9f80-451a-812e-58bc33eb0ae8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:13.732100 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1004/2007] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:13.733021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b8056-356c-48ed-9eb1-66945ca29122 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:13.739622 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555d3a7-9f80-451a-812e-58bc33eb0ae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:13.741075 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555d3a7-9f80-451a-812e-58bc33eb0ae8 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:13.743149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b8056-356c-48ed-9eb1-66945ca29122 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:13.748183 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065ca7e-b586-4934-a242-883b4322d32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:13.748840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065ca7e-b586-4934-a242-883b4322d32e admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:13.749157 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065ca7e-b586-4934-a242-883b4322d32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:13.749439 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065ca7e-b586-4934-a242-883b4322d32e admin admin] PATH_INFO: `/v3/projects/7960594839eb42e8939f4d7fcd01d47e/users/c125cfb576884cd09392152e9a9e0b3a/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:13.751590 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1004/2008] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:13.752390 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555d3a7-9f80-451a-812e-58bc33eb0ae8 service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:13.761296 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555d3a7-9f80-451a-812e-58bc33eb0ae8 service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:13.765192 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3ee96-fe64-4a27-94e8-7de1fece410d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:13.765733 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065ca7e-b586-4934-a242-883b4322d32e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7960594839eb42e8939f4d7fcd01d47e, user_id=c125cfb576884cd09392152e9a9e0b3a, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:13.765840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3ee96-fe64-4a27-94e8-7de1fece410d service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:13.766075 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3ee96-fe64-4a27-94e8-7de1fece410d service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:13.766351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3ee96-fe64-4a27-94e8-7de1fece410d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:13.768117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-84c3ee96-fe64-4a27-94e8-7de1fece410d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:13.768397 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065ca7e-b586-4934-a242-883b4322d32e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:13.784401 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1005/2009] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:13 2022] PUT /identity/v3/projects/7960594839eb42e8939f4d7fcd01d47e/users/c125cfb576884cd09392152e9a9e0b3a/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:13.785022 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065ca7e-b586-4934-a242-883b4322d32e admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:13.803304 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:13.840480 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:13.859389 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3ee96-fe64-4a27-94e8-7de1fece410d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:13.860890 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3ee96-fe64-4a27-94e8-7de1fece410d service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:13.874198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1005/2010] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:13.875593 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba4de9-4223-4fee-8f78-115d57d275b3 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:13.875884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba4de9-4223-4fee-8f78-115d57d275b3 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:13.876167 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba4de9-4223-4fee-8f78-115d57d275b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:13.878091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065ca7e-b586-4934-a242-883b4322d32e admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:13.886074 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a05050-91cc-4136-b481-8750b7d56494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:13.886796 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a05050-91cc-4136-b481-8750b7d56494 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:13.887079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a05050-91cc-4136-b481-8750b7d56494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:13.887363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a05050-91cc-4136-b481-8750b7d56494 admin admin] PATH_INFO: `/v3/projects/b7e5cb473a654a4bb90a9226369224ca/users/6c4e262ef25b4bb8922877866d9ee02b/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:13.913579 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-eaba4de9-4223-4fee-8f78-115d57d275b3 None None] MFA Rules not processed for user `c125cfb576884cd09392152e9a9e0b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:13.915906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-eaba4de9-4223-4fee-8f78-115d57d275b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:13.924793 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a05050-91cc-4136-b481-8750b7d56494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e5cb473a654a4bb90a9226369224ca, user_id=6c4e262ef25b4bb8922877866d9ee02b, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:13.932249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a05050-91cc-4136-b481-8750b7d56494 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:13.959458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1006/2011] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:13 2022] PUT /identity/v3/projects/b7e5cb473a654a4bb90a9226369224ca/users/6c4e262ef25b4bb8922877866d9ee02b/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:13.974954 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa2d09-9653-46eb-ba3f-980a016a4ef6 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:13.975419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa2d09-9653-46eb-ba3f-980a016a4ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:13.975670 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa2d09-9653-46eb-ba3f-980a016a4ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:14.007731 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1006/2012] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:14.012423 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f7aa2d09-9653-46eb-ba3f-980a016a4ef6 None None] MFA Rules not processed for user `6c4e262ef25b4bb8922877866d9ee02b`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:14.013047 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba4de9-4223-4fee-8f78-115d57d275b3 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:14.014258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f7aa2d09-9653-46eb-ba3f-980a016a4ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:14.030923 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba4de9-4223-4fee-8f78-115d57d275b3 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:14.102740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1007/2013] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:14.105903 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa2d09-9653-46eb-ba3f-980a016a4ef6 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:14.111223 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87f7ef-7338-4a5d-ae4c-b204709558aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:14.111965 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87f7ef-7338-4a5d-ae4c-b204709558aa admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:14.112342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87f7ef-7338-4a5d-ae4c-b204709558aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:14.112716 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87f7ef-7338-4a5d-ae4c-b204709558aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:14.113529 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87f7ef-7338-4a5d-ae4c-b204709558aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:14.115830 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87f7ef-7338-4a5d-ae4c-b204709558aa admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:14.147392 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1007/2014] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:14 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:56:14.153178 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87f7ef-7338-4a5d-ae4c-b204709558aa admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:14.195530 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa2d09-9653-46eb-ba3f-980a016a4ef6 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:14.233784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:14.243184 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87f7ef-7338-4a5d-ae4c-b204709558aa admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:14.253984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6ba6c-c2c7-4d56-96d5-af782b5aa36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:14.255426 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6ba6c-c2c7-4d56-96d5-af782b5aa36b admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:14.255856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6ba6c-c2c7-4d56-96d5-af782b5aa36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:14.256386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6ba6c-c2c7-4d56-96d5-af782b5aa36b admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:14.257846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6ba6c-c2c7-4d56-96d5-af782b5aa36b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:14.263096 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6ba6c-c2c7-4d56-96d5-af782b5aa36b admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:14.273630 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:14.285050 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4f0dc-9fc8-43ef-a297-96ea799ca290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:14.286226 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4f0dc-9fc8-43ef-a297-96ea799ca290 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:14.286500 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4f0dc-9fc8-43ef-a297-96ea799ca290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:14.286730 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4f0dc-9fc8-43ef-a297-96ea799ca290 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:14.287851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4f0dc-9fc8-43ef-a297-96ea799ca290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:14.290957 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4f0dc-9fc8-43ef-a297-96ea799ca290 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:14.298876 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1008/2015] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:14 2022] POST /identity/v3/users => generated 297 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:56:14.300088 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6ba6c-c2c7-4d56-96d5-af782b5aa36b admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:14.337400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1008/2016] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:14 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:14.337400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4f0dc-9fc8-43ef-a297-96ea799ca290 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:14.373994 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6ba6c-c2c7-4d56-96d5-af782b5aa36b admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:14.417907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4f0dc-9fc8-43ef-a297-96ea799ca290 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:14.423210 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3278bea-a4cc-4f00-af7f-13d952c70102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:14.424071 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3278bea-a4cc-4f00-af7f-13d952c70102 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:14.424551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3278bea-a4cc-4f00-af7f-13d952c70102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:14.425011 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3278bea-a4cc-4f00-af7f-13d952c70102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:14.425821 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3278bea-a4cc-4f00-af7f-13d952c70102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:14.427613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3278bea-a4cc-4f00-af7f-13d952c70102 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:14.444572 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1009/2017] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:14.445754 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3278bea-a4cc-4f00-af7f-13d952c70102 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:14.459918 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3278bea-a4cc-4f00-af7f-13d952c70102 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:14.469099 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f8d99-f291-4b9a-9653-51a2c21a2a91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:14.469099 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f8d99-f291-4b9a-9653-51a2c21a2a91 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:14.469421 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673377d-7aa2-457a-a94b-a4afe3863e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:14.469509 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f8d99-f291-4b9a-9653-51a2c21a2a91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:14.469509 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f8d99-f291-4b9a-9653-51a2c21a2a91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:14.469634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673377d-7aa2-457a-a94b-a4afe3863e3e admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:14.469634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673377d-7aa2-457a-a94b-a4afe3863e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:14.469634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673377d-7aa2-457a-a94b-a4afe3863e3e admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:14.469634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673377d-7aa2-457a-a94b-a4afe3863e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:14.471998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673377d-7aa2-457a-a94b-a4afe3863e3e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:14.502908 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1010/2018] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:14 2022] POST /identity/v3/users => generated 299 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:14.502908 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673377d-7aa2-457a-a94b-a4afe3863e3e admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:14.517763 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673377d-7aa2-457a-a94b-a4afe3863e3e admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:14.529976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd452d-f773-4ab5-bfd9-a98d88f5b579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:14.530747 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd452d-f773-4ab5-bfd9-a98d88f5b579 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:14.531092 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd452d-f773-4ab5-bfd9-a98d88f5b579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:14.531438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd452d-f773-4ab5-bfd9-a98d88f5b579 admin admin] PATH_INFO: `/v3/projects/84155589c2584c629339233f21cfd33e/users/23f4a1b3138049a3a05fe343ccfd9f58/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:14.554569 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd452d-f773-4ab5-bfd9-a98d88f5b579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84155589c2584c629339233f21cfd33e, user_id=23f4a1b3138049a3a05fe343ccfd9f58, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:14.557604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd452d-f773-4ab5-bfd9-a98d88f5b579 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:14.567091 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f8d99-f291-4b9a-9653-51a2c21a2a91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:14.569542 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f8d99-f291-4b9a-9653-51a2c21a2a91 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:14.582968 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1009/2019] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:14.587788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1011/2020] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:14 2022] PUT /identity/v3/projects/84155589c2584c629339233f21cfd33e/users/23f4a1b3138049a3a05fe343ccfd9f58/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:14.589481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd452d-f773-4ab5-bfd9-a98d88f5b579 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:14.594587 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f8d99-f291-4b9a-9653-51a2c21a2a91 service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:14.623821 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f8d99-f291-4b9a-9653-51a2c21a2a91 service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:14.694469 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:14.706469 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49a1cc-a16c-41ec-8dd6-5edaf2ecbe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:14.707113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49a1cc-a16c-41ec-8dd6-5edaf2ecbe19 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:14.707422 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49a1cc-a16c-41ec-8dd6-5edaf2ecbe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:14.707695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49a1cc-a16c-41ec-8dd6-5edaf2ecbe19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:14.708398 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49a1cc-a16c-41ec-8dd6-5edaf2ecbe19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:14.710049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49a1cc-a16c-41ec-8dd6-5edaf2ecbe19 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:14.734682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1010/2021] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:14.734682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49a1cc-a16c-41ec-8dd6-5edaf2ecbe19 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:14.734956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd452d-f773-4ab5-bfd9-a98d88f5b579 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:14.740969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab1c1d-4fce-457e-b8fc-60df2135d5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:14.741899 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab1c1d-4fce-457e-b8fc-60df2135d5df admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:14.742326 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab1c1d-4fce-457e-b8fc-60df2135d5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:14.742558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab1c1d-4fce-457e-b8fc-60df2135d5df admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:14.743534 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab1c1d-4fce-457e-b8fc-60df2135d5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:14.745445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab1c1d-4fce-457e-b8fc-60df2135d5df admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:14.765094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1012/2022] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:14.765094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab1c1d-4fce-457e-b8fc-60df2135d5df admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:14.775305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:14.826245 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49a1cc-a16c-41ec-8dd6-5edaf2ecbe19 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:14.831080 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e3c2e-4fd4-41f0-8aec-449be63a5cd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:14.832083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e3c2e-4fd4-41f0-8aec-449be63a5cd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:14.833097 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e3c2e-4fd4-41f0-8aec-449be63a5cd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:14.833097 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e3c2e-4fd4-41f0-8aec-449be63a5cd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:14.834909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-845e3c2e-4fd4-41f0-8aec-449be63a5cd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:14.845449 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab1c1d-4fce-457e-b8fc-60df2135d5df admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:14.849758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3833787-8cb4-4d9a-9f21-9a88a53bd2a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:14.849866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3833787-8cb4-4d9a-9f21-9a88a53bd2a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:14.850104 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3833787-8cb4-4d9a-9f21-9a88a53bd2a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:14.850420 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3833787-8cb4-4d9a-9f21-9a88a53bd2a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:14.910482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e3c2e-4fd4-41f0-8aec-449be63a5cd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:14.911965 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e3c2e-4fd4-41f0-8aec-449be63a5cd0 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:14.921874 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3833787-8cb4-4d9a-9f21-9a88a53bd2a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:14.922583 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1011/2023] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:14.923525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e3c2e-4fd4-41f0-8aec-449be63a5cd0 service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:14.925814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3833787-8cb4-4d9a-9f21-9a88a53bd2a9 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:14.937030 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e3c2e-4fd4-41f0-8aec-449be63a5cd0 service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:14.941209 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1013/2024] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:14.941939 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9db2bc-ed41-44a2-b7d6-51c4eae3170a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:14.942650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9db2bc-ed41-44a2-b7d6-51c4eae3170a admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:14.942870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9db2bc-ed41-44a2-b7d6-51c4eae3170a admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:14.943152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9db2bc-ed41-44a2-b7d6-51c4eae3170a admin admin] PATH_INFO: `/v3/projects/56aa6deb76ef4f5597400e2c2867af05/users/7844036c89b74f0dae87075b3ee822c1/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:14.943247 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3833787-8cb4-4d9a-9f21-9a88a53bd2a9 service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:14.956081 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3833787-8cb4-4d9a-9f21-9a88a53bd2a9 service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:14.962296 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e928dee-4126-49af-b85e-02a1dfd2fc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:14.962990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e928dee-4126-49af-b85e-02a1dfd2fc76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:14.963273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e928dee-4126-49af-b85e-02a1dfd2fc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:14.963547 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e928dee-4126-49af-b85e-02a1dfd2fc76 admin admin] PATH_INFO: `/v3/projects/84155589c2584c629339233f21cfd33e/users/23f4a1b3138049a3a05fe343ccfd9f58/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:14.966336 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e928dee-4126-49af-b85e-02a1dfd2fc76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84155589c2584c629339233f21cfd33e, user_id=23f4a1b3138049a3a05fe343ccfd9f58, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:14.969049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9db2bc-ed41-44a2-b7d6-51c4eae3170a admin admin] RBAC: Authorizing `identity:create_grant(project_id=56aa6deb76ef4f5597400e2c2867af05, user_id=7844036c89b74f0dae87075b3ee822c1, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:14.969284 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e928dee-4126-49af-b85e-02a1dfd2fc76 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:14.972896 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9db2bc-ed41-44a2-b7d6-51c4eae3170a admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:14.982532 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1014/2025] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:14 2022] PUT /identity/v3/projects/84155589c2584c629339233f21cfd33e/users/23f4a1b3138049a3a05fe343ccfd9f58/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:14.994835 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da68e1-c06e-43da-b747-2ff95e1ad088 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:14.995459 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da68e1-c06e-43da-b747-2ff95e1ad088 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:14.995892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da68e1-c06e-43da-b747-2ff95e1ad088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:15.005005 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1012/2026] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:14 2022] PUT /identity/v3/projects/56aa6deb76ef4f5597400e2c2867af05/users/7844036c89b74f0dae87075b3ee822c1/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:15.006086 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9db2bc-ed41-44a2-b7d6-51c4eae3170a admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:15.047049 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-99da68e1-c06e-43da-b747-2ff95e1ad088 None None] MFA Rules not processed for user `23f4a1b3138049a3a05fe343ccfd9f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:15.048352 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-99da68e1-c06e-43da-b747-2ff95e1ad088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:15.176915 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9db2bc-ed41-44a2-b7d6-51c4eae3170a admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:15.187973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fda56-1e18-462c-b9c9-b887f35ea9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:15.189164 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fda56-1e18-462c-b9c9-b887f35ea9ac admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:15.189521 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fda56-1e18-462c-b9c9-b887f35ea9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:15.189865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fda56-1e18-462c-b9c9-b887f35ea9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:15.192289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0fda56-1e18-462c-b9c9-b887f35ea9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:15.195454 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0fda56-1e18-462c-b9c9-b887f35ea9ac admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:15.214131 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1013/2027] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:15.218571 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fda56-1e18-462c-b9c9-b887f35ea9ac admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:15.220461 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1015/2028] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:15.235126 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da68e1-c06e-43da-b747-2ff95e1ad088 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:15.240620 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fda56-1e18-462c-b9c9-b887f35ea9ac admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:15.249525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58708312-3902-49da-b00c-374109c537a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:15.250427 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58708312-3902-49da-b00c-374109c537a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:15.253122 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58708312-3902-49da-b00c-374109c537a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:15.253122 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58708312-3902-49da-b00c-374109c537a8 admin admin] PATH_INFO: `/v3/projects/56aa6deb76ef4f5597400e2c2867af05/users/7844036c89b74f0dae87075b3ee822c1/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:15.253681 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58708312-3902-49da-b00c-374109c537a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56aa6deb76ef4f5597400e2c2867af05, user_id=7844036c89b74f0dae87075b3ee822c1, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:15.261402 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58708312-3902-49da-b00c-374109c537a8 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:15.281778 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1014/2029] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:15 2022] PUT /identity/v3/projects/56aa6deb76ef4f5597400e2c2867af05/users/7844036c89b74f0dae87075b3ee822c1/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:15.294272 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d017ba-5299-47f6-bf9d-42a1a181ae0e None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:15.294814 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d017ba-5299-47f6-bf9d-42a1a181ae0e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:15.295386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d017ba-5299-47f6-bf9d-42a1a181ae0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:15.299014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:15.307292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:15.337323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-74d017ba-5299-47f6-bf9d-42a1a181ae0e None None] MFA Rules not processed for user `7844036c89b74f0dae87075b3ee822c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:15.338976 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-74d017ba-5299-47f6-bf9d-42a1a181ae0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:15.349335 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da68e1-c06e-43da-b747-2ff95e1ad088 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:15.407561 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528d8e8-8a8a-4c18-b421-6003f8e9e998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:15.408216 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528d8e8-8a8a-4c18-b421-6003f8e9e998 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:15.408500 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528d8e8-8a8a-4c18-b421-6003f8e9e998 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:15.408772 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528d8e8-8a8a-4c18-b421-6003f8e9e998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:15.438523 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1015/2030] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:15.439731 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d017ba-5299-47f6-bf9d-42a1a181ae0e None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:15.492682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528d8e8-8a8a-4c18-b421-6003f8e9e998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:15.494381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528d8e8-8a8a-4c18-b421-6003f8e9e998 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:15.505344 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1016/2031] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:15.506337 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528d8e8-8a8a-4c18-b421-6003f8e9e998 service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:15.511928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d017ba-5299-47f6-bf9d-42a1a181ae0e None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:15.514944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528d8e8-8a8a-4c18-b421-6003f8e9e998 service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:15.518946 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85d5ec-8d97-4fbf-8955-ff45a04ef123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:15.519096 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39caec5-826c-4e11-af45-7ca08aaf5140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:15.519624 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39caec5-826c-4e11-af45-7ca08aaf5140 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:15.519772 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85d5ec-8d97-4fbf-8955-ff45a04ef123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:15.520136 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39caec5-826c-4e11-af45-7ca08aaf5140 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:15.520365 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85d5ec-8d97-4fbf-8955-ff45a04ef123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:15.520528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39caec5-826c-4e11-af45-7ca08aaf5140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:15.521084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85d5ec-8d97-4fbf-8955-ff45a04ef123 admin admin] PATH_INFO: `/v3/users/095b016f76d743ad87d7140a91afe8bf` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:15.522284 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85d5ec-8d97-4fbf-8955-ff45a04ef123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=095b016f76d743ad87d7140a91afe8bf)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:15.525251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85d5ec-8d97-4fbf-8955-ff45a04ef123 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:15.584404 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5f85d5ec-8d97-4fbf-8955-ff45a04ef123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '095b016f76d743ad87d7140a91afe8bf'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:15.588672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39caec5-826c-4e11-af45-7ca08aaf5140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:15.590163 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39caec5-826c-4e11-af45-7ca08aaf5140 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:15.599469 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1017/2032] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:15.620879 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5f85d5ec-8d97-4fbf-8955-ff45a04ef123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '095b016f76d743ad87d7140a91afe8bf'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:15.634148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5f85d5ec-8d97-4fbf-8955-ff45a04ef123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '095b016f76d743ad87d7140a91afe8bf'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:15.665341 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5f85d5ec-8d97-4fbf-8955-ff45a04ef123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '095b016f76d743ad87d7140a91afe8bf'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:15.665341 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5f85d5ec-8d97-4fbf-8955-ff45a04ef123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '095b016f76d743ad87d7140a91afe8bf'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:15.674708 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1016/2033] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:15 2022] DELETE /identity/v3/users/095b016f76d743ad87d7140a91afe8bf => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:15.677159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ff136-0b1d-42e3-a790-1b80a9e35073 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:15.677449 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ff136-0b1d-42e3-a790-1b80a9e35073 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:15.677724 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ff136-0b1d-42e3-a790-1b80a9e35073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:15.713791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a82ff136-0b1d-42e3-a790-1b80a9e35073 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:15.715029 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a82ff136-0b1d-42e3-a790-1b80a9e35073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:15.789551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:15.862971 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1018/2034] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:15.874623 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85d5ec-8d97-4fbf-8955-ff45a04ef123 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:15.876070 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-5f85d5ec-8d97-4fbf-8955-ff45a04ef123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:15.889475 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:15.978135 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85d5ec-8d97-4fbf-8955-ff45a04ef123 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:15.981980 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375c804-f033-4917-977c-421a2d3f19b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:15.982621 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375c804-f033-4917-977c-421a2d3f19b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:15.982883 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375c804-f033-4917-977c-421a2d3f19b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:15.983180 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375c804-f033-4917-977c-421a2d3f19b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:15.993905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375c804-f033-4917-977c-421a2d3f19b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:15.995535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375c804-f033-4917-977c-421a2d3f19b1 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:16.010055 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1017/2035] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:16.112002 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ff136-0b1d-42e3-a790-1b80a9e35073 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:16.113466 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a82ff136-0b1d-42e3-a790-1b80a9e35073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:16.273571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ff136-0b1d-42e3-a790-1b80a9e35073 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:16.281931 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8e867-3ec9-401e-a1ed-95d69c0ddf30 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4a1b3138049a3a05fe343ccfd9f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84155589c2584c629339233f21cfd33e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:16.282782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8e867-3ec9-401e-a1ed-95d69c0ddf30 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:16.283072 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8e867-3ec9-401e-a1ed-95d69c0ddf30 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:16.283355 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8e867-3ec9-401e-a1ed-95d69c0ddf30 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:16.284120 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8e867-3ec9-401e-a1ed-95d69c0ddf30 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:16.284420 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8e867-3ec9-401e-a1ed-95d69c0ddf30 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:16.286384 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8e867-3ec9-401e-a1ed-95d69c0ddf30 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:16.302955 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1019/2036] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:56:16.304931 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375c804-f033-4917-977c-421a2d3f19b1 service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:16.316962 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375c804-f033-4917-977c-421a2d3f19b1 service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:16.326368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcf967-7061-48be-8c38-8a7fd95efd31 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4a1b3138049a3a05fe343ccfd9f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84155589c2584c629339233f21cfd33e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:16.327586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcf967-7061-48be-8c38-8a7fd95efd31 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:16.328202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcf967-7061-48be-8c38-8a7fd95efd31 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:16.328705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcf967-7061-48be-8c38-8a7fd95efd31 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:16.329666 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcf967-7061-48be-8c38-8a7fd95efd31 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:16.333229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcf967-7061-48be-8c38-8a7fd95efd31 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:16.376975 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1018/2037] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:16 2022] POST /identity/v3/projects => generated 354 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:16.381153 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8e867-3ec9-401e-a1ed-95d69c0ddf30 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:16.403176 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8e867-3ec9-401e-a1ed-95d69c0ddf30 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:16.530585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab84c15-70a8-4412-92f6-b21be3977431 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4a1b3138049a3a05fe343ccfd9f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84155589c2584c629339233f21cfd33e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:16.531387 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab84c15-70a8-4412-92f6-b21be3977431 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:16.531672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab84c15-70a8-4412-92f6-b21be3977431 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:16.531974 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab84c15-70a8-4412-92f6-b21be3977431 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:16.533101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab84c15-70a8-4412-92f6-b21be3977431 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:16.533101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab84c15-70a8-4412-92f6-b21be3977431 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:16.534729 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab84c15-70a8-4412-92f6-b21be3977431 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:16.569134 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1020/2038] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:56:16.682076 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcf967-7061-48be-8c38-8a7fd95efd31 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:16.694502 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcf967-7061-48be-8c38-8a7fd95efd31 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:16.702061 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d1715-185c-4182-8378-cdd12bce254d tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4a1b3138049a3a05fe343ccfd9f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84155589c2584c629339233f21cfd33e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:16.703647 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1715-185c-4182-8378-cdd12bce254d tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:16.704089 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1715-185c-4182-8378-cdd12bce254d tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:16.704528 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1715-185c-4182-8378-cdd12bce254d tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] PATH_INFO: `/v3/projects/1b97e0ac6bce43d796e0e2be9fcdcbd0` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:16.706091 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d1715-185c-4182-8378-cdd12bce254d tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1b97e0ac6bce43d796e0e2be9fcdcbd0)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:16.708733 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d1715-185c-4182-8378-cdd12bce254d tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:16.823156 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-133d1715-185c-4182-8378-cdd12bce254d tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b97e0ac6bce43d796e0e2be9fcdcbd0', 'request_id': 'req-133d1715-185c-4182-8378-cdd12bce254d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:16.834266 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-133d1715-185c-4182-8378-cdd12bce254d tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b97e0ac6bce43d796e0e2be9fcdcbd0', 'request_id': 'req-133d1715-185c-4182-8378-cdd12bce254d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:16.845323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-133d1715-185c-4182-8378-cdd12bce254d tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b97e0ac6bce43d796e0e2be9fcdcbd0', 'request_id': 'req-133d1715-185c-4182-8378-cdd12bce254d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:16.846610 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab84c15-70a8-4412-92f6-b21be3977431 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:16.848463 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1ab84c15-70a8-4412-92f6-b21be3977431 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:16.859235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-133d1715-185c-4182-8378-cdd12bce254d tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] The token cache is being invalidate because project 1b97e0ac6bce43d796e0e2be9fcdcbd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:16.859620 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-133d1715-185c-4182-8378-cdd12bce254d tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:16.860203 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-133d1715-185c-4182-8378-cdd12bce254d tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:16.869991 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1019/2039] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:16 2022] DELETE /identity/v3/projects/1b97e0ac6bce43d796e0e2be9fcdcbd0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:16.957967 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab84c15-70a8-4412-92f6-b21be3977431 tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:16.981714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:17.102170 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5a6b2-c5eb-4812-9ed2-7c94fcc238e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:17.103017 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5a6b2-c5eb-4812-9ed2-7c94fcc238e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:17.103402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5a6b2-c5eb-4812-9ed2-7c94fcc238e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:17.103797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5a6b2-c5eb-4812-9ed2-7c94fcc238e1 admin admin] PATH_INFO: `/v3/projects/3bb19b405f43400aba9cbec0e797daba` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:17.105196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5a6b2-c5eb-4812-9ed2-7c94fcc238e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb19b405f43400aba9cbec0e797daba)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:17.107276 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5a6b2-c5eb-4812-9ed2-7c94fcc238e1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:17.139968 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d1715-185c-4182-8378-cdd12bce254d tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:17.141672 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-133d1715-185c-4182-8378-cdd12bce254d tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:17.169642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d1715-185c-4182-8378-cdd12bce254d tempest-VolumeQuotaClassesTest-1228619436 tempest-VolumeQuotaClassesTest-1228619436-project-admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:17.180599 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-46b5a6b2-c5eb-4812-9ed2-7c94fcc238e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb19b405f43400aba9cbec0e797daba', 'request_id': 'req-46b5a6b2-c5eb-4812-9ed2-7c94fcc238e1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:17.187339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-46b5a6b2-c5eb-4812-9ed2-7c94fcc238e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb19b405f43400aba9cbec0e797daba', 'request_id': 'req-46b5a6b2-c5eb-4812-9ed2-7c94fcc238e1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:17.199508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-46b5a6b2-c5eb-4812-9ed2-7c94fcc238e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb19b405f43400aba9cbec0e797daba', 'request_id': 'req-46b5a6b2-c5eb-4812-9ed2-7c94fcc238e1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:17.214188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-46b5a6b2-c5eb-4812-9ed2-7c94fcc238e1 admin admin] The token cache is being invalidate because project 3bb19b405f43400aba9cbec0e797daba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:17.214592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-46b5a6b2-c5eb-4812-9ed2-7c94fcc238e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:17.215485 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-46b5a6b2-c5eb-4812-9ed2-7c94fcc238e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:17.220253 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1021/2040] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:16 2022] DELETE /identity/v3/projects/3bb19b405f43400aba9cbec0e797daba => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:56:17.221217 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5a6b2-c5eb-4812-9ed2-7c94fcc238e1 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:17.223385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-46b5a6b2-c5eb-4812-9ed2-7c94fcc238e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:17.245740 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61820cde-9e3d-4288-b2fa-18a2df8331f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:17.246677 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61820cde-9e3d-4288-b2fa-18a2df8331f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:17.246953 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61820cde-9e3d-4288-b2fa-18a2df8331f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:17.247570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61820cde-9e3d-4288-b2fa-18a2df8331f4 admin admin] PATH_INFO: `/v3/users/c125cfb576884cd09392152e9a9e0b3a` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:17.248753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61820cde-9e3d-4288-b2fa-18a2df8331f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c125cfb576884cd09392152e9a9e0b3a)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:17.250907 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61820cde-9e3d-4288-b2fa-18a2df8331f4 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:17.266712 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:17.308636 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5a6b2-c5eb-4812-9ed2-7c94fcc238e1 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:17.313875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa29f7d-f542-4c6b-91d8-1720217e8b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:17.314532 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa29f7d-f542-4c6b-91d8-1720217e8b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:17.314814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa29f7d-f542-4c6b-91d8-1720217e8b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:17.315089 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa29f7d-f542-4c6b-91d8-1720217e8b87 admin admin] PATH_INFO: `/v3/users/ab3f3cce115d47f6a279b5db9afd2eac` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:17.316359 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa29f7d-f542-4c6b-91d8-1720217e8b87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab3f3cce115d47f6a279b5db9afd2eac)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:17.316655 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-61820cde-9e3d-4288-b2fa-18a2df8331f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c125cfb576884cd09392152e9a9e0b3a'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:17.318812 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa29f7d-f542-4c6b-91d8-1720217e8b87 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:17.330451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-61820cde-9e3d-4288-b2fa-18a2df8331f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c125cfb576884cd09392152e9a9e0b3a'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:17.343854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-61820cde-9e3d-4288-b2fa-18a2df8331f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c125cfb576884cd09392152e9a9e0b3a'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:17.355407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-61820cde-9e3d-4288-b2fa-18a2df8331f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c125cfb576884cd09392152e9a9e0b3a'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:17.356520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-61820cde-9e3d-4288-b2fa-18a2df8331f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c125cfb576884cd09392152e9a9e0b3a'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:17.363882 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1020/2041] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:17 2022] DELETE /identity/v3/users/c125cfb576884cd09392152e9a9e0b3a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:17.364859 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61820cde-9e3d-4288-b2fa-18a2df8331f4 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:17.366608 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-61820cde-9e3d-4288-b2fa-18a2df8331f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:17.386004 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:17.388883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-baa29f7d-f542-4c6b-91d8-1720217e8b87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab3f3cce115d47f6a279b5db9afd2eac'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:17.389613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-baa29f7d-f542-4c6b-91d8-1720217e8b87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab3f3cce115d47f6a279b5db9afd2eac'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:17.400373 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-baa29f7d-f542-4c6b-91d8-1720217e8b87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab3f3cce115d47f6a279b5db9afd2eac'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:17.416912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-baa29f7d-f542-4c6b-91d8-1720217e8b87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab3f3cce115d47f6a279b5db9afd2eac'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:17.417704 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-baa29f7d-f542-4c6b-91d8-1720217e8b87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab3f3cce115d47f6a279b5db9afd2eac'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:17.450973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61820cde-9e3d-4288-b2fa-18a2df8331f4 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:17.452003 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1022/2042] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:17 2022] DELETE /identity/v3/users/ab3f3cce115d47f6a279b5db9afd2eac => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:17.454105 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f223e2-bbde-42cb-a890-0692e3a4de0f None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:17.454459 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f223e2-bbde-42cb-a890-0692e3a4de0f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:17.454741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f223e2-bbde-42cb-a890-0692e3a4de0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:17.502037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-15f223e2-bbde-42cb-a890-0692e3a4de0f None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:17.503714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-15f223e2-bbde-42cb-a890-0692e3a4de0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:17.538156 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb318cc-8523-4c9b-8eb8-16ce425959f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:17.538799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb318cc-8523-4c9b-8eb8-16ce425959f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:17.539087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb318cc-8523-4c9b-8eb8-16ce425959f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:17.539372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb318cc-8523-4c9b-8eb8-16ce425959f8 admin admin] PATH_INFO: `/v3/users/765fba80852c4ef085eb9fdcf8546fab` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:17.540921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb318cc-8523-4c9b-8eb8-16ce425959f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=765fba80852c4ef085eb9fdcf8546fab)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:17.542930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb318cc-8523-4c9b-8eb8-16ce425959f8 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:17.611601 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1023/2043] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:17.635138 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f223e2-bbde-42cb-a890-0692e3a4de0f None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:17.637209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:17.637338 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-15f223e2-bbde-42cb-a890-0692e3a4de0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:17.665755 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-dbb318cc-8523-4c9b-8eb8-16ce425959f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '765fba80852c4ef085eb9fdcf8546fab'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:17.713491 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-dbb318cc-8523-4c9b-8eb8-16ce425959f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '765fba80852c4ef085eb9fdcf8546fab'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:17.767936 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-dbb318cc-8523-4c9b-8eb8-16ce425959f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '765fba80852c4ef085eb9fdcf8546fab'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:17.768310 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f223e2-bbde-42cb-a890-0692e3a4de0f None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:17.784492 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513ab48-d500-4539-b706-f3088b645885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:17.785194 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513ab48-d500-4539-b706-f3088b645885 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:17.785530 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513ab48-d500-4539-b706-f3088b645885 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:17.785809 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513ab48-d500-4539-b706-f3088b645885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:17.800055 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-dbb318cc-8523-4c9b-8eb8-16ce425959f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '765fba80852c4ef085eb9fdcf8546fab'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:17.801039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-dbb318cc-8523-4c9b-8eb8-16ce425959f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '765fba80852c4ef085eb9fdcf8546fab'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:17.805717 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513ab48-d500-4539-b706-f3088b645885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:17.807766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513ab48-d500-4539-b706-f3088b645885 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:17.826389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1024/2044] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:17.847977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1021/2045] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:17 2022] DELETE /identity/v3/users/765fba80852c4ef085eb9fdcf8546fab => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:17.854130 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056d081-4555-48cd-82b2-7e758e7bf5d1 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:17.854982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056d081-4555-48cd-82b2-7e758e7bf5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:17.855266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056d081-4555-48cd-82b2-7e758e7bf5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:17.876258 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb318cc-8523-4c9b-8eb8-16ce425959f8 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:17.877969 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-dbb318cc-8523-4c9b-8eb8-16ce425959f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:17.904226 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b056d081-4555-48cd-82b2-7e758e7bf5d1 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:17.907355 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b056d081-4555-48cd-82b2-7e758e7bf5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:18.025737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb318cc-8523-4c9b-8eb8-16ce425959f8 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:18.035046 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a9ce7-9d05-40e9-bf83-5c3ae39df510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:18.036637 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a9ce7-9d05-40e9-bf83-5c3ae39df510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:18.037092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a9ce7-9d05-40e9-bf83-5c3ae39df510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:18.037650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a9ce7-9d05-40e9-bf83-5c3ae39df510 admin admin] PATH_INFO: `/v3/projects/9e13cfe94f3d4f0f95cc7d6bca2fb68e` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:18.039292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a9ce7-9d05-40e9-bf83-5c3ae39df510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e13cfe94f3d4f0f95cc7d6bca2fb68e)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:18.042274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a9ce7-9d05-40e9-bf83-5c3ae39df510 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:18.107518 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1025/2046] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:56:18.124507 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056d081-4555-48cd-82b2-7e758e7bf5d1 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:18.126752 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b056d081-4555-48cd-82b2-7e758e7bf5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:18.139393 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-371a9ce7-9d05-40e9-bf83-5c3ae39df510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e13cfe94f3d4f0f95cc7d6bca2fb68e', 'request_id': 'req-371a9ce7-9d05-40e9-bf83-5c3ae39df510'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:18.149485 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:18.156830 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-371a9ce7-9d05-40e9-bf83-5c3ae39df510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e13cfe94f3d4f0f95cc7d6bca2fb68e', 'request_id': 'req-371a9ce7-9d05-40e9-bf83-5c3ae39df510'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:18.166006 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-371a9ce7-9d05-40e9-bf83-5c3ae39df510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e13cfe94f3d4f0f95cc7d6bca2fb68e', 'request_id': 'req-371a9ce7-9d05-40e9-bf83-5c3ae39df510'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:18.192871 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-371a9ce7-9d05-40e9-bf83-5c3ae39df510 admin admin] The token cache is being invalidate because project 9e13cfe94f3d4f0f95cc7d6bca2fb68e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:18.193200 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-371a9ce7-9d05-40e9-bf83-5c3ae39df510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:18.193924 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-371a9ce7-9d05-40e9-bf83-5c3ae39df510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:18.196119 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1022/2047] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:17 2022] DELETE /identity/v3/projects/9e13cfe94f3d4f0f95cc7d6bca2fb68e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:56:18.200858 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d03d3-2508-4b9b-b39d-084747a9b323 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:18.201176 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d03d3-2508-4b9b-b39d-084747a9b323 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:18.201459 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d03d3-2508-4b9b-b39d-084747a9b323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:18.234464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056d081-4555-48cd-82b2-7e758e7bf5d1 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:18.249016 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-7b0d03d3-2508-4b9b-b39d-084747a9b323 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:18.250859 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-7b0d03d3-2508-4b9b-b39d-084747a9b323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:18.309849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b0ce7-652b-492b-923d-339a2596c3b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:18.310461 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b0ce7-652b-492b-923d-339a2596c3b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:18.310742 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b0ce7-652b-492b-923d-339a2596c3b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:18.311030 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b0ce7-652b-492b-923d-339a2596c3b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:18.313936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9a3b0ce7-652b-492b-923d-339a2596c3b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:18.347627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:18.394451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1023/2048] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:18.396497 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c2dd8-2fbc-4b21-b6d9-de688016331a None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:18.396784 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c2dd8-2fbc-4b21-b6d9-de688016331a None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:18.397131 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c2dd8-2fbc-4b21-b6d9-de688016331a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:18.425232 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b0ce7-652b-492b-923d-339a2596c3b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:18.427893 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-d88c2dd8-2fbc-4b21-b6d9-de688016331a None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:18.428522 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b0ce7-652b-492b-923d-339a2596c3b8 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:18.429371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-d88c2dd8-2fbc-4b21-b6d9-de688016331a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:18.446653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1024/2049] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:18.453161 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c2dd8-2fbc-4b21-b6d9-de688016331a None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:18.453954 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1026/2050] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:56:18.483261 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c2dd8-2fbc-4b21-b6d9-de688016331a None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:18.495945 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae932743-b981-4b19-bf3b-8e66e323af59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:18.496717 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae932743-b981-4b19-bf3b-8e66e323af59 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:18.497375 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae932743-b981-4b19-bf3b-8e66e323af59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:18.497624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae932743-b981-4b19-bf3b-8e66e323af59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:18.498365 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae932743-b981-4b19-bf3b-8e66e323af59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:18.498690 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae932743-b981-4b19-bf3b-8e66e323af59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:18.500345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae932743-b981-4b19-bf3b-8e66e323af59 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:18.545898 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1025/2051] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:56:18.550300 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b0ce7-652b-492b-923d-339a2596c3b8 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:18.588068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b0ce7-652b-492b-923d-339a2596c3b8 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:18.601275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c19e45-e6bb-4a8b-b104-0ec4e9ec81b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:18.602887 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c19e45-e6bb-4a8b-b104-0ec4e9ec81b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:18.603271 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c19e45-e6bb-4a8b-b104-0ec4e9ec81b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:18.603550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c19e45-e6bb-4a8b-b104-0ec4e9ec81b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:18.605149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c19e45-e6bb-4a8b-b104-0ec4e9ec81b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:18.607766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c19e45-e6bb-4a8b-b104-0ec4e9ec81b2 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:18.637748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae932743-b981-4b19-bf3b-8e66e323af59 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:18.640439 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ae932743-b981-4b19-bf3b-8e66e323af59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:18.651538 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1027/2052] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:18 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:56:18.658075 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c19e45-e6bb-4a8b-b104-0ec4e9ec81b2 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:18.662603 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae932743-b981-4b19-bf3b-8e66e323af59 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:18.760635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:18.782715 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c19e45-e6bb-4a8b-b104-0ec4e9ec81b2 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:18.789955 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84140e6-35d1-4e91-87ec-289c43f96178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:18.790846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84140e6-35d1-4e91-87ec-289c43f96178 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:18.791447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84140e6-35d1-4e91-87ec-289c43f96178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:18.791929 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84140e6-35d1-4e91-87ec-289c43f96178 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:18.792824 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84140e6-35d1-4e91-87ec-289c43f96178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:18.795632 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84140e6-35d1-4e91-87ec-289c43f96178 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:18.798817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760bf0b-7819-49ad-aa84-5c87b2c54907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:18.798817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760bf0b-7819-49ad-aa84-5c87b2c54907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:18.799095 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760bf0b-7819-49ad-aa84-5c87b2c54907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:18.799326 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760bf0b-7819-49ad-aa84-5c87b2c54907 admin admin] PATH_INFO: `/v3/projects/7960594839eb42e8939f4d7fcd01d47e` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:18.804522 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760bf0b-7819-49ad-aa84-5c87b2c54907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7960594839eb42e8939f4d7fcd01d47e)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:18.808498 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760bf0b-7819-49ad-aa84-5c87b2c54907 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:18.849241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1028/2053] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:18 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:56:18.860758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84140e6-35d1-4e91-87ec-289c43f96178 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:18.875902 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84140e6-35d1-4e91-87ec-289c43f96178 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:18.881766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb82b4-f10d-4db5-90ea-3fc38d248b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:18.882509 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb82b4-f10d-4db5-90ea-3fc38d248b72 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:18.882846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb82b4-f10d-4db5-90ea-3fc38d248b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:18.883145 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb82b4-f10d-4db5-90ea-3fc38d248b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:18.883994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb82b4-f10d-4db5-90ea-3fc38d248b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:18.885908 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb82b4-f10d-4db5-90ea-3fc38d248b72 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:18.904599 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1029/2054] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:18.906373 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb82b4-f10d-4db5-90ea-3fc38d248b72 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:18.919906 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb82b4-f10d-4db5-90ea-3fc38d248b72 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:18.928088 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2608a-1cee-4681-ba5a-7250a0e04897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:18.928458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2608a-1cee-4681-ba5a-7250a0e04897 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:18.929142 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2608a-1cee-4681-ba5a-7250a0e04897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:18.929418 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2608a-1cee-4681-ba5a-7250a0e04897 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:18.930338 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2608a-1cee-4681-ba5a-7250a0e04897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:18.932255 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2608a-1cee-4681-ba5a-7250a0e04897 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:18.965972 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1030/2055] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:56:18.974805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2608a-1cee-4681-ba5a-7250a0e04897 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:18.989196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2608a-1cee-4681-ba5a-7250a0e04897 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:19.005470 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c760bf0b-7819-49ad-aa84-5c87b2c54907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7960594839eb42e8939f4d7fcd01d47e', 'request_id': 'req-c760bf0b-7819-49ad-aa84-5c87b2c54907'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.026234 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c760bf0b-7819-49ad-aa84-5c87b2c54907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7960594839eb42e8939f4d7fcd01d47e', 'request_id': 'req-c760bf0b-7819-49ad-aa84-5c87b2c54907'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.039152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c760bf0b-7819-49ad-aa84-5c87b2c54907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7960594839eb42e8939f4d7fcd01d47e', 'request_id': 'req-c760bf0b-7819-49ad-aa84-5c87b2c54907'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.065597 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c760bf0b-7819-49ad-aa84-5c87b2c54907 admin admin] The token cache is being invalidate because project 7960594839eb42e8939f4d7fcd01d47e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:19.065889 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c760bf0b-7819-49ad-aa84-5c87b2c54907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.068787 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c760bf0b-7819-49ad-aa84-5c87b2c54907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.070866 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1026/2056] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:18 2022] DELETE /identity/v3/projects/7960594839eb42e8939f4d7fcd01d47e => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:19.075202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760bf0b-7819-49ad-aa84-5c87b2c54907 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:19.079008 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-c760bf0b-7819-49ad-aa84-5c87b2c54907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:19.118188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6f606-cdca-45a0-8210-90dbe65a010b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:19.119715 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6f606-cdca-45a0-8210-90dbe65a010b admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:19.120140 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6f606-cdca-45a0-8210-90dbe65a010b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:19.120482 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6f606-cdca-45a0-8210-90dbe65a010b admin admin] PATH_INFO: `/v3/projects/d99471b06bab4181a4c15d17630ad322/users/113c75481e3d4272af7b3fe8c1acd58d/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:19.143182 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6f606-cdca-45a0-8210-90dbe65a010b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d99471b06bab4181a4c15d17630ad322, user_id=113c75481e3d4272af7b3fe8c1acd58d, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:19.146371 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6f606-cdca-45a0-8210-90dbe65a010b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:19.175087 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1031/2057] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:18 2022] PUT /identity/v3/projects/d99471b06bab4181a4c15d17630ad322/users/113c75481e3d4272af7b3fe8c1acd58d/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:19.176251 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6f606-cdca-45a0-8210-90dbe65a010b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:19.179510 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-76f6f606-cdca-45a0-8210-90dbe65a010b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:19.190618 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:19.196545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760bf0b-7819-49ad-aa84-5c87b2c54907 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:19.279435 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c5acc-ab2a-4148-bf40-0f6ece83b4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:19.280418 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c5acc-ab2a-4148-bf40-0f6ece83b4b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:19.280866 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c5acc-ab2a-4148-bf40-0f6ece83b4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:19.281407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c5acc-ab2a-4148-bf40-0f6ece83b4b0 admin admin] PATH_INFO: `/v3/users/23f4a1b3138049a3a05fe343ccfd9f58` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:19.282805 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c5acc-ab2a-4148-bf40-0f6ece83b4b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f4a1b3138049a3a05fe343ccfd9f58)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:19.285104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c5acc-ab2a-4148-bf40-0f6ece83b4b0 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:19.296422 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6f606-cdca-45a0-8210-90dbe65a010b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:19.302782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec852d-241a-4e97-91d3-ecbb467b825a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:19.303719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec852d-241a-4e97-91d3-ecbb467b825a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:19.304089 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec852d-241a-4e97-91d3-ecbb467b825a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:19.304856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec852d-241a-4e97-91d3-ecbb467b825a admin admin] PATH_INFO: `/v3/projects/c08eb44f6d8a49a4aff91220df0c38ed` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:19.306335 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec852d-241a-4e97-91d3-ecbb467b825a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c08eb44f6d8a49a4aff91220df0c38ed)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:19.308866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec852d-241a-4e97-91d3-ecbb467b825a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:19.369085 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-182c5acc-ab2a-4148-bf40-0f6ece83b4b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f4a1b3138049a3a05fe343ccfd9f58'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.395625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:19.404209 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fbec852d-241a-4e97-91d3-ecbb467b825a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c08eb44f6d8a49a4aff91220df0c38ed', 'request_id': 'req-fbec852d-241a-4e97-91d3-ecbb467b825a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.407847 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-182c5acc-ab2a-4148-bf40-0f6ece83b4b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f4a1b3138049a3a05fe343ccfd9f58'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.427312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fbec852d-241a-4e97-91d3-ecbb467b825a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c08eb44f6d8a49a4aff91220df0c38ed', 'request_id': 'req-fbec852d-241a-4e97-91d3-ecbb467b825a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.431307 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-182c5acc-ab2a-4148-bf40-0f6ece83b4b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f4a1b3138049a3a05fe343ccfd9f58'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.441716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fbec852d-241a-4e97-91d3-ecbb467b825a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c08eb44f6d8a49a4aff91220df0c38ed', 'request_id': 'req-fbec852d-241a-4e97-91d3-ecbb467b825a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.447926 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-182c5acc-ab2a-4148-bf40-0f6ece83b4b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f4a1b3138049a3a05fe343ccfd9f58'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.448781 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-182c5acc-ab2a-4148-bf40-0f6ece83b4b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f4a1b3138049a3a05fe343ccfd9f58'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.457813 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1027/2058] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:19 2022] DELETE /identity/v3/users/23f4a1b3138049a3a05fe343ccfd9f58 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:19.457963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fbec852d-241a-4e97-91d3-ecbb467b825a admin admin] The token cache is being invalidate because project c08eb44f6d8a49a4aff91220df0c38ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:19.459026 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fbec852d-241a-4e97-91d3-ecbb467b825a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.459326 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e599837-2e9a-4a3a-b8b6-2235c60cff92 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:19.459626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e599837-2e9a-4a3a-b8b6-2235c60cff92 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:19.459827 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fbec852d-241a-4e97-91d3-ecbb467b825a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.459930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e599837-2e9a-4a3a-b8b6-2235c60cff92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:19.461862 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1032/2059] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:19 2022] DELETE /identity/v3/projects/c08eb44f6d8a49a4aff91220df0c38ed => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:19.465764 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec852d-241a-4e97-91d3-ecbb467b825a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:19.467394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fbec852d-241a-4e97-91d3-ecbb467b825a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:19.499932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-6e599837-2e9a-4a3a-b8b6-2235c60cff92 None None] MFA Rules not processed for user `113c75481e3d4272af7b3fe8c1acd58d`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:19.501408 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6e599837-2e9a-4a3a-b8b6-2235c60cff92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:19.573591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec852d-241a-4e97-91d3-ecbb467b825a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:19.611046 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1028/2060] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:19.630033 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e599837-2e9a-4a3a-b8b6-2235c60cff92 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:19.632565 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6e599837-2e9a-4a3a-b8b6-2235c60cff92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:19.658871 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:19.671930 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ef868-36a0-4f73-bd12-d0a6f2bd9d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:19.687833 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ef868-36a0-4f73-bd12-d0a6f2bd9d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:19.688305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ef868-36a0-4f73-bd12-d0a6f2bd9d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:19.689269 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ef868-36a0-4f73-bd12-d0a6f2bd9d63 admin admin] PATH_INFO: `/v3/users/9ea2a862b2bc4a3caf9428aac84950a9` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:19.690152 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ef868-36a0-4f73-bd12-d0a6f2bd9d63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ea2a862b2bc4a3caf9428aac84950a9)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:19.692115 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ef868-36a0-4f73-bd12-d0a6f2bd9d63 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:19.718251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e599837-2e9a-4a3a-b8b6-2235c60cff92 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:19.725563 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06798619-7a2c-44dc-b7ed-bd1cffe28b82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:19.726417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06798619-7a2c-44dc-b7ed-bd1cffe28b82 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:19.727012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06798619-7a2c-44dc-b7ed-bd1cffe28b82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:19.727012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06798619-7a2c-44dc-b7ed-bd1cffe28b82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:19.738792 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06798619-7a2c-44dc-b7ed-bd1cffe28b82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:19.740560 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06798619-7a2c-44dc-b7ed-bd1cffe28b82 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:19.751382 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1029/2061] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:56:19.773490 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6b3ef868-36a0-4f73-bd12-d0a6f2bd9d63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ea2a862b2bc4a3caf9428aac84950a9'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.773490 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6b3ef868-36a0-4f73-bd12-d0a6f2bd9d63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ea2a862b2bc4a3caf9428aac84950a9'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.773490 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6b3ef868-36a0-4f73-bd12-d0a6f2bd9d63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ea2a862b2bc4a3caf9428aac84950a9'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.778362 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06798619-7a2c-44dc-b7ed-bd1cffe28b82 service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:19.779590 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-06798619-7a2c-44dc-b7ed-bd1cffe28b82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:19.799318 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06798619-7a2c-44dc-b7ed-bd1cffe28b82 service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:19.804836 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ea594-8d69-4489-9aca-4eb37aa3eca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:19.805766 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ea594-8d69-4489-9aca-4eb37aa3eca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:19.806326 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ea594-8d69-4489-9aca-4eb37aa3eca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:19.806693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ea594-8d69-4489-9aca-4eb37aa3eca5 admin admin] PATH_INFO: `/v3/users/113c75481e3d4272af7b3fe8c1acd58d` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:19.807998 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ea594-8d69-4489-9aca-4eb37aa3eca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=113c75481e3d4272af7b3fe8c1acd58d)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:19.810234 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ea594-8d69-4489-9aca-4eb37aa3eca5 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:19.813454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6b3ef868-36a0-4f73-bd12-d0a6f2bd9d63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ea2a862b2bc4a3caf9428aac84950a9'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.814652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6b3ef868-36a0-4f73-bd12-d0a6f2bd9d63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ea2a862b2bc4a3caf9428aac84950a9'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.831031 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:19.844922 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1033/2062] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:19 2022] DELETE /identity/v3/users/9ea2a862b2bc4a3caf9428aac84950a9 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:19.860636 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ef868-36a0-4f73-bd12-d0a6f2bd9d63 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:19.862369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6b3ef868-36a0-4f73-bd12-d0a6f2bd9d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:19.884747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4b6ea594-8d69-4489-9aca-4eb37aa3eca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113c75481e3d4272af7b3fe8c1acd58d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.904855 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4b6ea594-8d69-4489-9aca-4eb37aa3eca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113c75481e3d4272af7b3fe8c1acd58d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.921038 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4b6ea594-8d69-4489-9aca-4eb37aa3eca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113c75481e3d4272af7b3fe8c1acd58d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.944053 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4b6ea594-8d69-4489-9aca-4eb37aa3eca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113c75481e3d4272af7b3fe8c1acd58d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.945560 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4b6ea594-8d69-4489-9aca-4eb37aa3eca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113c75481e3d4272af7b3fe8c1acd58d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:19.971980 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1030/2063] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:19 2022] DELETE /identity/v3/users/113c75481e3d4272af7b3fe8c1acd58d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:19.971980 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ea594-8d69-4489-9aca-4eb37aa3eca5 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:19.974235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-4b6ea594-8d69-4489-9aca-4eb37aa3eca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:19.980460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ef868-36a0-4f73-bd12-d0a6f2bd9d63 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:20.093471 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd50eb8-ba37-41f5-a84f-adae434b6008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:20.094299 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd50eb8-ba37-41f5-a84f-adae434b6008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:20.094676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd50eb8-ba37-41f5-a84f-adae434b6008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:20.095051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd50eb8-ba37-41f5-a84f-adae434b6008 admin admin] PATH_INFO: `/v3/users/a73fc7895dd142a7a89da7cf83bb629e` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:20.096684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd50eb8-ba37-41f5-a84f-adae434b6008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73fc7895dd142a7a89da7cf83bb629e)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:20.101130 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd50eb8-ba37-41f5-a84f-adae434b6008 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:20.112035 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ea594-8d69-4489-9aca-4eb37aa3eca5 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:20.118513 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58319297-1939-45f0-a8bc-9717c203fa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:20.119183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58319297-1939-45f0-a8bc-9717c203fa1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:20.119468 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58319297-1939-45f0-a8bc-9717c203fa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:20.121149 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58319297-1939-45f0-a8bc-9717c203fa1e admin admin] PATH_INFO: `/v3/projects/84155589c2584c629339233f21cfd33e` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:20.122719 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58319297-1939-45f0-a8bc-9717c203fa1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=84155589c2584c629339233f21cfd33e)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:20.124650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58319297-1939-45f0-a8bc-9717c203fa1e admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:20.173001 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:20.181463 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fbd50eb8-ba37-41f5-a84f-adae434b6008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73fc7895dd142a7a89da7cf83bb629e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:20.182181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fbd50eb8-ba37-41f5-a84f-adae434b6008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73fc7895dd142a7a89da7cf83bb629e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:20.191183 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fbd50eb8-ba37-41f5-a84f-adae434b6008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73fc7895dd142a7a89da7cf83bb629e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:20.196971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-58319297-1939-45f0-a8bc-9717c203fa1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84155589c2584c629339233f21cfd33e', 'request_id': 'req-58319297-1939-45f0-a8bc-9717c203fa1e'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:20.208047 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-58319297-1939-45f0-a8bc-9717c203fa1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84155589c2584c629339233f21cfd33e', 'request_id': 'req-58319297-1939-45f0-a8bc-9717c203fa1e'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:20.208298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fbd50eb8-ba37-41f5-a84f-adae434b6008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73fc7895dd142a7a89da7cf83bb629e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:20.209285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fbd50eb8-ba37-41f5-a84f-adae434b6008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73fc7895dd142a7a89da7cf83bb629e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:20.219092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-58319297-1939-45f0-a8bc-9717c203fa1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84155589c2584c629339233f21cfd33e', 'request_id': 'req-58319297-1939-45f0-a8bc-9717c203fa1e'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:20.230373 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1034/2064] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:19 2022] DELETE /identity/v3/users/a73fc7895dd142a7a89da7cf83bb629e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:20.232036 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116fde-5fa1-41a6-97c9-200e7c8b5796 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:20.232336 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116fde-5fa1-41a6-97c9-200e7c8b5796 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:20.232612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116fde-5fa1-41a6-97c9-200e7c8b5796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:20.238428 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-58319297-1939-45f0-a8bc-9717c203fa1e admin admin] The token cache is being invalidate because project 84155589c2584c629339233f21cfd33e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:20.238715 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-58319297-1939-45f0-a8bc-9717c203fa1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:20.241211 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-58319297-1939-45f0-a8bc-9717c203fa1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:20.245138 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1031/2065] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:19 2022] DELETE /identity/v3/projects/84155589c2584c629339233f21cfd33e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:20.247509 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0890dfb-0586-4eef-9f0b-231f212da16c None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:20.247813 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0890dfb-0586-4eef-9f0b-231f212da16c None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:20.248096 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0890dfb-0586-4eef-9f0b-231f212da16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:20.259546 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-99116fde-5fa1-41a6-97c9-200e7c8b5796 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:20.261224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-99116fde-5fa1-41a6-97c9-200e7c8b5796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:20.277640 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-d0890dfb-0586-4eef-9f0b-231f212da16c None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:20.279771 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-d0890dfb-0586-4eef-9f0b-231f212da16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:20.285183 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:20.349020 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1032/2066] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:20.350235 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1035/2067] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:20.351467 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99116fde-5fa1-41a6-97c9-200e7c8b5796 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:20.353257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-99116fde-5fa1-41a6-97c9-200e7c8b5796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:20.353979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab26f3d-4ea2-405c-a156-e8111612c911 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:20.354357 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab26f3d-4ea2-405c-a156-e8111612c911 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:20.354725 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab26f3d-4ea2-405c-a156-e8111612c911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:20.368039 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99116fde-5fa1-41a6-97c9-200e7c8b5796 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:20.378586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-4ab26f3d-4ea2-405c-a156-e8111612c911 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:20.379823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-4ab26f3d-4ea2-405c-a156-e8111612c911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:20.381210 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03054c-96ba-4f8e-8f2e-e1bb54703144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:20.381875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03054c-96ba-4f8e-8f2e-e1bb54703144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:20.382153 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03054c-96ba-4f8e-8f2e-e1bb54703144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:20.382543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03054c-96ba-4f8e-8f2e-e1bb54703144 admin admin] PATH_INFO: `/v3/projects/2c5666e4f3ab4e4999351e772418707f` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:20.384250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03054c-96ba-4f8e-8f2e-e1bb54703144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c5666e4f3ab4e4999351e772418707f)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:20.386261 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03054c-96ba-4f8e-8f2e-e1bb54703144 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:20.407488 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1033/2068] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:20.407488 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab26f3d-4ea2-405c-a156-e8111612c911 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:20.407488 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-4ab26f3d-4ea2-405c-a156-e8111612c911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:20.492320 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fb03054c-96ba-4f8e-8f2e-e1bb54703144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c5666e4f3ab4e4999351e772418707f', 'request_id': 'req-fb03054c-96ba-4f8e-8f2e-e1bb54703144'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:20.499537 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab26f3d-4ea2-405c-a156-e8111612c911 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:20.510721 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fb03054c-96ba-4f8e-8f2e-e1bb54703144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c5666e4f3ab4e4999351e772418707f', 'request_id': 'req-fb03054c-96ba-4f8e-8f2e-e1bb54703144'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:20.524705 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fb03054c-96ba-4f8e-8f2e-e1bb54703144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c5666e4f3ab4e4999351e772418707f', 'request_id': 'req-fb03054c-96ba-4f8e-8f2e-e1bb54703144'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:20.565025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fb03054c-96ba-4f8e-8f2e-e1bb54703144 admin admin] The token cache is being invalidate because project 2c5666e4f3ab4e4999351e772418707f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:20.565362 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fb03054c-96ba-4f8e-8f2e-e1bb54703144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:20.566740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fb03054c-96ba-4f8e-8f2e-e1bb54703144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:20.572541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1036/2069] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:20 2022] DELETE /identity/v3/projects/2c5666e4f3ab4e4999351e772418707f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:20.573875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03054c-96ba-4f8e-8f2e-e1bb54703144 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:20.576158 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fb03054c-96ba-4f8e-8f2e-e1bb54703144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:20.586571 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb1d05-437a-4e39-9326-e192ece94829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:20.587537 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb1d05-437a-4e39-9326-e192ece94829 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:20.587821 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb1d05-437a-4e39-9326-e192ece94829 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:20.588099 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb1d05-437a-4e39-9326-e192ece94829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:20.590281 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b4fb1d05-437a-4e39-9326-e192ece94829 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:20.618809 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:20.686845 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03054c-96ba-4f8e-8f2e-e1bb54703144 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:20.692133 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dab104-8a00-484b-b580-8c7904075fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:20.692765 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dab104-8a00-484b-b580-8c7904075fbb service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:20.693047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dab104-8a00-484b-b580-8c7904075fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:20.693348 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dab104-8a00-484b-b580-8c7904075fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:20.695957 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c2dab104-8a00-484b-b580-8c7904075fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:20.701770 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb1d05-437a-4e39-9326-e192ece94829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:20.703307 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb1d05-437a-4e39-9326-e192ece94829 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:20.710675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dab104-8a00-484b-b580-8c7904075fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:20.712558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dab104-8a00-484b-b580-8c7904075fbb service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:20.715138 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1034/2070] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:20.717765 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a765e4-ddd3-4b84-bb48-1b097db20c98 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:20.718236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a765e4-ddd3-4b84-bb48-1b097db20c98 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:20.718704 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a765e4-ddd3-4b84-bb48-1b097db20c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:20.724012 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1037/2071] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:20.725600 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0b81a-dd35-4262-b76c-b3a68bf0f244 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:20.726122 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0b81a-dd35-4262-b76c-b3a68bf0f244 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:20.726814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0b81a-dd35-4262-b76c-b3a68bf0f244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:20.743507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-89a765e4-ddd3-4b84-bb48-1b097db20c98 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:20.745142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-89a765e4-ddd3-4b84-bb48-1b097db20c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:20.752524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-8ce0b81a-dd35-4262-b76c-b3a68bf0f244 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:20.753851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8ce0b81a-dd35-4262-b76c-b3a68bf0f244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:20.755746 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1035/2072] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:20.756666 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a765e4-ddd3-4b84-bb48-1b097db20c98 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:20.759982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-89a765e4-ddd3-4b84-bb48-1b097db20c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:20.767014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1038/2073] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:20.774906 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0b81a-dd35-4262-b76c-b3a68bf0f244 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:20.803496 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0b81a-dd35-4262-b76c-b3a68bf0f244 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:20.815369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02320630-05dc-443e-aa31-51d5d0c55707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:20.817589 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02320630-05dc-443e-aa31-51d5d0c55707 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:20.818447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02320630-05dc-443e-aa31-51d5d0c55707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:20.819403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02320630-05dc-443e-aa31-51d5d0c55707 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:20.822417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02320630-05dc-443e-aa31-51d5d0c55707 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:20.823009 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02320630-05dc-443e-aa31-51d5d0c55707 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:20.826347 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02320630-05dc-443e-aa31-51d5d0c55707 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:20.850815 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1039/2074] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:56:20.850815 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff299c-2b33-4913-8cb0-760a6cb30621 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:20.850815 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff299c-2b33-4913-8cb0-760a6cb30621 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:20.851245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff299c-2b33-4913-8cb0-760a6cb30621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:20.857508 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a765e4-ddd3-4b84-bb48-1b097db20c98 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:20.866657 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6542f-bebc-4d83-ae16-c5910383516c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:20.867621 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6542f-bebc-4d83-ae16-c5910383516c service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:20.867971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6542f-bebc-4d83-ae16-c5910383516c service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:20.868281 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6542f-bebc-4d83-ae16-c5910383516c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:20.880216 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-fbc6542f-bebc-4d83-ae16-c5910383516c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:20.881537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d7ff299c-2b33-4913-8cb0-760a6cb30621 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:20.883294 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d7ff299c-2b33-4913-8cb0-760a6cb30621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:20.898526 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1040/2075] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:20.898526 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff299c-2b33-4913-8cb0-760a6cb30621 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:20.905994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff299c-2b33-4913-8cb0-760a6cb30621 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:20.911266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7d834-33c1-4d07-a9c1-914db422718d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:20.912451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7d834-33c1-4d07-a9c1-914db422718d admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:20.912451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7d834-33c1-4d07-a9c1-914db422718d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:20.912726 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7d834-33c1-4d07-a9c1-914db422718d admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:20.913245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7d834-33c1-4d07-a9c1-914db422718d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:20.915817 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7d834-33c1-4d07-a9c1-914db422718d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:20.958686 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1041/2076] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:20 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:20.978239 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7d834-33c1-4d07-a9c1-914db422718d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:21.003542 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6542f-bebc-4d83-ae16-c5910383516c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:21.004310 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:21.008538 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6542f-bebc-4d83-ae16-c5910383516c service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:21.044613 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1036/2077] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:21.046414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6542f-bebc-4d83-ae16-c5910383516c service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:21.085110 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6542f-bebc-4d83-ae16-c5910383516c service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:21.154450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7d834-33c1-4d07-a9c1-914db422718d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:21.170267 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086170b-e4ad-4142-8e81-6f2190f738da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:21.171105 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086170b-e4ad-4142-8e81-6f2190f738da admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:21.171511 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086170b-e4ad-4142-8e81-6f2190f738da admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:21.171750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086170b-e4ad-4142-8e81-6f2190f738da admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:21.172458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086170b-e4ad-4142-8e81-6f2190f738da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:21.172765 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086170b-e4ad-4142-8e81-6f2190f738da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:21.174854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086170b-e4ad-4142-8e81-6f2190f738da admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:21.205633 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1042/2078] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:56:21.208127 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086170b-e4ad-4142-8e81-6f2190f738da admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:21.211117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd0959-32b7-4139-bc54-2082ab47a27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:21.212859 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd0959-32b7-4139-bc54-2082ab47a27d admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:21.213167 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd0959-32b7-4139-bc54-2082ab47a27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:21.213466 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd0959-32b7-4139-bc54-2082ab47a27d admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:21.214145 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd0959-32b7-4139-bc54-2082ab47a27d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:21.222458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd0959-32b7-4139-bc54-2082ab47a27d admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:21.231271 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086170b-e4ad-4142-8e81-6f2190f738da admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:21.245290 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db27f8f-77ed-495e-97ec-f094c4a3df95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:21.245807 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db27f8f-77ed-495e-97ec-f094c4a3df95 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:21.246088 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db27f8f-77ed-495e-97ec-f094c4a3df95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:21.246363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db27f8f-77ed-495e-97ec-f094c4a3df95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:21.247379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db27f8f-77ed-495e-97ec-f094c4a3df95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:21.249329 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db27f8f-77ed-495e-97ec-f094c4a3df95 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:21.251949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:21.273324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1037/2079] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:21 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:21.278085 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd0959-32b7-4139-bc54-2082ab47a27d admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:21.306141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd0959-32b7-4139-bc54-2082ab47a27d admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:21.312997 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86956a-42a2-4a12-81b4-321ac8f38cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:21.313916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86956a-42a2-4a12-81b4-321ac8f38cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:21.314251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86956a-42a2-4a12-81b4-321ac8f38cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:21.314636 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86956a-42a2-4a12-81b4-321ac8f38cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:21.315694 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86956a-42a2-4a12-81b4-321ac8f38cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:21.315805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1043/2080] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:21 2022] POST /identity/v3/projects => generated 405 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:21.317547 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86956a-42a2-4a12-81b4-321ac8f38cd2 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:21.320300 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db27f8f-77ed-495e-97ec-f094c4a3df95 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:21.346709 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1038/2081] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:56:21.348378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86956a-42a2-4a12-81b4-321ac8f38cd2 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:21.390693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86956a-42a2-4a12-81b4-321ac8f38cd2 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:21.489900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db27f8f-77ed-495e-97ec-f094c4a3df95 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:21.497487 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ffabd-1206-4489-821a-4bf10b89a69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:21.498371 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ffabd-1206-4489-821a-4bf10b89a69e admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:21.498836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ffabd-1206-4489-821a-4bf10b89a69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:21.499262 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ffabd-1206-4489-821a-4bf10b89a69e admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:21.500586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ffabd-1206-4489-821a-4bf10b89a69e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:21.502788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ffabd-1206-4489-821a-4bf10b89a69e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:21.542133 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1044/2082] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:21 2022] POST /identity/v3/users => generated 303 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:56:21.543267 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ffabd-1206-4489-821a-4bf10b89a69e admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:21.546620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-924ffabd-1206-4489-821a-4bf10b89a69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:21.562094 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e6d3f-a331-4401-b5ac-eebc2adc2d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:21.562747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e6d3f-a331-4401-b5ac-eebc2adc2d96 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:21.563023 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e6d3f-a331-4401-b5ac-eebc2adc2d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:21.563300 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e6d3f-a331-4401-b5ac-eebc2adc2d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:21.563598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ffabd-1206-4489-821a-4bf10b89a69e admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:21.563993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e6d3f-a331-4401-b5ac-eebc2adc2d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:21.569769 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1b6ca-f91e-4f48-bc1a-617558b5ce93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:21.570563 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e6d3f-a331-4401-b5ac-eebc2adc2d96 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:21.571172 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1b6ca-f91e-4f48-bc1a-617558b5ce93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:21.571660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1b6ca-f91e-4f48-bc1a-617558b5ce93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:21.572228 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1b6ca-f91e-4f48-bc1a-617558b5ce93 admin admin] PATH_INFO: `/v3/projects/03df4d79d7e04b7f9c8a2ef97588b582` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:21.573702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1b6ca-f91e-4f48-bc1a-617558b5ce93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03df4d79d7e04b7f9c8a2ef97588b582)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:21.576131 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1b6ca-f91e-4f48-bc1a-617558b5ce93 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:21.601388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1039/2083] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:21.602828 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e6d3f-a331-4401-b5ac-eebc2adc2d96 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:21.605997 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-d66e6d3f-a331-4401-b5ac-eebc2adc2d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:21.623791 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e6d3f-a331-4401-b5ac-eebc2adc2d96 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:21.631049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eea907-c769-4dda-8cae-e09aa012bb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:21.632105 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eea907-c769-4dda-8cae-e09aa012bb4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:21.637556 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eea907-c769-4dda-8cae-e09aa012bb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:21.637920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eea907-c769-4dda-8cae-e09aa012bb4e admin admin] PATH_INFO: `/v3/projects/d99471b06bab4181a4c15d17630ad322` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:21.639863 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eea907-c769-4dda-8cae-e09aa012bb4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d99471b06bab4181a4c15d17630ad322)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:21.642161 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eea907-c769-4dda-8cae-e09aa012bb4e admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:21.649962 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a1d1b6ca-f91e-4f48-bc1a-617558b5ce93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03df4d79d7e04b7f9c8a2ef97588b582', 'request_id': 'req-a1d1b6ca-f91e-4f48-bc1a-617558b5ce93'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:21.674166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a1d1b6ca-f91e-4f48-bc1a-617558b5ce93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03df4d79d7e04b7f9c8a2ef97588b582', 'request_id': 'req-a1d1b6ca-f91e-4f48-bc1a-617558b5ce93'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:21.702787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:21.717715 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a1d1b6ca-f91e-4f48-bc1a-617558b5ce93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03df4d79d7e04b7f9c8a2ef97588b582', 'request_id': 'req-a1d1b6ca-f91e-4f48-bc1a-617558b5ce93'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:21.734259 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a1d1b6ca-f91e-4f48-bc1a-617558b5ce93 admin admin] The token cache is being invalidate because project 03df4d79d7e04b7f9c8a2ef97588b582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:21.734701 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a1d1b6ca-f91e-4f48-bc1a-617558b5ce93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:21.735630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a1d1b6ca-f91e-4f48-bc1a-617558b5ce93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:21.740476 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1045/2084] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:21 2022] DELETE /identity/v3/projects/03df4d79d7e04b7f9c8a2ef97588b582 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:21.740476 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1b6ca-f91e-4f48-bc1a-617558b5ce93 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:21.743276 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a1d1b6ca-f91e-4f48-bc1a-617558b5ce93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:21.759142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-20eea907-c769-4dda-8cae-e09aa012bb4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd99471b06bab4181a4c15d17630ad322', 'request_id': 'req-20eea907-c769-4dda-8cae-e09aa012bb4e'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:21.771248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-20eea907-c769-4dda-8cae-e09aa012bb4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd99471b06bab4181a4c15d17630ad322', 'request_id': 'req-20eea907-c769-4dda-8cae-e09aa012bb4e'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:21.782641 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-20eea907-c769-4dda-8cae-e09aa012bb4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd99471b06bab4181a4c15d17630ad322', 'request_id': 'req-20eea907-c769-4dda-8cae-e09aa012bb4e'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:21.800393 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-20eea907-c769-4dda-8cae-e09aa012bb4e admin admin] The token cache is being invalidate because project d99471b06bab4181a4c15d17630ad322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:21.801032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-20eea907-c769-4dda-8cae-e09aa012bb4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:21.802291 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-20eea907-c769-4dda-8cae-e09aa012bb4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:21.805650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1040/2085] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:21 2022] DELETE /identity/v3/projects/d99471b06bab4181a4c15d17630ad322 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:21.807022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eea907-c769-4dda-8cae-e09aa012bb4e admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:21.808751 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-20eea907-c769-4dda-8cae-e09aa012bb4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:21.841692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1b6ca-f91e-4f48-bc1a-617558b5ce93 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:21.907947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eea907-c769-4dda-8cae-e09aa012bb4e admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:21.916170 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56c525-d0a0-4eb4-b7b7-6fa4373ce5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:21.917367 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56c525-d0a0-4eb4-b7b7-6fa4373ce5e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:21.917917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56c525-d0a0-4eb4-b7b7-6fa4373ce5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:21.918600 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56c525-d0a0-4eb4-b7b7-6fa4373ce5e4 admin admin] PATH_INFO: `/v3/projects/8ac774a6a6184fce91242a4dac87405d/users/16e40996a8944be5ae15208328832aad/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:21.921384 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b1d68-b2c9-4a43-9206-33d70d21822c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:21.922038 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b1d68-b2c9-4a43-9206-33d70d21822c admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:21.922361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b1d68-b2c9-4a43-9206-33d70d21822c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:21.922638 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b1d68-b2c9-4a43-9206-33d70d21822c admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:21.923346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b1d68-b2c9-4a43-9206-33d70d21822c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:21.923460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:21.925271 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b1d68-b2c9-4a43-9206-33d70d21822c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:21.940058 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1046/2086] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:21.940951 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b1d68-b2c9-4a43-9206-33d70d21822c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:21.942988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ff9b1d68-b2c9-4a43-9206-33d70d21822c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:21.947010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56c525-d0a0-4eb4-b7b7-6fa4373ce5e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ac774a6a6184fce91242a4dac87405d, user_id=16e40996a8944be5ae15208328832aad, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:21.951248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56c525-d0a0-4eb4-b7b7-6fa4373ce5e4 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:21.957454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b1d68-b2c9-4a43-9206-33d70d21822c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:21.963223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd658414-6e6b-4db7-8518-417d92f8d126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:21.963909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd658414-6e6b-4db7-8518-417d92f8d126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:21.964187 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd658414-6e6b-4db7-8518-417d92f8d126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:21.964988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd658414-6e6b-4db7-8518-417d92f8d126 admin admin] PATH_INFO: `/v3/users/0e388e9879b54662a2d153811db6f2fc` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:21.966217 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd658414-6e6b-4db7-8518-417d92f8d126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e388e9879b54662a2d153811db6f2fc)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:21.969099 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd658414-6e6b-4db7-8518-417d92f8d126 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:21.972686 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1041/2087] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:21 2022] PUT /identity/v3/projects/8ac774a6a6184fce91242a4dac87405d/users/16e40996a8944be5ae15208328832aad/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:21.974012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dc226-f1af-4a6d-a754-c878e6a9484c None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:21.974388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dc226-f1af-4a6d-a754-c878e6a9484c None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:21.974602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dc226-f1af-4a6d-a754-c878e6a9484c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:21.996084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-6e2dc226-f1af-4a6d-a754-c878e6a9484c None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:21.997680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6e2dc226-f1af-4a6d-a754-c878e6a9484c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:22.043836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-dd658414-6e6b-4db7-8518-417d92f8d126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e388e9879b54662a2d153811db6f2fc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:22.044872 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-dd658414-6e6b-4db7-8518-417d92f8d126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e388e9879b54662a2d153811db6f2fc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:22.062500 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-dd658414-6e6b-4db7-8518-417d92f8d126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e388e9879b54662a2d153811db6f2fc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:22.077537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-dd658414-6e6b-4db7-8518-417d92f8d126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e388e9879b54662a2d153811db6f2fc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:22.078803 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-dd658414-6e6b-4db7-8518-417d92f8d126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e388e9879b54662a2d153811db6f2fc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:22.085256 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1042/2088] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:22.086417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2dc226-f1af-4a6d-a754-c878e6a9484c None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:22.088316 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6e2dc226-f1af-4a6d-a754-c878e6a9484c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:22.104546 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1047/2089] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:21 2022] DELETE /identity/v3/users/0e388e9879b54662a2d153811db6f2fc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:22.106362 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadda3c6-0dc2-4d29-abc1-b4fa3ef2d5c0 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:22.106362 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadda3c6-0dc2-4d29-abc1-b4fa3ef2d5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:22.106714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadda3c6-0dc2-4d29-abc1-b4fa3ef2d5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:22.119441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:22.141584 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2dc226-f1af-4a6d-a754-c878e6a9484c None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:22.144870 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-eadda3c6-0dc2-4d29-abc1-b4fa3ef2d5c0 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:22.146554 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-eadda3c6-0dc2-4d29-abc1-b4fa3ef2d5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:22.249090 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1048/2090] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:22.256775 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0513f-a9ad-481a-abdc-1b0127b28416 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:22.257210 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0513f-a9ad-481a-abdc-1b0127b28416 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:22.257592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0513f-a9ad-481a-abdc-1b0127b28416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:22.282991 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef06b8-819b-40c1-ae45-2fdb9abce2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:22.284094 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef06b8-819b-40c1-ae45-2fdb9abce2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:22.284468 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef06b8-819b-40c1-ae45-2fdb9abce2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:22.284846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef06b8-819b-40c1-ae45-2fdb9abce2f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:22.286102 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef06b8-819b-40c1-ae45-2fdb9abce2f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:22.288009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef06b8-819b-40c1-ae45-2fdb9abce2f2 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:22.301242 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-49d0513f-a9ad-481a-abdc-1b0127b28416 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:22.302666 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-49d0513f-a9ad-481a-abdc-1b0127b28416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:22.304597 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1043/2091] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:22.305661 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef06b8-819b-40c1-ae45-2fdb9abce2f2 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:22.308339 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-49ef06b8-819b-40c1-ae45-2fdb9abce2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:22.316909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1049/2092] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:22.321690 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0513f-a9ad-481a-abdc-1b0127b28416 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:22.336359 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0513f-a9ad-481a-abdc-1b0127b28416 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:22.346978 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723ddf0-61e9-4c9c-b0aa-72d9f977ab8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:22.347781 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723ddf0-61e9-4c9c-b0aa-72d9f977ab8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:22.348071 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723ddf0-61e9-4c9c-b0aa-72d9f977ab8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:22.348433 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723ddf0-61e9-4c9c-b0aa-72d9f977ab8f admin admin] PATH_INFO: `/v3/projects/09183e79ca9940648112dfa525c6da0c/users/b6f3b06f8e8e4fc6bfc7de7ffba76d42/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:22.373337 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723ddf0-61e9-4c9c-b0aa-72d9f977ab8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=09183e79ca9940648112dfa525c6da0c, user_id=b6f3b06f8e8e4fc6bfc7de7ffba76d42, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:22.376902 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723ddf0-61e9-4c9c-b0aa-72d9f977ab8f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:22.394667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef06b8-819b-40c1-ae45-2fdb9abce2f2 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:22.412510 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1050/2093] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:22 2022] PUT /identity/v3/projects/09183e79ca9940648112dfa525c6da0c/users/b6f3b06f8e8e4fc6bfc7de7ffba76d42/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:22.412510 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723ddf0-61e9-4c9c-b0aa-72d9f977ab8f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:22.456258 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:22.484176 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706e5bf-0d95-45e4-978f-49ef7404e1a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:22.484863 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706e5bf-0d95-45e4-978f-49ef7404e1a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:22.485172 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706e5bf-0d95-45e4-978f-49ef7404e1a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:22.486350 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706e5bf-0d95-45e4-978f-49ef7404e1a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:22.521648 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723ddf0-61e9-4c9c-b0aa-72d9f977ab8f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:22.556826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c184e1c-b6d6-433d-b900-c7404e637746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:22.557545 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c184e1c-b6d6-433d-b900-c7404e637746 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:22.557927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c184e1c-b6d6-433d-b900-c7404e637746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:22.558336 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c184e1c-b6d6-433d-b900-c7404e637746 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:22.558983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c184e1c-b6d6-433d-b900-c7404e637746 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:22.560137 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c184e1c-b6d6-433d-b900-c7404e637746 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:22.562761 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c184e1c-b6d6-433d-b900-c7404e637746 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:22.581663 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1051/2094] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:56:22.587259 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77598b-f083-459a-8952-29fa53f5bf05 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:22.587560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77598b-f083-459a-8952-29fa53f5bf05 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:22.587840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77598b-f083-459a-8952-29fa53f5bf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:22.609411 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b706e5bf-0d95-45e4-978f-49ef7404e1a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:22.611843 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b706e5bf-0d95-45e4-978f-49ef7404e1a1 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:22.624850 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1044/2095] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:22.625710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706e5bf-0d95-45e4-978f-49ef7404e1a1 service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:22.625829 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-9d77598b-f083-459a-8952-29fa53f5bf05 None None] MFA Rules not processed for user `b6f3b06f8e8e4fc6bfc7de7ffba76d42`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:22.627120 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9d77598b-f083-459a-8952-29fa53f5bf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:22.627308 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b706e5bf-0d95-45e4-978f-49ef7404e1a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:22.649382 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706e5bf-0d95-45e4-978f-49ef7404e1a1 service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:22.656188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50d827-cc26-4945-bec5-bc063834f0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:22.656974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50d827-cc26-4945-bec5-bc063834f0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:22.657370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50d827-cc26-4945-bec5-bc063834f0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:22.658140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50d827-cc26-4945-bec5-bc063834f0fa admin admin] PATH_INFO: `/v3/projects/00bf08c0dd204306a959bade34345cb8` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:22.659575 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50d827-cc26-4945-bec5-bc063834f0fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=00bf08c0dd204306a959bade34345cb8)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:22.663165 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50d827-cc26-4945-bec5-bc063834f0fa admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:22.704096 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:22.720290 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1052/2096] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:22 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:22.720290 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77598b-f083-459a-8952-29fa53f5bf05 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:22.734824 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-fc50d827-cc26-4945-bec5-bc063834f0fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00bf08c0dd204306a959bade34345cb8', 'request_id': 'req-fc50d827-cc26-4945-bec5-bc063834f0fa'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:22.736949 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77598b-f083-459a-8952-29fa53f5bf05 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:22.751151 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-fc50d827-cc26-4945-bec5-bc063834f0fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00bf08c0dd204306a959bade34345cb8', 'request_id': 'req-fc50d827-cc26-4945-bec5-bc063834f0fa'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:22.762634 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-fc50d827-cc26-4945-bec5-bc063834f0fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00bf08c0dd204306a959bade34345cb8', 'request_id': 'req-fc50d827-cc26-4945-bec5-bc063834f0fa'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:22.780909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-fc50d827-cc26-4945-bec5-bc063834f0fa admin admin] The token cache is being invalidate because project 00bf08c0dd204306a959bade34345cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:22.781320 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-fc50d827-cc26-4945-bec5-bc063834f0fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:22.783688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-fc50d827-cc26-4945-bec5-bc063834f0fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:22.788592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1045/2097] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:22 2022] DELETE /identity/v3/projects/00bf08c0dd204306a959bade34345cb8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:22.788592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50d827-cc26-4945-bec5-bc063834f0fa admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:22.789333 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-fc50d827-cc26-4945-bec5-bc063834f0fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:22.814815 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3dc86-c5d3-4ee2-818e-cc2ea83eeb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:22.815621 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3dc86-c5d3-4ee2-818e-cc2ea83eeb9b admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:22.815951 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3dc86-c5d3-4ee2-818e-cc2ea83eeb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:22.816317 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3dc86-c5d3-4ee2-818e-cc2ea83eeb9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:22.817947 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3dc86-c5d3-4ee2-818e-cc2ea83eeb9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:22.819995 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3dc86-c5d3-4ee2-818e-cc2ea83eeb9b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:22.865620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1053/2098] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:22 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:22.866717 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3dc86-c5d3-4ee2-818e-cc2ea83eeb9b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:22.872626 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6cd3dc86-c5d3-4ee2-818e-cc2ea83eeb9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:22.904193 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50d827-cc26-4945-bec5-bc063834f0fa admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:22.920254 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:22.986931 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aed40-2608-4663-a29d-b26194f95ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:22.987221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3dc86-c5d3-4ee2-818e-cc2ea83eeb9b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:22.987332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aed40-2608-4663-a29d-b26194f95ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:22.987332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aed40-2608-4663-a29d-b26194f95ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:22.987332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aed40-2608-4663-a29d-b26194f95ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:22.988012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63aed40-2608-4663-a29d-b26194f95ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:22.989987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63aed40-2608-4663-a29d-b26194f95ca6 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:22.992518 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7250048-a6a8-4d9a-b1f9-41cab6f9f7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:22.993347 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7250048-a6a8-4d9a-b1f9-41cab6f9f7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:22.993689 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7250048-a6a8-4d9a-b1f9-41cab6f9f7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:22.994081 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7250048-a6a8-4d9a-b1f9-41cab6f9f7af admin admin] PATH_INFO: `/v3/users/9a43c54016ef48a6b36fe0de42ab131e` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:22.995436 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7250048-a6a8-4d9a-b1f9-41cab6f9f7af admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a43c54016ef48a6b36fe0de42ab131e)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:22.998404 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7250048-a6a8-4d9a-b1f9-41cab6f9f7af admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:23.048714 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1046/2099] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:22 2022] POST /identity/v3/projects => generated 409 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:23.049865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aed40-2608-4663-a29d-b26194f95ca6 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:23.052928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f63aed40-2608-4663-a29d-b26194f95ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:23.081277 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e7250048-a6a8-4d9a-b1f9-41cab6f9f7af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a43c54016ef48a6b36fe0de42ab131e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:23.082054 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e7250048-a6a8-4d9a-b1f9-41cab6f9f7af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a43c54016ef48a6b36fe0de42ab131e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:23.096386 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e7250048-a6a8-4d9a-b1f9-41cab6f9f7af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a43c54016ef48a6b36fe0de42ab131e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:23.116770 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e7250048-a6a8-4d9a-b1f9-41cab6f9f7af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a43c54016ef48a6b36fe0de42ab131e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:23.117848 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e7250048-a6a8-4d9a-b1f9-41cab6f9f7af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a43c54016ef48a6b36fe0de42ab131e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:23.142017 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:23.155042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1054/2100] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:22 2022] DELETE /identity/v3/users/9a43c54016ef48a6b36fe0de42ab131e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:23.166766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7250048-a6a8-4d9a-b1f9-41cab6f9f7af admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:23.170873 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e7250048-a6a8-4d9a-b1f9-41cab6f9f7af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:23.174520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aed40-2608-4663-a29d-b26194f95ca6 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:23.245924 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d586421-7fad-4e0e-bdcd-e6e4d02c5921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:23.246576 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d586421-7fad-4e0e-bdcd-e6e4d02c5921 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:23.247259 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d586421-7fad-4e0e-bdcd-e6e4d02c5921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:23.247542 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d586421-7fad-4e0e-bdcd-e6e4d02c5921 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:23.248376 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d586421-7fad-4e0e-bdcd-e6e4d02c5921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:23.250754 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d586421-7fad-4e0e-bdcd-e6e4d02c5921 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:23.286137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1047/2101] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:23 2022] POST /identity/v3/users => generated 288 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:23.287477 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d586421-7fad-4e0e-bdcd-e6e4d02c5921 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:23.290941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-4d586421-7fad-4e0e-bdcd-e6e4d02c5921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:23.322646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d586421-7fad-4e0e-bdcd-e6e4d02c5921 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:23.339222 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536ff3c-a969-44b4-b7e5-56cf563a6e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:23.339805 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536ff3c-a969-44b4-b7e5-56cf563a6e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:23.340179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536ff3c-a969-44b4-b7e5-56cf563a6e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:23.340458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536ff3c-a969-44b4-b7e5-56cf563a6e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:23.341352 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536ff3c-a969-44b4-b7e5-56cf563a6e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:23.343051 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536ff3c-a969-44b4-b7e5-56cf563a6e91 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:23.375876 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1048/2102] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:23.377570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536ff3c-a969-44b4-b7e5-56cf563a6e91 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:23.395468 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536ff3c-a969-44b4-b7e5-56cf563a6e91 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:23.419313 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe451729-bb4f-4c81-9b8d-c5504d3eca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:23.419956 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe451729-bb4f-4c81-9b8d-c5504d3eca64 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:23.420548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe451729-bb4f-4c81-9b8d-c5504d3eca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:23.420548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe451729-bb4f-4c81-9b8d-c5504d3eca64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:23.421278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe451729-bb4f-4c81-9b8d-c5504d3eca64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:23.422849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe451729-bb4f-4c81-9b8d-c5504d3eca64 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:23.444421 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7250048-a6a8-4d9a-b1f9-41cab6f9f7af admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:23.446632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1049/2103] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:23.451265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe451729-bb4f-4c81-9b8d-c5504d3eca64 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:23.454521 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e0bde-47ed-403c-b678-0fed413446fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:23.455430 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e0bde-47ed-403c-b678-0fed413446fb admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:23.455927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e0bde-47ed-403c-b678-0fed413446fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:23.456380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e0bde-47ed-403c-b678-0fed413446fb admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:23.457290 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e0bde-47ed-403c-b678-0fed413446fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:23.459490 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e0bde-47ed-403c-b678-0fed413446fb admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:23.470454 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe451729-bb4f-4c81-9b8d-c5504d3eca64 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:23.489903 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a282cef-0db8-4054-a763-fa8c38e60a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:23.490604 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a282cef-0db8-4054-a763-fa8c38e60a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:23.490867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a282cef-0db8-4054-a763-fa8c38e60a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:23.491068 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a282cef-0db8-4054-a763-fa8c38e60a78 admin admin] PATH_INFO: `/v3/projects/3a0559273d254257a88c013ee3e175ec/users/e9209400251e4e078d2b5ca4b64a22ed/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:23.498133 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1055/2104] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:23 2022] POST /identity/v3/users => generated 311 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:23.502342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e0bde-47ed-403c-b678-0fed413446fb admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:23.514684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e0bde-47ed-403c-b678-0fed413446fb admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:23.521308 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80620a0a-a341-4c33-9686-1ce63d716c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:23.522263 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:23.522457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80620a0a-a341-4c33-9686-1ce63d716c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:23.522898 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80620a0a-a341-4c33-9686-1ce63d716c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:23.523405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80620a0a-a341-4c33-9686-1ce63d716c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:23.524186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80620a0a-a341-4c33-9686-1ce63d716c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:23.526344 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80620a0a-a341-4c33-9686-1ce63d716c8c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:23.528580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a282cef-0db8-4054-a763-fa8c38e60a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0559273d254257a88c013ee3e175ec, user_id=e9209400251e4e078d2b5ca4b64a22ed, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:23.533381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a282cef-0db8-4054-a763-fa8c38e60a78 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:23.558996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1050/2105] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:23 2022] PUT /identity/v3/projects/3a0559273d254257a88c013ee3e175ec/users/e9209400251e4e078d2b5ca4b64a22ed/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:23.573532 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22202a4f-a9d1-414d-bbc4-5f3e886c4855 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:23.574370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22202a4f-a9d1-414d-bbc4-5f3e886c4855 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:23.574831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22202a4f-a9d1-414d-bbc4-5f3e886c4855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:23.584720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1056/2106] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:23.585715 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80620a0a-a341-4c33-9686-1ce63d716c8c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:23.604895 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80620a0a-a341-4c33-9686-1ce63d716c8c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:23.619266 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-22202a4f-a9d1-414d-bbc4-5f3e886c4855 None None] MFA Rules not processed for user `e9209400251e4e078d2b5ca4b64a22ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:23.621130 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-22202a4f-a9d1-414d-bbc4-5f3e886c4855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:23.749467 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1051/2107] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:56:23.749467 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22202a4f-a9d1-414d-bbc4-5f3e886c4855 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:23.760754 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-22202a4f-a9d1-414d-bbc4-5f3e886c4855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:23.785918 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ea6a1-085e-4bc2-a12a-ad6c4ab786ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:23.786668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ea6a1-085e-4bc2-a12a-ad6c4ab786ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:23.786931 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ea6a1-085e-4bc2-a12a-ad6c4ab786ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:23.787208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ea6a1-085e-4bc2-a12a-ad6c4ab786ae admin admin] PATH_INFO: `/v3/projects/94332a8addfc498ba2178a32453b5397/users/ba1d5dc3cdb8458aa4502d242f3e60ea/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:23.825467 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ea6a1-085e-4bc2-a12a-ad6c4ab786ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=94332a8addfc498ba2178a32453b5397, user_id=ba1d5dc3cdb8458aa4502d242f3e60ea, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:23.828603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ea6a1-085e-4bc2-a12a-ad6c4ab786ae admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:23.861530 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1057/2108] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:23 2022] PUT /identity/v3/projects/94332a8addfc498ba2178a32453b5397/users/ba1d5dc3cdb8458aa4502d242f3e60ea/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:23.862370 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ea6a1-085e-4bc2-a12a-ad6c4ab786ae admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:23.865490 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-820ea6a1-085e-4bc2-a12a-ad6c4ab786ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:23.878013 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22202a4f-a9d1-414d-bbc4-5f3e886c4855 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:23.970429 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746dbbb6-940e-4bcd-8ec7-1e7bdb60afd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:23.971097 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dbbb6-940e-4bcd-8ec7-1e7bdb60afd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:23.971378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dbbb6-940e-4bcd-8ec7-1e7bdb60afd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:23.971654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dbbb6-940e-4bcd-8ec7-1e7bdb60afd4 admin admin] PATH_INFO: `/v3/projects/a760136358014ab1a16a115b5ddd6b52` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:23.972839 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746dbbb6-940e-4bcd-8ec7-1e7bdb60afd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a760136358014ab1a16a115b5ddd6b52)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:23.974817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746dbbb6-940e-4bcd-8ec7-1e7bdb60afd4 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:23.982247 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:24.008577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ea6a1-085e-4bc2-a12a-ad6c4ab786ae admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:24.025333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d0575-f900-47c6-b5f9-3f8410d32ee3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98465c2d73e540b5bf506f5a7423e035', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:24.026109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d0575-f900-47c6-b5f9-3f8410d32ee3 service glance] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:24.026468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d0575-f900-47c6-b5f9-3f8410d32ee3 service glance] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:24.028320 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d0575-f900-47c6-b5f9-3f8410d32ee3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:24.040779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:24.063677 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-746dbbb6-940e-4bcd-8ec7-1e7bdb60afd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a760136358014ab1a16a115b5ddd6b52', 'request_id': 'req-746dbbb6-940e-4bcd-8ec7-1e7bdb60afd4'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:24.077145 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-746dbbb6-940e-4bcd-8ec7-1e7bdb60afd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a760136358014ab1a16a115b5ddd6b52', 'request_id': 'req-746dbbb6-940e-4bcd-8ec7-1e7bdb60afd4'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:24.092374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-746dbbb6-940e-4bcd-8ec7-1e7bdb60afd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a760136358014ab1a16a115b5ddd6b52', 'request_id': 'req-746dbbb6-940e-4bcd-8ec7-1e7bdb60afd4'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:24.114665 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-746dbbb6-940e-4bcd-8ec7-1e7bdb60afd4 admin admin] The token cache is being invalidate because project a760136358014ab1a16a115b5ddd6b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:24.115107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-746dbbb6-940e-4bcd-8ec7-1e7bdb60afd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:24.116007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-746dbbb6-940e-4bcd-8ec7-1e7bdb60afd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:24.121529 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1052/2109] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:23 2022] DELETE /identity/v3/projects/a760136358014ab1a16a115b5ddd6b52 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:24.122804 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746dbbb6-940e-4bcd-8ec7-1e7bdb60afd4 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:24.129210 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-746dbbb6-940e-4bcd-8ec7-1e7bdb60afd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:24.138901 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d0575-f900-47c6-b5f9-3f8410d32ee3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:24.140436 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d0575-f900-47c6-b5f9-3f8410d32ee3 service glance] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:24.170824 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1058/2110] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:24.172449 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a5502-ec29-4004-b29f-6ea10d963f5a None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:24.172739 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a5502-ec29-4004-b29f-6ea10d963f5a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:24.173016 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a5502-ec29-4004-b29f-6ea10d963f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:24.216242 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-025a5502-ec29-4004-b29f-6ea10d963f5a None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:24.217623 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-025a5502-ec29-4004-b29f-6ea10d963f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:24.268461 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746dbbb6-940e-4bcd-8ec7-1e7bdb60afd4 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:24.277419 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607970b-f875-4391-91ed-4b41fdb6b7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:24.277990 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607970b-f875-4391-91ed-4b41fdb6b7dc admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:24.278268 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607970b-f875-4391-91ed-4b41fdb6b7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:24.278541 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607970b-f875-4391-91ed-4b41fdb6b7dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:24.279249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607970b-f875-4391-91ed-4b41fdb6b7dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:24.280893 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607970b-f875-4391-91ed-4b41fdb6b7dc admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:24.302116 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1053/2111] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:24.306164 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607970b-f875-4391-91ed-4b41fdb6b7dc admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:24.319431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607970b-f875-4391-91ed-4b41fdb6b7dc admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:24.326225 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aaf4ec-da70-4f5a-9d0f-f852565eb902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:24.327326 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1059/2112] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:24.336356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aaf4ec-da70-4f5a-9d0f-f852565eb902 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:24.336710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aaf4ec-da70-4f5a-9d0f-f852565eb902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:24.337823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aaf4ec-da70-4f5a-9d0f-f852565eb902 admin admin] PATH_INFO: `/v3/projects/94332a8addfc498ba2178a32453b5397/users/ba1d5dc3cdb8458aa4502d242f3e60ea/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:24.338714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88de62d-5a9d-4ef2-9290-1eb27c3b887a None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:24.338714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88de62d-5a9d-4ef2-9290-1eb27c3b887a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:24.339920 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88de62d-5a9d-4ef2-9290-1eb27c3b887a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:24.343887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aaf4ec-da70-4f5a-9d0f-f852565eb902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94332a8addfc498ba2178a32453b5397, user_id=ba1d5dc3cdb8458aa4502d242f3e60ea, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:24.347519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aaf4ec-da70-4f5a-9d0f-f852565eb902 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:24.376091 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1054/2113] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:24 2022] PUT /identity/v3/projects/94332a8addfc498ba2178a32453b5397/users/ba1d5dc3cdb8458aa4502d242f3e60ea/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:56:24.379316 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb542f-5291-48ad-85d0-b583b89c48df None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:24.381004 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb542f-5291-48ad-85d0-b583b89c48df None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:24.381464 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb542f-5291-48ad-85d0-b583b89c48df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:24.385782 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d88de62d-5a9d-4ef2-9290-1eb27c3b887a None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:24.387207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d88de62d-5a9d-4ef2-9290-1eb27c3b887a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:24.443116 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-44eb542f-5291-48ad-85d0-b583b89c48df None None] MFA Rules not processed for user `16e40996a8944be5ae15208328832aad`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:24.444653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-44eb542f-5291-48ad-85d0-b583b89c48df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:24.566506 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1060/2114] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:24.572385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a824c2-8225-48a5-bbaa-beb5abe9d561 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:24.573442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a824c2-8225-48a5-bbaa-beb5abe9d561 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:24.575943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a824c2-8225-48a5-bbaa-beb5abe9d561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:24.675224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-30a824c2-8225-48a5-bbaa-beb5abe9d561 None None] MFA Rules not processed for user `ba1d5dc3cdb8458aa4502d242f3e60ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:24.678267 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1055/2115] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:24.683168 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-30a824c2-8225-48a5-bbaa-beb5abe9d561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:24.684704 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb542f-5291-48ad-85d0-b583b89c48df None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:24.740957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb542f-5291-48ad-85d0-b583b89c48df None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:24.762617 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c4a44-5548-488f-b094-42e4f404cb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:24.763298 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c4a44-5548-488f-b094-42e4f404cb55 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:24.763575 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c4a44-5548-488f-b094-42e4f404cb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:24.763843 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c4a44-5548-488f-b094-42e4f404cb55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:24.764570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c4a44-5548-488f-b094-42e4f404cb55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:24.764878 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c4a44-5548-488f-b094-42e4f404cb55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:24.769408 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c4a44-5548-488f-b094-42e4f404cb55 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:24.825639 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1056/2116] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:56:24.826898 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c4a44-5548-488f-b094-42e4f404cb55 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:24.827406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:24.844346 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-cb5c4a44-5548-488f-b094-42e4f404cb55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:24.868992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c4a44-5548-488f-b094-42e4f404cb55 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:24.919569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d7ecf-738b-4167-8464-c946974242b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:24.921935 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d7ecf-738b-4167-8464-c946974242b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:24.923672 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d7ecf-738b-4167-8464-c946974242b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:24.925752 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d7ecf-738b-4167-8464-c946974242b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:24.926989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d7ecf-738b-4167-8464-c946974242b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:24.933183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d7ecf-738b-4167-8464-c946974242b8 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:24.984041 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:24.991330 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1061/2117] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:24 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:24.995115 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a824c2-8225-48a5-bbaa-beb5abe9d561 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:25.035168 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a824c2-8225-48a5-bbaa-beb5abe9d561 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:25.037793 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1057/2118] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:24 2022] POST /identity/v3/projects => generated 371 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:25.039066 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d7ecf-738b-4167-8464-c946974242b8 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:25.059345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-373d7ecf-738b-4167-8464-c946974242b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:25.185626 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fd90a-c7fa-4a17-abc4-8dde06b5f0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:25.186650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fd90a-c7fa-4a17-abc4-8dde06b5f0ed admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:25.188346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fd90a-c7fa-4a17-abc4-8dde06b5f0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:25.188722 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fd90a-c7fa-4a17-abc4-8dde06b5f0ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:25.194612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fd90a-c7fa-4a17-abc4-8dde06b5f0ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:25.197051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fd90a-c7fa-4a17-abc4-8dde06b5f0ed admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:25.203998 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d7ecf-738b-4167-8464-c946974242b8 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:25.215010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42bd95-dc2f-4e2e-bdfa-41e0a8184c92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:25.215618 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42bd95-dc2f-4e2e-bdfa-41e0a8184c92 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:25.215841 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42bd95-dc2f-4e2e-bdfa-41e0a8184c92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:25.216118 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42bd95-dc2f-4e2e-bdfa-41e0a8184c92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:25.235759 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1062/2119] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:24 2022] POST /identity/v3/projects => generated 373 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:25.236519 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fd90a-c7fa-4a17-abc4-8dde06b5f0ed admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:25.337028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42bd95-dc2f-4e2e-bdfa-41e0a8184c92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:25.339309 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42bd95-dc2f-4e2e-bdfa-41e0a8184c92 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:25.348560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fd90a-c7fa-4a17-abc4-8dde06b5f0ed admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:25.354372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1058/2120] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:25 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:25.356326 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b59258-b325-44f1-93c7-8f680e3e1b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:25.356562 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42bd95-dc2f-4e2e-bdfa-41e0a8184c92 service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:25.358664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b59258-b325-44f1-93c7-8f680e3e1b7b admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:25.359152 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b59258-b325-44f1-93c7-8f680e3e1b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:25.359681 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b59258-b325-44f1-93c7-8f680e3e1b7b admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:25.361812 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b59258-b325-44f1-93c7-8f680e3e1b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:25.364854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b59258-b325-44f1-93c7-8f680e3e1b7b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:25.368640 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42bd95-dc2f-4e2e-bdfa-41e0a8184c92 service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:25.375436 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5aa56-a287-4656-99f5-f54c27434c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:25.376082 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5aa56-a287-4656-99f5-f54c27434c2d admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:25.376408 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5aa56-a287-4656-99f5-f54c27434c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:25.376686 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5aa56-a287-4656-99f5-f54c27434c2d admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:25.377527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5aa56-a287-4656-99f5-f54c27434c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:25.379593 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5aa56-a287-4656-99f5-f54c27434c2d admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:25.413282 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1059/2121] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:25 2022] POST /identity/v3/users => generated 287 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:25.413282 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5aa56-a287-4656-99f5-f54c27434c2d admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:25.417501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1063/2122] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:25 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:25.420490 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b59258-b325-44f1-93c7-8f680e3e1b7b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:25.425487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5aa56-a287-4656-99f5-f54c27434c2d admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:25.448097 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b59258-b325-44f1-93c7-8f680e3e1b7b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:25.452542 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dba8f5-7a01-4aba-a48d-ecd83c2d11b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:25.453228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dba8f5-7a01-4aba-a48d-ecd83c2d11b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:25.453624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dba8f5-7a01-4aba-a48d-ecd83c2d11b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:25.453912 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dba8f5-7a01-4aba-a48d-ecd83c2d11b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:25.459062 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dba8f5-7a01-4aba-a48d-ecd83c2d11b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:25.461841 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa3706-02d3-402e-b5f9-5e29143510c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:25.462565 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa3706-02d3-402e-b5f9-5e29143510c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:25.462856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa3706-02d3-402e-b5f9-5e29143510c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:25.463542 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dba8f5-7a01-4aba-a48d-ecd83c2d11b4 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:25.464344 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa3706-02d3-402e-b5f9-5e29143510c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:25.466635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa3706-02d3-402e-b5f9-5e29143510c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:25.470852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa3706-02d3-402e-b5f9-5e29143510c4 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:25.485966 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1060/2123] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:25.487508 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dba8f5-7a01-4aba-a48d-ecd83c2d11b4 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:25.493537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1064/2124] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:25.495241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa3706-02d3-402e-b5f9-5e29143510c4 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:25.506448 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa3706-02d3-402e-b5f9-5e29143510c4 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:25.513201 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dba8f5-7a01-4aba-a48d-ecd83c2d11b4 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:25.516711 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815085e0-2ea3-42fc-81a5-2046174633c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:25.518621 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815085e0-2ea3-42fc-81a5-2046174633c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:25.518621 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815085e0-2ea3-42fc-81a5-2046174633c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:25.518857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815085e0-2ea3-42fc-81a5-2046174633c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:25.519365 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815085e0-2ea3-42fc-81a5-2046174633c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:25.521888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815085e0-2ea3-42fc-81a5-2046174633c4 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:25.527697 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230b8a6-1f74-409c-ba5a-80c11704dd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:25.530142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230b8a6-1f74-409c-ba5a-80c11704dd3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:25.531120 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230b8a6-1f74-409c-ba5a-80c11704dd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:25.532546 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230b8a6-1f74-409c-ba5a-80c11704dd3a admin admin] PATH_INFO: `/v3/projects/7b26fe74e5f54ea096892b7e529c7977/users/fa41018d1d194992b7b0a9ca07fe0749/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:25.543027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1065/2125] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:25.549870 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815085e0-2ea3-42fc-81a5-2046174633c4 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:25.564687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230b8a6-1f74-409c-ba5a-80c11704dd3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b26fe74e5f54ea096892b7e529c7977, user_id=fa41018d1d194992b7b0a9ca07fe0749, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:25.567582 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230b8a6-1f74-409c-ba5a-80c11704dd3a admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:25.573577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815085e0-2ea3-42fc-81a5-2046174633c4 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:25.579937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cfec9-c853-4cf3-ad1b-291e060e8bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:25.580947 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cfec9-c853-4cf3-ad1b-291e060e8bad admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:25.581334 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cfec9-c853-4cf3-ad1b-291e060e8bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:25.581744 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cfec9-c853-4cf3-ad1b-291e060e8bad admin admin] PATH_INFO: `/v3/projects/23ef380012ab4ab38586ef4c1107f476/users/a8330780c04d4ab9a43b5f49a1e7e4f5/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:25.594632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1061/2126] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:25 2022] PUT /identity/v3/projects/7b26fe74e5f54ea096892b7e529c7977/users/fa41018d1d194992b7b0a9ca07fe0749/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:25.600686 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:25.602119 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230b8a6-1f74-409c-ba5a-80c11704dd3a admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:25.604801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cfec9-c853-4cf3-ad1b-291e060e8bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ef380012ab4ab38586ef4c1107f476, user_id=a8330780c04d4ab9a43b5f49a1e7e4f5, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:25.607946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cfec9-c853-4cf3-ad1b-291e060e8bad admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:25.626745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1066/2127] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:25 2022] PUT /identity/v3/projects/23ef380012ab4ab38586ef4c1107f476/users/a8330780c04d4ab9a43b5f49a1e7e4f5/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:25.632646 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b0eef-d956-4c3b-89f1-adc989ffff5e None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:25.633096 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b0eef-d956-4c3b-89f1-adc989ffff5e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:25.635351 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b0eef-d956-4c3b-89f1-adc989ffff5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:25.664199 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-5c6b0eef-d956-4c3b-89f1-adc989ffff5e None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:25.665650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5c6b0eef-d956-4c3b-89f1-adc989ffff5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:25.692358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:25.712414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230b8a6-1f74-409c-ba5a-80c11704dd3a admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:25.765215 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1067/2128] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:25.767487 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b0eef-d956-4c3b-89f1-adc989ffff5e None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:25.809038 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1878adc-b668-4f13-80f1-a52add96c134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:25.809854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1878adc-b668-4f13-80f1-a52add96c134 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:25.810052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1878adc-b668-4f13-80f1-a52add96c134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:25.811949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1878adc-b668-4f13-80f1-a52add96c134 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:25.811949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1878adc-b668-4f13-80f1-a52add96c134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:25.812807 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1878adc-b668-4f13-80f1-a52add96c134 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:25.828251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1062/2129] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:25.828251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1878adc-b668-4f13-80f1-a52add96c134 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:25.828251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b1878adc-b668-4f13-80f1-a52add96c134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:25.875929 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b0eef-d956-4c3b-89f1-adc989ffff5e None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:25.879599 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072844e-029a-400e-8a87-055acfb301e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:25.880221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072844e-029a-400e-8a87-055acfb301e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:25.880496 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072844e-029a-400e-8a87-055acfb301e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:25.880767 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072844e-029a-400e-8a87-055acfb301e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:25.883516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3072844e-029a-400e-8a87-055acfb301e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:25.930032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1878adc-b668-4f13-80f1-a52add96c134 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:25.935152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497dab90-a462-4247-9b3c-cfffb5b22534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:25.936246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dab90-a462-4247-9b3c-cfffb5b22534 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:25.936560 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dab90-a462-4247-9b3c-cfffb5b22534 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:25.936849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dab90-a462-4247-9b3c-cfffb5b22534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:25.954019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497dab90-a462-4247-9b3c-cfffb5b22534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:25.955800 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497dab90-a462-4247-9b3c-cfffb5b22534 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:25.966943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072844e-029a-400e-8a87-055acfb301e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:25.968440 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072844e-029a-400e-8a87-055acfb301e1 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:25.972958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1063/2130] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:25.973765 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497dab90-a462-4247-9b3c-cfffb5b22534 service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:25.979580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1068/2131] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:25 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:25.984452 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497dab90-a462-4247-9b3c-cfffb5b22534 service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:26.002999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5f24e-dcc9-4d12-883a-8b6f3505b79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:26.004354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5f24e-dcc9-4d12-883a-8b6f3505b79d admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:26.004778 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5f24e-dcc9-4d12-883a-8b6f3505b79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:26.005775 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5f24e-dcc9-4d12-883a-8b6f3505b79d admin admin] PATH_INFO: `/v3/projects/7b26fe74e5f54ea096892b7e529c7977/users/fa41018d1d194992b7b0a9ca07fe0749/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:26.008150 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5f24e-dcc9-4d12-883a-8b6f3505b79d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b26fe74e5f54ea096892b7e529c7977, user_id=fa41018d1d194992b7b0a9ca07fe0749, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:26.011195 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5f24e-dcc9-4d12-883a-8b6f3505b79d admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:26.043752 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1064/2132] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:25 2022] PUT /identity/v3/projects/7b26fe74e5f54ea096892b7e529c7977/users/fa41018d1d194992b7b0a9ca07fe0749/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:26.954505 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072844e-029a-400e-8a87-055acfb301e1 service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:26.956676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3072844e-029a-400e-8a87-055acfb301e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:26.975725 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072844e-029a-400e-8a87-055acfb301e1 service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:27.056026 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:27.083395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f12f0-597c-4eae-889e-b9dba50ffe78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:27.085086 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f12f0-597c-4eae-889e-b9dba50ffe78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:27.085909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f12f0-597c-4eae-889e-b9dba50ffe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:27.086347 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f12f0-597c-4eae-889e-b9dba50ffe78 admin admin] PATH_INFO: `/v3/users/6c4e262ef25b4bb8922877866d9ee02b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:27.089677 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f12f0-597c-4eae-889e-b9dba50ffe78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c4e262ef25b4bb8922877866d9ee02b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:27.092312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f12f0-597c-4eae-889e-b9dba50ffe78 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:27.113339 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826f1df-15b1-4e93-b165-b512cc9d7a85 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:27.113339 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826f1df-15b1-4e93-b165-b512cc9d7a85 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:27.113339 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826f1df-15b1-4e93-b165-b512cc9d7a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:27.170299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-1826f1df-15b1-4e93-b165-b512cc9d7a85 None None] MFA Rules not processed for user `a8330780c04d4ab9a43b5f49a1e7e4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:27.171937 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1826f1df-15b1-4e93-b165-b512cc9d7a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:27.205966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-757f12f0-597c-4eae-889e-b9dba50ffe78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c4e262ef25b4bb8922877866d9ee02b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:27.206735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-757f12f0-597c-4eae-889e-b9dba50ffe78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c4e262ef25b4bb8922877866d9ee02b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:27.224890 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-757f12f0-597c-4eae-889e-b9dba50ffe78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c4e262ef25b4bb8922877866d9ee02b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:27.255473 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-757f12f0-597c-4eae-889e-b9dba50ffe78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c4e262ef25b4bb8922877866d9ee02b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:27.256603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-757f12f0-597c-4eae-889e-b9dba50ffe78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c4e262ef25b4bb8922877866d9ee02b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:27.282834 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1065/2133] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:27.285331 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d3a6f-8f66-4c59-bd76-a6c34ef5408f None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:27.285996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d3a6f-8f66-4c59-bd76-a6c34ef5408f None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:27.286558 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d3a6f-8f66-4c59-bd76-a6c34ef5408f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:27.306320 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1069/2134] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:26 2022] DELETE /identity/v3/users/6c4e262ef25b4bb8922877866d9ee02b => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:56:27.306633 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f12f0-597c-4eae-889e-b9dba50ffe78 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:27.310745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-757f12f0-597c-4eae-889e-b9dba50ffe78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:27.329422 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-706d3a6f-8f66-4c59-bd76-a6c34ef5408f None None] MFA Rules not processed for user `fa41018d1d194992b7b0a9ca07fe0749`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:27.332821 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-706d3a6f-8f66-4c59-bd76-a6c34ef5408f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:27.337773 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:27.402518 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f12f0-597c-4eae-889e-b9dba50ffe78 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:27.406603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8035f-eef7-4f8f-904b-ea7dea65b797 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:27.408083 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8035f-eef7-4f8f-904b-ea7dea65b797 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:27.408465 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8035f-eef7-4f8f-904b-ea7dea65b797 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:27.408912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8035f-eef7-4f8f-904b-ea7dea65b797 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:27.441721 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1066/2135] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:27 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:27.443647 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57b097-0d51-4ad4-bd93-84b221f522b5 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:27.443952 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57b097-0d51-4ad4-bd93-84b221f522b5 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:27.444241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57b097-0d51-4ad4-bd93-84b221f522b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:27.472507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-dd57b097-0d51-4ad4-bd93-84b221f522b5 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:27.474076 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-dd57b097-0d51-4ad4-bd93-84b221f522b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:27.502303 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8035f-eef7-4f8f-904b-ea7dea65b797 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:27.504072 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8035f-eef7-4f8f-904b-ea7dea65b797 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:27.528274 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1070/2136] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:27.529776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2f576-b9ee-44f6-bbd4-4cb759f557be None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:27.530063 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2f576-b9ee-44f6-bbd4-4cb759f557be None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:27.530340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2f576-b9ee-44f6-bbd4-4cb759f557be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:27.565426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-11f2f576-b9ee-44f6-bbd4-4cb759f557be None None] MFA Rules not processed for user `16e40996a8944be5ae15208328832aad`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:27.566929 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-11f2f576-b9ee-44f6-bbd4-4cb759f557be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:27.583005 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1067/2137] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:27.591240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57b097-0d51-4ad4-bd93-84b221f522b5 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:27.592929 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-dd57b097-0d51-4ad4-bd93-84b221f522b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:27.594123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:27.698588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57b097-0d51-4ad4-bd93-84b221f522b5 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:27.707954 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df855f8-589d-495f-9661-7861f6b153ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:27.711451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df855f8-589d-495f-9661-7861f6b153ba service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:27.712968 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df855f8-589d-495f-9661-7861f6b153ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:27.713434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df855f8-589d-495f-9661-7861f6b153ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:27.727905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1071/2138] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:27.735827 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df855f8-589d-495f-9661-7861f6b153ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:27.737948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df855f8-589d-495f-9661-7861f6b153ba service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:27.740272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2f576-b9ee-44f6-bbd4-4cb759f557be None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:27.741936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-11f2f576-b9ee-44f6-bbd4-4cb759f557be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:27.793728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1068/2139] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:56:27.911506 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2f576-b9ee-44f6-bbd4-4cb759f557be None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:27.919227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd6a94-366f-4adb-a652-2c8051c236a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:27.920015 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd6a94-366f-4adb-a652-2c8051c236a4 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:27.920749 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd6a94-366f-4adb-a652-2c8051c236a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:27.925400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd6a94-366f-4adb-a652-2c8051c236a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:27.932223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-75bd6a94-366f-4adb-a652-2c8051c236a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:27.947774 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd6a94-366f-4adb-a652-2c8051c236a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:27.950066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd6a94-366f-4adb-a652-2c8051c236a4 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:27.966092 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1072/2140] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:56:28.266256 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df855f8-589d-495f-9661-7861f6b153ba service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:28.268253 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1df855f8-589d-495f-9661-7861f6b153ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:28.288921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df855f8-589d-495f-9661-7861f6b153ba service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:28.294686 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4d0a4-a55a-4717-9a6b-23ca97717630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:28.295323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4d0a4-a55a-4717-9a6b-23ca97717630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:28.295612 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4d0a4-a55a-4717-9a6b-23ca97717630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:28.295868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4d0a4-a55a-4717-9a6b-23ca97717630 admin admin] PATH_INFO: `/v3/projects/b7e5cb473a654a4bb90a9226369224ca` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:28.297685 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4d0a4-a55a-4717-9a6b-23ca97717630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7e5cb473a654a4bb90a9226369224ca)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:28.299638 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4d0a4-a55a-4717-9a6b-23ca97717630 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:28.348306 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:28.356860 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5bd4d0a4-a55a-4717-9a6b-23ca97717630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7e5cb473a654a4bb90a9226369224ca', 'request_id': 'req-5bd4d0a4-a55a-4717-9a6b-23ca97717630'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:28.365841 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5bd4d0a4-a55a-4717-9a6b-23ca97717630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7e5cb473a654a4bb90a9226369224ca', 'request_id': 'req-5bd4d0a4-a55a-4717-9a6b-23ca97717630'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:28.373203 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5bd4d0a4-a55a-4717-9a6b-23ca97717630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7e5cb473a654a4bb90a9226369224ca', 'request_id': 'req-5bd4d0a4-a55a-4717-9a6b-23ca97717630'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:28.384524 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5bd4d0a4-a55a-4717-9a6b-23ca97717630 admin admin] The token cache is being invalidate because project b7e5cb473a654a4bb90a9226369224ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:28.384816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5bd4d0a4-a55a-4717-9a6b-23ca97717630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:28.385499 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5bd4d0a4-a55a-4717-9a6b-23ca97717630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:28.387077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1069/2141] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:28 2022] DELETE /identity/v3/projects/b7e5cb473a654a4bb90a9226369224ca => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:56:28.391255 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd6a94-366f-4adb-a652-2c8051c236a4 service nova] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:28.403052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd6a94-366f-4adb-a652-2c8051c236a4 service nova] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:28.465866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffc37a-f8c3-41d1-93e9-3c3d69fd374f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:28.466515 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffc37a-f8c3-41d1-93e9-3c3d69fd374f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:28.466792 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffc37a-f8c3-41d1-93e9-3c3d69fd374f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:28.467062 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffc37a-f8c3-41d1-93e9-3c3d69fd374f admin admin] PATH_INFO: `/v3/users/7844036c89b74f0dae87075b3ee822c1` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:28.468233 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffc37a-f8c3-41d1-93e9-3c3d69fd374f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7844036c89b74f0dae87075b3ee822c1)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:28.470504 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffc37a-f8c3-41d1-93e9-3c3d69fd374f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:28.521448 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f1ffc37a-f8c3-41d1-93e9-3c3d69fd374f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7844036c89b74f0dae87075b3ee822c1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:28.522212 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f1ffc37a-f8c3-41d1-93e9-3c3d69fd374f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7844036c89b74f0dae87075b3ee822c1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:28.527549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:28.532201 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f1ffc37a-f8c3-41d1-93e9-3c3d69fd374f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7844036c89b74f0dae87075b3ee822c1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:28.549923 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f1ffc37a-f8c3-41d1-93e9-3c3d69fd374f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7844036c89b74f0dae87075b3ee822c1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:28.550745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f1ffc37a-f8c3-41d1-93e9-3c3d69fd374f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7844036c89b74f0dae87075b3ee822c1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:28.565252 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1073/2142] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:28 2022] DELETE /identity/v3/users/7844036c89b74f0dae87075b3ee822c1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:28.954080 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4d0a4-a55a-4717-9a6b-23ca97717630 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:28.955693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-5bd4d0a4-a55a-4717-9a6b-23ca97717630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:28.978993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4d0a4-a55a-4717-9a6b-23ca97717630 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:29.069327 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee361e1-218a-4278-a3d9-366a4304f467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:29.070296 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee361e1-218a-4278-a3d9-366a4304f467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:29.070579 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee361e1-218a-4278-a3d9-366a4304f467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:29.071228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee361e1-218a-4278-a3d9-366a4304f467 admin admin] PATH_INFO: `/v3/projects/56aa6deb76ef4f5597400e2c2867af05` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:29.073012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee361e1-218a-4278-a3d9-366a4304f467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56aa6deb76ef4f5597400e2c2867af05)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:29.075154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee361e1-218a-4278-a3d9-366a4304f467 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:29.147800 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2ee361e1-218a-4278-a3d9-366a4304f467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56aa6deb76ef4f5597400e2c2867af05', 'request_id': 'req-2ee361e1-218a-4278-a3d9-366a4304f467'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:29.168476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2ee361e1-218a-4278-a3d9-366a4304f467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56aa6deb76ef4f5597400e2c2867af05', 'request_id': 'req-2ee361e1-218a-4278-a3d9-366a4304f467'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:29.184787 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2ee361e1-218a-4278-a3d9-366a4304f467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56aa6deb76ef4f5597400e2c2867af05', 'request_id': 'req-2ee361e1-218a-4278-a3d9-366a4304f467'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:29.207027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2ee361e1-218a-4278-a3d9-366a4304f467 admin admin] The token cache is being invalidate because project 56aa6deb76ef4f5597400e2c2867af05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:29.211638 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2ee361e1-218a-4278-a3d9-366a4304f467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:29.213182 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2ee361e1-218a-4278-a3d9-366a4304f467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:29.223552 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1070/2143] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:28 2022] DELETE /identity/v3/projects/56aa6deb76ef4f5597400e2c2867af05 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:29.224705 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65237b-2fc0-4084-8894-e366b69fe410 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:29.225349 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65237b-2fc0-4084-8894-e366b69fe410 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:29.225435 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65237b-2fc0-4084-8894-e366b69fe410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:29.271179 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-ec65237b-2fc0-4084-8894-e366b69fe410 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:29.273967 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ec65237b-2fc0-4084-8894-e366b69fe410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:29.286961 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb34368-026c-4120-b1c4-13f5ce309e0a None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:29.287661 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb34368-026c-4120-b1c4-13f5ce309e0a None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:29.287661 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb34368-026c-4120-b1c4-13f5ce309e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:29.329827 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-2cb34368-026c-4120-b1c4-13f5ce309e0a None None] MFA Rules not processed for user `a8330780c04d4ab9a43b5f49a1e7e4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:29.331167 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-2cb34368-026c-4120-b1c4-13f5ce309e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:29.426482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1071/2144] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 28 17:56:29.435638 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1074/2145] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:56:29.444026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d42ab5-eda7-434e-968c-2c11d41f4e15 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:29.444310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d42ab5-eda7-434e-968c-2c11d41f4e15 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:29.444584 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d42ab5-eda7-434e-968c-2c11d41f4e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:29.454814 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:29.480587 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-d4d42ab5-eda7-434e-968c-2c11d41f4e15 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:29.481852 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-d4d42ab5-eda7-434e-968c-2c11d41f4e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:29.489911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1072/2146] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:29.494488 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65237b-2fc0-4084-8894-e366b69fe410 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:29.510987 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65237b-2fc0-4084-8894-e366b69fe410 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:29.517502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac6891-aebc-42cc-a169-87be48b120e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:29.518309 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac6891-aebc-42cc-a169-87be48b120e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:29.518910 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac6891-aebc-42cc-a169-87be48b120e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:29.519438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac6891-aebc-42cc-a169-87be48b120e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:29.520624 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac6891-aebc-42cc-a169-87be48b120e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:29.521039 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac6891-aebc-42cc-a169-87be48b120e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:29.523596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac6891-aebc-42cc-a169-87be48b120e7 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:29.548195 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d42ab5-eda7-434e-968c-2c11d41f4e15 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:29.557684 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1075/2147] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:56:29.561325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d42ab5-eda7-434e-968c-2c11d41f4e15 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:29.566923 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0418f-448e-4239-9141-572951b80366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:29.567822 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0418f-448e-4239-9141-572951b80366 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:29.568251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0418f-448e-4239-9141-572951b80366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:29.568707 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0418f-448e-4239-9141-572951b80366 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:29.569573 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0418f-448e-4239-9141-572951b80366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:29.572420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0418f-448e-4239-9141-572951b80366 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:29.611946 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1073/2148] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:29 2022] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:29.616099 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac6891-aebc-42cc-a169-87be48b120e7 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:29.633167 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac6891-aebc-42cc-a169-87be48b120e7 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:29.716974 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8277f4-5fb4-43ad-a185-072b35b4e027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:29.717739 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8277f4-5fb4-43ad-a185-072b35b4e027 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:29.718084 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8277f4-5fb4-43ad-a185-072b35b4e027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:29.718424 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8277f4-5fb4-43ad-a185-072b35b4e027 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:29.719685 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8277f4-5fb4-43ad-a185-072b35b4e027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:29.721892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8277f4-5fb4-43ad-a185-072b35b4e027 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:29.750156 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1076/2149] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:29 2022] POST /identity/v3/users => generated 284 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:29.754265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0418f-448e-4239-9141-572951b80366 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:29.772659 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0418f-448e-4239-9141-572951b80366 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:29.780283 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7ff19-aff7-469a-9fbf-2cbad3986236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:29.781033 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7ff19-aff7-469a-9fbf-2cbad3986236 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:29.781423 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7ff19-aff7-469a-9fbf-2cbad3986236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:29.781725 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7ff19-aff7-469a-9fbf-2cbad3986236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:29.782489 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7ff19-aff7-469a-9fbf-2cbad3986236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:29.784228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7ff19-aff7-469a-9fbf-2cbad3986236 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:29.818502 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1074/2150] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:29.822776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8277f4-5fb4-43ad-a185-072b35b4e027 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:29.838131 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8277f4-5fb4-43ad-a185-072b35b4e027 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:29.857960 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baef55e-f087-43c0-b8fd-66fea36827fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:29.858618 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baef55e-f087-43c0-b8fd-66fea36827fe admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:29.859003 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baef55e-f087-43c0-b8fd-66fea36827fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:29.859408 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baef55e-f087-43c0-b8fd-66fea36827fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:29.860210 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baef55e-f087-43c0-b8fd-66fea36827fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:29.862721 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baef55e-f087-43c0-b8fd-66fea36827fe admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:29.877659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1077/2151] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:56:29.882109 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7ff19-aff7-469a-9fbf-2cbad3986236 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:29.893007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7ff19-aff7-469a-9fbf-2cbad3986236 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:29.899770 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc033086-4544-4e35-b43d-d167f9a67dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:29.900466 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc033086-4544-4e35-b43d-d167f9a67dac admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:29.900743 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc033086-4544-4e35-b43d-d167f9a67dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:29.901015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc033086-4544-4e35-b43d-d167f9a67dac admin admin] PATH_INFO: `/v3/projects/684c8364fcef45858a32cb8d01c939c2/users/3090a1a7295544d88b74c66c56465add/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:29.926163 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc033086-4544-4e35-b43d-d167f9a67dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=684c8364fcef45858a32cb8d01c939c2, user_id=3090a1a7295544d88b74c66c56465add, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:29.928843 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc033086-4544-4e35-b43d-d167f9a67dac admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:29.949094 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1075/2152] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:29 2022] PUT /identity/v3/projects/684c8364fcef45858a32cb8d01c939c2/users/3090a1a7295544d88b74c66c56465add/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:29.958596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad37db-345c-4db0-8b44-800444bca435 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:29.958898 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad37db-345c-4db0-8b44-800444bca435 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:29.959197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad37db-345c-4db0-8b44-800444bca435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:29.989472 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-48ad37db-345c-4db0-8b44-800444bca435 None None] MFA Rules not processed for user `3090a1a7295544d88b74c66c56465add`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:29.990729 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-48ad37db-345c-4db0-8b44-800444bca435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:30.018724 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:30.068065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1078/2153] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:30.082571 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc033086-4544-4e35-b43d-d167f9a67dac admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:30.085000 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-bc033086-4544-4e35-b43d-d167f9a67dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:30.171055 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc033086-4544-4e35-b43d-d167f9a67dac admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:30.175269 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936eb94b-f0fc-4577-9374-e54f323442da service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98465c2d73e540b5bf506f5a7423e035', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:30.175889 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936eb94b-f0fc-4577-9374-e54f323442da service glance] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:30.176167 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936eb94b-f0fc-4577-9374-e54f323442da service glance] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:30.176441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936eb94b-f0fc-4577-9374-e54f323442da service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:30.185315 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936eb94b-f0fc-4577-9374-e54f323442da service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:30.186908 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936eb94b-f0fc-4577-9374-e54f323442da service glance] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:30.196887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1076/2154] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:32.395980 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad37db-345c-4db0-8b44-800444bca435 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:32.398396 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-48ad37db-345c-4db0-8b44-800444bca435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:32.565626 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad37db-345c-4db0-8b44-800444bca435 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:32.571717 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceee0d1-d57b-432e-bab3-2615a8a41172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:32.572493 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceee0d1-d57b-432e-bab3-2615a8a41172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:32.572773 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceee0d1-d57b-432e-bab3-2615a8a41172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:32.573446 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceee0d1-d57b-432e-bab3-2615a8a41172 admin admin] PATH_INFO: `/v3/users/b6f3b06f8e8e4fc6bfc7de7ffba76d42` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:32.575066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceee0d1-d57b-432e-bab3-2615a8a41172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f3b06f8e8e4fc6bfc7de7ffba76d42)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:32.576499 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceee0d1-d57b-432e-bab3-2615a8a41172 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:32.671015 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5ceee0d1-d57b-432e-bab3-2615a8a41172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f3b06f8e8e4fc6bfc7de7ffba76d42'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:32.671015 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5ceee0d1-d57b-432e-bab3-2615a8a41172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f3b06f8e8e4fc6bfc7de7ffba76d42'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:32.681710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5ceee0d1-d57b-432e-bab3-2615a8a41172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f3b06f8e8e4fc6bfc7de7ffba76d42'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:32.702753 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5ceee0d1-d57b-432e-bab3-2615a8a41172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f3b06f8e8e4fc6bfc7de7ffba76d42'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:32.703805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5ceee0d1-d57b-432e-bab3-2615a8a41172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f3b06f8e8e4fc6bfc7de7ffba76d42'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:32.725799 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1079/2155] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:32 2022] DELETE /identity/v3/users/b6f3b06f8e8e4fc6bfc7de7ffba76d42 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:56:32.730422 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1ab08-dc33-42fe-8409-e26fa28cca23 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:32.731314 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1ab08-dc33-42fe-8409-e26fa28cca23 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:32.731738 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1ab08-dc33-42fe-8409-e26fa28cca23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:32.760920 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-1ce1ab08-dc33-42fe-8409-e26fa28cca23 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:32.762494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1ce1ab08-dc33-42fe-8409-e26fa28cca23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:32.852214 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1077/2156] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:32.870090 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceee0d1-d57b-432e-bab3-2615a8a41172 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:32.872591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5ceee0d1-d57b-432e-bab3-2615a8a41172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:32.991576 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:33.015720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceee0d1-d57b-432e-bab3-2615a8a41172 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:33.030577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2d584-48b3-4677-8167-3a701d38bd3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:33.031493 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2d584-48b3-4677-8167-3a701d38bd3a service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:33.031774 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2d584-48b3-4677-8167-3a701d38bd3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:33.032048 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2d584-48b3-4677-8167-3a701d38bd3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:33.044968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2d584-48b3-4677-8167-3a701d38bd3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:33.046766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2d584-48b3-4677-8167-3a701d38bd3a service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:33.067370 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1080/2157] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:34.011381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1ab08-dc33-42fe-8409-e26fa28cca23 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:34.013454 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1ce1ab08-dc33-42fe-8409-e26fa28cca23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:34.034116 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1ab08-dc33-42fe-8409-e26fa28cca23 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:34.039334 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308ae3a-cf3e-422c-93fb-404b785535e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:34.040067 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308ae3a-cf3e-422c-93fb-404b785535e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:34.040461 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308ae3a-cf3e-422c-93fb-404b785535e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:34.040916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308ae3a-cf3e-422c-93fb-404b785535e3 admin admin] PATH_INFO: `/v3/projects/09183e79ca9940648112dfa525c6da0c` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:34.043266 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308ae3a-cf3e-422c-93fb-404b785535e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09183e79ca9940648112dfa525c6da0c)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:34.045938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308ae3a-cf3e-422c-93fb-404b785535e3 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:34.108684 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:34.136552 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e308ae3a-cf3e-422c-93fb-404b785535e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09183e79ca9940648112dfa525c6da0c', 'request_id': 'req-e308ae3a-cf3e-422c-93fb-404b785535e3'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:34.162861 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e308ae3a-cf3e-422c-93fb-404b785535e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09183e79ca9940648112dfa525c6da0c', 'request_id': 'req-e308ae3a-cf3e-422c-93fb-404b785535e3'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:34.198419 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e308ae3a-cf3e-422c-93fb-404b785535e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09183e79ca9940648112dfa525c6da0c', 'request_id': 'req-e308ae3a-cf3e-422c-93fb-404b785535e3'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:34.225707 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e308ae3a-cf3e-422c-93fb-404b785535e3 admin admin] The token cache is being invalidate because project 09183e79ca9940648112dfa525c6da0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:34.225876 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e308ae3a-cf3e-422c-93fb-404b785535e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:34.230826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e308ae3a-cf3e-422c-93fb-404b785535e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:34.235828 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1078/2158] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:34 2022] DELETE /identity/v3/projects/09183e79ca9940648112dfa525c6da0c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:34.240235 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2d584-48b3-4677-8167-3a701d38bd3a service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:34.277521 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2d584-48b3-4677-8167-3a701d38bd3a service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:34.379634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837c58e-2a9e-4ebc-984b-f24e9f8d48c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:34.380670 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837c58e-2a9e-4ebc-984b-f24e9f8d48c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:34.381111 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837c58e-2a9e-4ebc-984b-f24e9f8d48c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:34.381541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837c58e-2a9e-4ebc-984b-f24e9f8d48c6 admin admin] PATH_INFO: `/v3/users/ba1d5dc3cdb8458aa4502d242f3e60ea` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:34.383835 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837c58e-2a9e-4ebc-984b-f24e9f8d48c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba1d5dc3cdb8458aa4502d242f3e60ea)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:34.386618 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837c58e-2a9e-4ebc-984b-f24e9f8d48c6 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:34.519304 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7837c58e-2a9e-4ebc-984b-f24e9f8d48c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba1d5dc3cdb8458aa4502d242f3e60ea'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:34.522046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7837c58e-2a9e-4ebc-984b-f24e9f8d48c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba1d5dc3cdb8458aa4502d242f3e60ea'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:34.540037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7837c58e-2a9e-4ebc-984b-f24e9f8d48c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba1d5dc3cdb8458aa4502d242f3e60ea'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:34.593213 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7837c58e-2a9e-4ebc-984b-f24e9f8d48c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba1d5dc3cdb8458aa4502d242f3e60ea'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:34.603218 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7837c58e-2a9e-4ebc-984b-f24e9f8d48c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba1d5dc3cdb8458aa4502d242f3e60ea'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:34.700132 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1081/2159] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:34 2022] DELETE /identity/v3/users/ba1d5dc3cdb8458aa4502d242f3e60ea => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:35.217372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60341c8-0831-4e34-9146-dcf33ee466f9 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:35.218012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60341c8-0831-4e34-9146-dcf33ee466f9 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:35.218217 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60341c8-0831-4e34-9146-dcf33ee466f9 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:35.220162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1079/2160] 10.222.0.96 () {54 vars in 921 bytes} [Thu Jul 28 17:56:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:56:35.254377 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cee198-63aa-426d-944c-f336ee0fc64e None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:35.254977 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cee198-63aa-426d-944c-f336ee0fc64e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:35.254977 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cee198-63aa-426d-944c-f336ee0fc64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:35.295713 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-08cee198-63aa-426d-944c-f336ee0fc64e None None] MFA Rules not processed for user `38257735924d44488e1407fefb886324`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:35.301330 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-08cee198-63aa-426d-944c-f336ee0fc64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:35.323781 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60341c8-0831-4e34-9146-dcf33ee466f9 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:35.325930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-a60341c8-0831-4e34-9146-dcf33ee466f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:35.413097 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1082/2161] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Jul 28 17:56:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:35.438175 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cee198-63aa-426d-944c-f336ee0fc64e None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:35.440697 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-08cee198-63aa-426d-944c-f336ee0fc64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:35.449523 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:35.456893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cee198-63aa-426d-944c-f336ee0fc64e None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:35.470646 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce53e5-a360-48da-abdf-19cee77bf608 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38257735924d44488e1407fefb886324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:35.474411 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce53e5-a360-48da-abdf-19cee77bf608 service placement] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:35.474816 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce53e5-a360-48da-abdf-19cee77bf608 service placement] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:35.475108 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce53e5-a360-48da-abdf-19cee77bf608 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:35.481649 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60341c8-0831-4e34-9146-dcf33ee466f9 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:35.492960 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce53e5-a360-48da-abdf-19cee77bf608 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:35.493745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76e827-d85d-42e7-be56-d1f10e35a5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:35.494417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76e827-d85d-42e7-be56-d1f10e35a5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:35.494886 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76e827-d85d-42e7-be56-d1f10e35a5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:35.495157 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76e827-d85d-42e7-be56-d1f10e35a5bf admin admin] PATH_INFO: `/v3/users/7fe1bb900c544286ba2fbed4f1d8c066` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:35.496454 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76e827-d85d-42e7-be56-d1f10e35a5bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe1bb900c544286ba2fbed4f1d8c066)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:35.497617 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce53e5-a360-48da-abdf-19cee77bf608 service placement] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:35.498934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76e827-d85d-42e7-be56-d1f10e35a5bf admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:35.511367 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1083/2162] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:56:35.565269 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-0d76e827-d85d-42e7-be56-d1f10e35a5bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe1bb900c544286ba2fbed4f1d8c066'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:35.579022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-0d76e827-d85d-42e7-be56-d1f10e35a5bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe1bb900c544286ba2fbed4f1d8c066'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:35.587881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-0d76e827-d85d-42e7-be56-d1f10e35a5bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe1bb900c544286ba2fbed4f1d8c066'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:35.595178 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-0d76e827-d85d-42e7-be56-d1f10e35a5bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe1bb900c544286ba2fbed4f1d8c066'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:35.595872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-0d76e827-d85d-42e7-be56-d1f10e35a5bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe1bb900c544286ba2fbed4f1d8c066'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:35.602594 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1080/2163] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:35 2022] DELETE /identity/v3/users/7fe1bb900c544286ba2fbed4f1d8c066 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:35.603628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce53e5-a360-48da-abdf-19cee77bf608 service placement] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:35.605211 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-60ce53e5-a360-48da-abdf-19cee77bf608 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:35.623355 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce53e5-a360-48da-abdf-19cee77bf608 service placement] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:35.703088 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4a489-1cb5-4ed6-9be6-3ef30c01a52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:35.703883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4a489-1cb5-4ed6-9be6-3ef30c01a52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:35.704220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4a489-1cb5-4ed6-9be6-3ef30c01a52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:35.704556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4a489-1cb5-4ed6-9be6-3ef30c01a52f admin admin] PATH_INFO: `/v3/projects/94332a8addfc498ba2178a32453b5397` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:35.705796 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4a489-1cb5-4ed6-9be6-3ef30c01a52f admin admin] RBAC: Authorizing `identity:delete_project(project_id=94332a8addfc498ba2178a32453b5397)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:35.707798 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4a489-1cb5-4ed6-9be6-3ef30c01a52f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:35.764675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-50f4a489-1cb5-4ed6-9be6-3ef30c01a52f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94332a8addfc498ba2178a32453b5397', 'request_id': 'req-50f4a489-1cb5-4ed6-9be6-3ef30c01a52f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:35.771416 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-50f4a489-1cb5-4ed6-9be6-3ef30c01a52f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94332a8addfc498ba2178a32453b5397', 'request_id': 'req-50f4a489-1cb5-4ed6-9be6-3ef30c01a52f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:35.779768 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-50f4a489-1cb5-4ed6-9be6-3ef30c01a52f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94332a8addfc498ba2178a32453b5397', 'request_id': 'req-50f4a489-1cb5-4ed6-9be6-3ef30c01a52f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:35.791014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-50f4a489-1cb5-4ed6-9be6-3ef30c01a52f admin admin] The token cache is being invalidate because project 94332a8addfc498ba2178a32453b5397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:35.791441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-50f4a489-1cb5-4ed6-9be6-3ef30c01a52f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:35.792229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-50f4a489-1cb5-4ed6-9be6-3ef30c01a52f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:35.794023 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1084/2164] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:35 2022] DELETE /identity/v3/projects/94332a8addfc498ba2178a32453b5397 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:56:35.800319 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bd85f-a950-408d-a42e-97db3df2ff20 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:35.800763 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bd85f-a950-408d-a42e-97db3df2ff20 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:35.801136 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bd85f-a950-408d-a42e-97db3df2ff20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:35.815786 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4a489-1cb5-4ed6-9be6-3ef30c01a52f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:35.819507 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-50f4a489-1cb5-4ed6-9be6-3ef30c01a52f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:35.826212 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-3c2bd85f-a950-408d-a42e-97db3df2ff20 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:35.827465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-3c2bd85f-a950-408d-a42e-97db3df2ff20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:35.876565 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:35.897326 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1081/2165] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:35.898246 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4a489-1cb5-4ed6-9be6-3ef30c01a52f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:35.902953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3da5b9-e8b7-4cfb-8004-69a54fb92b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:35.903619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3da5b9-e8b7-4cfb-8004-69a54fb92b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:35.903897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3da5b9-e8b7-4cfb-8004-69a54fb92b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:35.904173 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3da5b9-e8b7-4cfb-8004-69a54fb92b09 admin admin] PATH_INFO: `/v3/projects/4488dea1ea244c5da3033646031190de` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:35.905378 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3da5b9-e8b7-4cfb-8004-69a54fb92b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4488dea1ea244c5da3033646031190de)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:35.906729 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389248f2-c552-4f84-bb0c-0a3452eb80ef None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:35.907015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389248f2-c552-4f84-bb0c-0a3452eb80ef None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:35.907307 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389248f2-c552-4f84-bb0c-0a3452eb80ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:35.907407 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3da5b9-e8b7-4cfb-8004-69a54fb92b09 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:35.927927 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-389248f2-c552-4f84-bb0c-0a3452eb80ef None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:35.929618 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-389248f2-c552-4f84-bb0c-0a3452eb80ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:35.932469 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:35.945096 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1082/2166] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:56:35.949856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389248f2-c552-4f84-bb0c-0a3452eb80ef None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:35.959032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389248f2-c552-4f84-bb0c-0a3452eb80ef None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:35.965605 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ca3da5b9-e8b7-4cfb-8004-69a54fb92b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4488dea1ea244c5da3033646031190de', 'request_id': 'req-ca3da5b9-e8b7-4cfb-8004-69a54fb92b09'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:35.972158 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ca3da5b9-e8b7-4cfb-8004-69a54fb92b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4488dea1ea244c5da3033646031190de', 'request_id': 'req-ca3da5b9-e8b7-4cfb-8004-69a54fb92b09'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:35.980146 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ca3da5b9-e8b7-4cfb-8004-69a54fb92b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4488dea1ea244c5da3033646031190de', 'request_id': 'req-ca3da5b9-e8b7-4cfb-8004-69a54fb92b09'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:35.991325 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ca3da5b9-e8b7-4cfb-8004-69a54fb92b09 admin admin] The token cache is being invalidate because project 4488dea1ea244c5da3033646031190de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:35.992015 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ca3da5b9-e8b7-4cfb-8004-69a54fb92b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:35.992783 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ca3da5b9-e8b7-4cfb-8004-69a54fb92b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:35.995006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1085/2167] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:35 2022] DELETE /identity/v3/projects/4488dea1ea244c5da3033646031190de => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:56:36.001943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10130cdb-b74b-4404-8c69-8f350ee16bdd None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:36.002227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10130cdb-b74b-4404-8c69-8f350ee16bdd None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:36.002504 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10130cdb-b74b-4404-8c69-8f350ee16bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:36.026128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-10130cdb-b74b-4404-8c69-8f350ee16bdd None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:36.027385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-10130cdb-b74b-4404-8c69-8f350ee16bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:36.030181 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502ea5f-fbda-4c4d-af33-0c106538e89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:36.030519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502ea5f-fbda-4c4d-af33-0c106538e89b admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:36.030805 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502ea5f-fbda-4c4d-af33-0c106538e89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:36.031081 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502ea5f-fbda-4c4d-af33-0c106538e89b admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:36.031784 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502ea5f-fbda-4c4d-af33-0c106538e89b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:36.032091 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502ea5f-fbda-4c4d-af33-0c106538e89b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:36.033820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502ea5f-fbda-4c4d-af33-0c106538e89b admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:36.037024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1086/2168] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:36.046513 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621d036-ef2f-4e5e-ad68-ab167ecbab65 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:36.047417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621d036-ef2f-4e5e-ad68-ab167ecbab65 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:36.051032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1083/2169] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:56:36.051216 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621d036-ef2f-4e5e-ad68-ab167ecbab65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:36.052234 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502ea5f-fbda-4c4d-af33-0c106538e89b admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:36.054260 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f502ea5f-fbda-4c4d-af33-0c106538e89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:36.066513 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502ea5f-fbda-4c4d-af33-0c106538e89b admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:36.069898 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d621d036-ef2f-4e5e-ad68-ab167ecbab65 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:36.071222 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d621d036-ef2f-4e5e-ad68-ab167ecbab65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:36.071510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6bf3e-1ffc-4688-9e11-d29d2bdf1af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:36.072102 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6bf3e-1ffc-4688-9e11-d29d2bdf1af3 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:36.072379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6bf3e-1ffc-4688-9e11-d29d2bdf1af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:36.072650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6bf3e-1ffc-4688-9e11-d29d2bdf1af3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:36.073355 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6bf3e-1ffc-4688-9e11-d29d2bdf1af3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:36.075294 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6bf3e-1ffc-4688-9e11-d29d2bdf1af3 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:36.079488 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1087/2170] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:36.083963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621d036-ef2f-4e5e-ad68-ab167ecbab65 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:36.096785 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621d036-ef2f-4e5e-ad68-ab167ecbab65 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:36.104645 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c194685-2e7a-4f6b-84ca-8f684cc1da9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:36.105306 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c194685-2e7a-4f6b-84ca-8f684cc1da9b admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:36.105600 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c194685-2e7a-4f6b-84ca-8f684cc1da9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:36.105879 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c194685-2e7a-4f6b-84ca-8f684cc1da9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:36.106585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c194685-2e7a-4f6b-84ca-8f684cc1da9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:36.106890 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c194685-2e7a-4f6b-84ca-8f684cc1da9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:36.107916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1084/2171] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:36 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:36.112424 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c194685-2e7a-4f6b-84ca-8f684cc1da9b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:36.113262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6bf3e-1ffc-4688-9e11-d29d2bdf1af3 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:36.126777 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1088/2172] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:56:36.131602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c194685-2e7a-4f6b-84ca-8f684cc1da9b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:36.145019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c194685-2e7a-4f6b-84ca-8f684cc1da9b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:36.210039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6bf3e-1ffc-4688-9e11-d29d2bdf1af3 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:36.219765 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610522a2-8998-47c1-a07e-3978d011b384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:36.221380 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610522a2-8998-47c1-a07e-3978d011b384 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:36.221822 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610522a2-8998-47c1-a07e-3978d011b384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:36.222257 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610522a2-8998-47c1-a07e-3978d011b384 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:36.223081 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610522a2-8998-47c1-a07e-3978d011b384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:36.226801 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610522a2-8998-47c1-a07e-3978d011b384 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:36.246276 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651af19c-35fd-4b49-88dc-e430bfa12eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:36.247550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651af19c-35fd-4b49-88dc-e430bfa12eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:36.247933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651af19c-35fd-4b49-88dc-e430bfa12eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:36.248378 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651af19c-35fd-4b49-88dc-e430bfa12eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:36.249365 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651af19c-35fd-4b49-88dc-e430bfa12eb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:36.254390 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651af19c-35fd-4b49-88dc-e430bfa12eb3 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:36.255008 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1085/2173] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:36 2022] POST /identity/v3/users => generated 284 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:56:36.258123 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610522a2-8998-47c1-a07e-3978d011b384 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:36.269385 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610522a2-8998-47c1-a07e-3978d011b384 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:36.275780 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be330b2f-86ed-4db1-8b61-44e34cfa01a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:36.276793 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be330b2f-86ed-4db1-8b61-44e34cfa01a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:36.277385 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be330b2f-86ed-4db1-8b61-44e34cfa01a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:36.277901 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be330b2f-86ed-4db1-8b61-44e34cfa01a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:36.278856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be330b2f-86ed-4db1-8b61-44e34cfa01a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:36.280766 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be330b2f-86ed-4db1-8b61-44e34cfa01a8 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:36.291165 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1089/2174] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:36 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:36.293031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1086/2175] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:56:36.295748 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651af19c-35fd-4b49-88dc-e430bfa12eb3 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:36.297235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be330b2f-86ed-4db1-8b61-44e34cfa01a8 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:36.312131 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be330b2f-86ed-4db1-8b61-44e34cfa01a8 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:36.341498 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:36.395123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651af19c-35fd-4b49-88dc-e430bfa12eb3 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:36.398178 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63501796-a4ec-42d3-8d42-0e05c305d599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:36.398948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63501796-a4ec-42d3-8d42-0e05c305d599 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:36.399501 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63501796-a4ec-42d3-8d42-0e05c305d599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:36.399776 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63501796-a4ec-42d3-8d42-0e05c305d599 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:36.401023 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63501796-a4ec-42d3-8d42-0e05c305d599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:36.402433 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136981c-f925-4460-9305-202978699a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:36.402965 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63501796-a4ec-42d3-8d42-0e05c305d599 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:36.403427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136981c-f925-4460-9305-202978699a32 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:36.403846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136981c-f925-4460-9305-202978699a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:36.404258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136981c-f925-4460-9305-202978699a32 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:36.405121 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136981c-f925-4460-9305-202978699a32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:36.417249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136981c-f925-4460-9305-202978699a32 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:36.417375 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1087/2176] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:36.424516 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63501796-a4ec-42d3-8d42-0e05c305d599 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:36.434689 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:36.436781 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63501796-a4ec-42d3-8d42-0e05c305d599 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:36.441754 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1090/2177] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:36 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:36.442425 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ee64d-e23a-455d-8be9-d305371b53a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:36.443133 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ee64d-e23a-455d-8be9-d305371b53a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:36.443411 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ee64d-e23a-455d-8be9-d305371b53a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:36.443686 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ee64d-e23a-455d-8be9-d305371b53a3 admin admin] PATH_INFO: `/v3/projects/758c95af63644c9491fc430e98728445/users/77d5548a4ccb4859ab659d5064575b08/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:36.446814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136981c-f925-4460-9305-202978699a32 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:36.469923 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136981c-f925-4460-9305-202978699a32 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:36.475203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ec0ca-bf34-450d-bd0c-7422147f5591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:36.476154 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ec0ca-bf34-450d-bd0c-7422147f5591 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:36.476711 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ec0ca-bf34-450d-bd0c-7422147f5591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:36.477045 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ec0ca-bf34-450d-bd0c-7422147f5591 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:36.477494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ee64d-e23a-455d-8be9-d305371b53a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758c95af63644c9491fc430e98728445, user_id=77d5548a4ccb4859ab659d5064575b08, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:36.478126 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ec0ca-bf34-450d-bd0c-7422147f5591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:36.480096 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ec0ca-bf34-450d-bd0c-7422147f5591 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:36.481697 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ee64d-e23a-455d-8be9-d305371b53a3 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:36.499241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1091/2178] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:36.503137 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ec0ca-bf34-450d-bd0c-7422147f5591 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:36.513098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1088/2179] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:36 2022] PUT /identity/v3/projects/758c95af63644c9491fc430e98728445/users/77d5548a4ccb4859ab659d5064575b08/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:56:36.518622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ec0ca-bf34-450d-bd0c-7422147f5591 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:36.524828 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741f8f0-cb2c-4019-bb77-c15987c1113e None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:36.525582 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741f8f0-cb2c-4019-bb77-c15987c1113e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:36.526584 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741f8f0-cb2c-4019-bb77-c15987c1113e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:36.574866 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-0741f8f0-cb2c-4019-bb77-c15987c1113e None None] MFA Rules not processed for user `77d5548a4ccb4859ab659d5064575b08`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:36.576769 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-0741f8f0-cb2c-4019-bb77-c15987c1113e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:36.613614 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28cfd5-8804-436d-9b5c-adf2a46a6e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:36.614526 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28cfd5-8804-436d-9b5c-adf2a46a6e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:36.615049 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28cfd5-8804-436d-9b5c-adf2a46a6e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:36.615531 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28cfd5-8804-436d-9b5c-adf2a46a6e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:36.616523 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28cfd5-8804-436d-9b5c-adf2a46a6e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:36.619373 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28cfd5-8804-436d-9b5c-adf2a46a6e1a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:36.639687 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1092/2180] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:36.645329 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28cfd5-8804-436d-9b5c-adf2a46a6e1a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:36.660019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28cfd5-8804-436d-9b5c-adf2a46a6e1a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:36.669239 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b76bc-6f3c-4634-a877-73588fe1a8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:36.670016 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b76bc-6f3c-4634-a877-73588fe1a8f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:36.670301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b76bc-6f3c-4634-a877-73588fe1a8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:36.670578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b76bc-6f3c-4634-a877-73588fe1a8f8 admin admin] PATH_INFO: `/v3/projects/62c839cc3de8444096cd196d9be403f4/users/a00b6b9e5f8b4cceb8a3197e0349fa65/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:36.681528 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1089/2181] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:56:36.687649 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741f8f0-cb2c-4019-bb77-c15987c1113e None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:36.705474 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b76bc-6f3c-4634-a877-73588fe1a8f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c839cc3de8444096cd196d9be403f4, user_id=a00b6b9e5f8b4cceb8a3197e0349fa65, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:36.707790 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741f8f0-cb2c-4019-bb77-c15987c1113e None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:36.710997 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b76bc-6f3c-4634-a877-73588fe1a8f8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:36.720099 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bf543-dae5-4774-8ea8-8936af14265d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:36.721595 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bf543-dae5-4774-8ea8-8936af14265d admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:36.721879 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bf543-dae5-4774-8ea8-8936af14265d admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:36.722545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bf543-dae5-4774-8ea8-8936af14265d admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:36.724529 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7bf543-dae5-4774-8ea8-8936af14265d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:36.727063 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7bf543-dae5-4774-8ea8-8936af14265d admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:36.735153 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1093/2182] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:36 2022] PUT /identity/v3/projects/62c839cc3de8444096cd196d9be403f4/users/a00b6b9e5f8b4cceb8a3197e0349fa65/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:36.737216 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff963090-3eec-4b7e-b127-04d71fee7012 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:36.737459 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff963090-3eec-4b7e-b127-04d71fee7012 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:36.737737 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff963090-3eec-4b7e-b127-04d71fee7012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:36.776343 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-ff963090-3eec-4b7e-b127-04d71fee7012 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:36.777614 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ff963090-3eec-4b7e-b127-04d71fee7012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:36.779953 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1090/2183] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:36 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:56:36.784054 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bf543-dae5-4774-8ea8-8936af14265d admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:36.878817 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1094/2184] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:36.886298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff963090-3eec-4b7e-b127-04d71fee7012 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:36.888885 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ff963090-3eec-4b7e-b127-04d71fee7012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:36.908268 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bf543-dae5-4774-8ea8-8936af14265d admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:36.922526 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f52e8-2f6f-40ce-91be-54e83643d9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:36.922526 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f52e8-2f6f-40ce-91be-54e83643d9cd admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:36.922526 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f52e8-2f6f-40ce-91be-54e83643d9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:36.922526 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f52e8-2f6f-40ce-91be-54e83643d9cd admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:36.922847 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f52e8-2f6f-40ce-91be-54e83643d9cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:36.922847 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f52e8-2f6f-40ce-91be-54e83643d9cd admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:36.948189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:36.959254 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1091/2185] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:36 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:56:36.960490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f52e8-2f6f-40ce-91be-54e83643d9cd admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:36.965631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff963090-3eec-4b7e-b127-04d71fee7012 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:36.970417 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b63b8-e27c-4b9c-90af-a49e5beb6179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:36.971190 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b63b8-e27c-4b9c-90af-a49e5beb6179 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:36.971457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b63b8-e27c-4b9c-90af-a49e5beb6179 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:36.971727 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b63b8-e27c-4b9c-90af-a49e5beb6179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:36.971843 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f52e8-2f6f-40ce-91be-54e83643d9cd admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:36.978701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a97be0-4713-45ff-8908-a17b2a819443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:36.979408 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a97be0-4713-45ff-8908-a17b2a819443 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:36.979760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a97be0-4713-45ff-8908-a17b2a819443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:36.980103 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a97be0-4713-45ff-8908-a17b2a819443 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:36.980930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a97be0-4713-45ff-8908-a17b2a819443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:36.982791 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a97be0-4713-45ff-8908-a17b2a819443 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:36.985562 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b63b8-e27c-4b9c-90af-a49e5beb6179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:36.987257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b63b8-e27c-4b9c-90af-a49e5beb6179 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:36.995111 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1092/2186] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:37.000318 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a97be0-4713-45ff-8908-a17b2a819443 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:37.012081 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1095/2187] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:37.016778 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a97be0-4713-45ff-8908-a17b2a819443 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:37.030844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13471e7f-5013-4921-b259-4a72a74652ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:37.031684 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13471e7f-5013-4921-b259-4a72a74652ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:37.032379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13471e7f-5013-4921-b259-4a72a74652ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:37.032659 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13471e7f-5013-4921-b259-4a72a74652ad admin admin] PATH_INFO: `/v3/projects/47feaede376d43aba302b2cd0e8939ea/users/14be4459e7194a75a704ccda17d2792d/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:37.055470 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13471e7f-5013-4921-b259-4a72a74652ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=47feaede376d43aba302b2cd0e8939ea, user_id=14be4459e7194a75a704ccda17d2792d, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:37.058181 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13471e7f-5013-4921-b259-4a72a74652ad admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:37.077464 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1093/2188] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:36 2022] PUT /identity/v3/projects/47feaede376d43aba302b2cd0e8939ea/users/14be4459e7194a75a704ccda17d2792d/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:37.081992 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b63b8-e27c-4b9c-90af-a49e5beb6179 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:37.087739 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:37.094125 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b63b8-e27c-4b9c-90af-a49e5beb6179 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:37.179458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abe83a-bb77-4de9-a2c8-e3162cbd453e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:37.180535 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abe83a-bb77-4de9-a2c8-e3162cbd453e admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:37.180824 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abe83a-bb77-4de9-a2c8-e3162cbd453e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:37.183545 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abe83a-bb77-4de9-a2c8-e3162cbd453e admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:37.183545 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13abe83a-bb77-4de9-a2c8-e3162cbd453e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:37.184389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13abe83a-bb77-4de9-a2c8-e3162cbd453e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:37.225296 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1096/2189] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:37.232044 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13471e7f-5013-4921-b259-4a72a74652ad admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:37.266399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13471e7f-5013-4921-b259-4a72a74652ad admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:37.274452 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d92d3-c479-49f4-ba68-a1e9941bb6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:37.275322 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d92d3-c479-49f4-ba68-a1e9941bb6b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:37.275704 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d92d3-c479-49f4-ba68-a1e9941bb6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:37.276130 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d92d3-c479-49f4-ba68-a1e9941bb6b4 admin admin] PATH_INFO: `/v3/projects/47feaede376d43aba302b2cd0e8939ea/users/14be4459e7194a75a704ccda17d2792d/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:37.278349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d92d3-c479-49f4-ba68-a1e9941bb6b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47feaede376d43aba302b2cd0e8939ea, user_id=14be4459e7194a75a704ccda17d2792d, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:37.281473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d92d3-c479-49f4-ba68-a1e9941bb6b4 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:37.294088 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1094/2190] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:37 2022] PUT /identity/v3/projects/47feaede376d43aba302b2cd0e8939ea/users/14be4459e7194a75a704ccda17d2792d/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:37.306409 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aafab-78f3-4e93-934a-65ae8304f400 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:37.307037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aafab-78f3-4e93-934a-65ae8304f400 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:37.307037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aafab-78f3-4e93-934a-65ae8304f400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:37.340999 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-037aafab-78f3-4e93-934a-65ae8304f400 None None] MFA Rules not processed for user `14be4459e7194a75a704ccda17d2792d`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:37.342319 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-037aafab-78f3-4e93-934a-65ae8304f400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:37.450463 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1097/2191] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:37 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:37.463465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d92d3-c479-49f4-ba68-a1e9941bb6b4 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:37.465794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-0a8d92d3-c479-49f4-ba68-a1e9941bb6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:37.566035 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d92d3-c479-49f4-ba68-a1e9941bb6b4 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:37.570115 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff1aa1-71eb-4c0a-af50-db9c403a46c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:37.570782 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff1aa1-71eb-4c0a-af50-db9c403a46c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:37.571075 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff1aa1-71eb-4c0a-af50-db9c403a46c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:37.571355 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff1aa1-71eb-4c0a-af50-db9c403a46c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:37.582771 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff1aa1-71eb-4c0a-af50-db9c403a46c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:37.584536 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff1aa1-71eb-4c0a-af50-db9c403a46c6 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:37.597794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1095/2192] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:37.724394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037aafab-78f3-4e93-934a-65ae8304f400 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:37.743151 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037aafab-78f3-4e93-934a-65ae8304f400 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:37.749496 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f36973-45ed-48af-b868-88d2792ef5f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:37.751490 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f36973-45ed-48af-b868-88d2792ef5f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:37.752424 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f36973-45ed-48af-b868-88d2792ef5f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:37.752909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f36973-45ed-48af-b868-88d2792ef5f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:37.878463 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f36973-45ed-48af-b868-88d2792ef5f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:37.879775 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f36973-45ed-48af-b868-88d2792ef5f4 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:37.897507 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1098/2193] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:42.410914 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110da2a6-42ce-4a6d-af4a-cb66888bc061 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:42.411415 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110da2a6-42ce-4a6d-af4a-cb66888bc061 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:42.411617 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110da2a6-42ce-4a6d-af4a-cb66888bc061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:42.447396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-110da2a6-42ce-4a6d-af4a-cb66888bc061 None None] MFA Rules not processed for user `a00b6b9e5f8b4cceb8a3197e0349fa65`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:42.448632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-110da2a6-42ce-4a6d-af4a-cb66888bc061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:42.527917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1096/2194] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:42.543046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f36973-45ed-48af-b868-88d2792ef5f4 service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:42.544628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-10f36973-45ed-48af-b868-88d2792ef5f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:42.578164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:42.632671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f36973-45ed-48af-b868-88d2792ef5f4 service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:42.638497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3849c-d911-4df2-bb83-bea886f5abaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:42.639126 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3849c-d911-4df2-bb83-bea886f5abaa service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:42.639403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3849c-d911-4df2-bb83-bea886f5abaa service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:42.639697 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3849c-d911-4df2-bb83-bea886f5abaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:42.648754 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3849c-d911-4df2-bb83-bea886f5abaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:42.650152 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3849c-d911-4df2-bb83-bea886f5abaa service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:42.665430 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1099/2195] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:43.646301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110da2a6-42ce-4a6d-af4a-cb66888bc061 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:43.721437 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:43.771074 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110da2a6-42ce-4a6d-af4a-cb66888bc061 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:43.788610 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224b28b-2c39-4cfd-a22e-6fcb7afe649d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:43.789790 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224b28b-2c39-4cfd-a22e-6fcb7afe649d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:43.790079 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224b28b-2c39-4cfd-a22e-6fcb7afe649d admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:43.791320 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224b28b-2c39-4cfd-a22e-6fcb7afe649d admin admin] PATH_INFO: `/v3/users/77d5548a4ccb4859ab659d5064575b08` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:43.795211 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224b28b-2c39-4cfd-a22e-6fcb7afe649d admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d5548a4ccb4859ab659d5064575b08)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:43.798237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224b28b-2c39-4cfd-a22e-6fcb7afe649d admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:43.884565 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-1224b28b-2c39-4cfd-a22e-6fcb7afe649d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d5548a4ccb4859ab659d5064575b08'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:43.899320 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-1224b28b-2c39-4cfd-a22e-6fcb7afe649d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d5548a4ccb4859ab659d5064575b08'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:43.916799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-1224b28b-2c39-4cfd-a22e-6fcb7afe649d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d5548a4ccb4859ab659d5064575b08'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:43.931713 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-1224b28b-2c39-4cfd-a22e-6fcb7afe649d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d5548a4ccb4859ab659d5064575b08'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:43.932575 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-1224b28b-2c39-4cfd-a22e-6fcb7afe649d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d5548a4ccb4859ab659d5064575b08'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:43.944294 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1097/2196] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:43 2022] DELETE /identity/v3/users/77d5548a4ccb4859ab659d5064575b08 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:43.945316 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cb6b5-91fc-4389-963e-5973548ce2ec None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:43.946074 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cb6b5-91fc-4389-963e-5973548ce2ec None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:43.946675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cb6b5-91fc-4389-963e-5973548ce2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:43.990479 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-791cb6b5-91fc-4389-963e-5973548ce2ec None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:43.991850 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-791cb6b5-91fc-4389-963e-5973548ce2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:44.077509 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1100/2197] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:56:44.089397 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224b28b-2c39-4cfd-a22e-6fcb7afe649d admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:44.091708 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1224b28b-2c39-4cfd-a22e-6fcb7afe649d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:44.153097 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224b28b-2c39-4cfd-a22e-6fcb7afe649d admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:44.156732 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cc6ab-7988-4f92-9f47-66de8cba8867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:44.157617 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cc6ab-7988-4f92-9f47-66de8cba8867 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:44.157902 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cc6ab-7988-4f92-9f47-66de8cba8867 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:44.158173 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cc6ab-7988-4f92-9f47-66de8cba8867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:44.170210 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cc6ab-7988-4f92-9f47-66de8cba8867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:44.171822 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cc6ab-7988-4f92-9f47-66de8cba8867 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:44.182819 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1098/2198] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:44.708681 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cb6b5-91fc-4389-963e-5973548ce2ec None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:44.710218 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-791cb6b5-91fc-4389-963e-5973548ce2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:44.723484 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cb6b5-91fc-4389-963e-5973548ce2ec None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:44.729116 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c877da1-0b1b-42e1-802f-348245a15a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:44.730607 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c877da1-0b1b-42e1-802f-348245a15a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:44.731035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c877da1-0b1b-42e1-802f-348245a15a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:44.731464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c877da1-0b1b-42e1-802f-348245a15a76 admin admin] PATH_INFO: `/v3/projects/758c95af63644c9491fc430e98728445` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:44.732979 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c877da1-0b1b-42e1-802f-348245a15a76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=758c95af63644c9491fc430e98728445)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:44.734995 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c877da1-0b1b-42e1-802f-348245a15a76 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:44.841303 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9c877da1-0b1b-42e1-802f-348245a15a76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758c95af63644c9491fc430e98728445', 'request_id': 'req-9c877da1-0b1b-42e1-802f-348245a15a76'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:44.853993 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9c877da1-0b1b-42e1-802f-348245a15a76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758c95af63644c9491fc430e98728445', 'request_id': 'req-9c877da1-0b1b-42e1-802f-348245a15a76'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:44.872136 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9c877da1-0b1b-42e1-802f-348245a15a76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758c95af63644c9491fc430e98728445', 'request_id': 'req-9c877da1-0b1b-42e1-802f-348245a15a76'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:44.931071 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9c877da1-0b1b-42e1-802f-348245a15a76 admin admin] The token cache is being invalidate because project 758c95af63644c9491fc430e98728445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:44.931382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9c877da1-0b1b-42e1-802f-348245a15a76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:44.932165 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9c877da1-0b1b-42e1-802f-348245a15a76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:44.937232 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1101/2199] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:44 2022] DELETE /identity/v3/projects/758c95af63644c9491fc430e98728445 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:44.938939 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cc6ab-7988-4f92-9f47-66de8cba8867 service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:44.979416 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cc6ab-7988-4f92-9f47-66de8cba8867 service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:45.123249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b01695-5af2-4983-8c47-0e162347c99d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:45.132104 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b01695-5af2-4983-8c47-0e162347c99d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:45.132709 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b01695-5af2-4983-8c47-0e162347c99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:45.139404 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b236892-dc3a-481a-8b09-aac7bbd53ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:45.140728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b236892-dc3a-481a-8b09-aac7bbd53ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:45.141017 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b236892-dc3a-481a-8b09-aac7bbd53ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:45.142480 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b236892-dc3a-481a-8b09-aac7bbd53ef6 admin admin] PATH_INFO: `/v3/users/14be4459e7194a75a704ccda17d2792d` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:45.143005 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b236892-dc3a-481a-8b09-aac7bbd53ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14be4459e7194a75a704ccda17d2792d)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:45.145349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b236892-dc3a-481a-8b09-aac7bbd53ef6 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:45.156774 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-85b01695-5af2-4983-8c47-0e162347c99d None None] MFA Rules not processed for user `a00b6b9e5f8b4cceb8a3197e0349fa65`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:45.158403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-85b01695-5af2-4983-8c47-0e162347c99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:45.166547 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:45.191644 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:45.241828 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1102/2200] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:45.245389 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5b236892-dc3a-481a-8b09-aac7bbd53ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14be4459e7194a75a704ccda17d2792d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:45.262104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5b236892-dc3a-481a-8b09-aac7bbd53ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14be4459e7194a75a704ccda17d2792d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:45.274987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5b236892-dc3a-481a-8b09-aac7bbd53ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14be4459e7194a75a704ccda17d2792d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:45.283622 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5b236892-dc3a-481a-8b09-aac7bbd53ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14be4459e7194a75a704ccda17d2792d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:45.284513 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5b236892-dc3a-481a-8b09-aac7bbd53ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14be4459e7194a75a704ccda17d2792d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:45.293572 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1099/2201] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:44 2022] DELETE /identity/v3/users/14be4459e7194a75a704ccda17d2792d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:45.758805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b01695-5af2-4983-8c47-0e162347c99d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:45.760302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-85b01695-5af2-4983-8c47-0e162347c99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:45.803463 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b236892-dc3a-481a-8b09-aac7bbd53ef6 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:45.806004 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-5b236892-dc3a-481a-8b09-aac7bbd53ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:45.929200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b01695-5af2-4983-8c47-0e162347c99d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:45.973036 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b236892-dc3a-481a-8b09-aac7bbd53ef6 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:45.998841 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38624fe-67e6-4af4-b70c-7081f8bff995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:45.999527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38624fe-67e6-4af4-b70c-7081f8bff995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:45.999812 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38624fe-67e6-4af4-b70c-7081f8bff995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:46.000088 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38624fe-67e6-4af4-b70c-7081f8bff995 admin admin] PATH_INFO: `/v3/projects/47feaede376d43aba302b2cd0e8939ea` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:46.002092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38624fe-67e6-4af4-b70c-7081f8bff995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47feaede376d43aba302b2cd0e8939ea)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:46.004956 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38624fe-67e6-4af4-b70c-7081f8bff995 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:46.079281 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd7c35-138b-4b05-852d-9f382653a342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:46.080162 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd7c35-138b-4b05-852d-9f382653a342 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:46.081523 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd7c35-138b-4b05-852d-9f382653a342 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:46.082468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd7c35-138b-4b05-852d-9f382653a342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:46.086507 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-04dd7c35-138b-4b05-852d-9f382653a342 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:46.153234 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f38624fe-67e6-4af4-b70c-7081f8bff995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47feaede376d43aba302b2cd0e8939ea', 'request_id': 'req-f38624fe-67e6-4af4-b70c-7081f8bff995'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:46.179234 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f38624fe-67e6-4af4-b70c-7081f8bff995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47feaede376d43aba302b2cd0e8939ea', 'request_id': 'req-f38624fe-67e6-4af4-b70c-7081f8bff995'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:46.187908 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f38624fe-67e6-4af4-b70c-7081f8bff995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47feaede376d43aba302b2cd0e8939ea', 'request_id': 'req-f38624fe-67e6-4af4-b70c-7081f8bff995'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:46.220913 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f38624fe-67e6-4af4-b70c-7081f8bff995 admin admin] The token cache is being invalidate because project 47feaede376d43aba302b2cd0e8939ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:46.221219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f38624fe-67e6-4af4-b70c-7081f8bff995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:46.222652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f38624fe-67e6-4af4-b70c-7081f8bff995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:46.226538 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd7c35-138b-4b05-852d-9f382653a342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:46.229111 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd7c35-138b-4b05-852d-9f382653a342 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:46.229264 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1100/2202] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:45 2022] DELETE /identity/v3/projects/47feaede376d43aba302b2cd0e8939ea => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:56:46.233843 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c49315-fdac-419c-bb1a-aeaa9bc237af None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:46.234131 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c49315-fdac-419c-bb1a-aeaa9bc237af None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:46.234412 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c49315-fdac-419c-bb1a-aeaa9bc237af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:46.255877 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1103/2203] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:45 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:46.282389 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-55c49315-fdac-419c-bb1a-aeaa9bc237af None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:46.285254 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-55c49315-fdac-419c-bb1a-aeaa9bc237af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:46.325347 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:46.503030 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1101/2204] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:46.504885 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd9df0-be04-4d98-a645-8c593ce1e602 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:46.505505 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd9df0-be04-4d98-a645-8c593ce1e602 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:46.507791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd9df0-be04-4d98-a645-8c593ce1e602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:46.572603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-6afd9df0-be04-4d98-a645-8c593ce1e602 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:46.573595 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6afd9df0-be04-4d98-a645-8c593ce1e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:46.603214 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1104/2205] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:46.607823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c49315-fdac-419c-bb1a-aeaa9bc237af None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:46.622553 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c49315-fdac-419c-bb1a-aeaa9bc237af None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:46.663189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d3348-23ba-4c2c-816c-8527d450a294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:46.663952 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d3348-23ba-4c2c-816c-8527d450a294 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:46.664296 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d3348-23ba-4c2c-816c-8527d450a294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:46.664630 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d3348-23ba-4c2c-816c-8527d450a294 admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:46.665575 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d3348-23ba-4c2c-816c-8527d450a294 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:46.665959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d3348-23ba-4c2c-816c-8527d450a294 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:46.668172 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d3348-23ba-4c2c-816c-8527d450a294 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:46.705036 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1102/2206] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:56:46.705531 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd9df0-be04-4d98-a645-8c593ce1e602 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:46.731414 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd9df0-be04-4d98-a645-8c593ce1e602 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:46.743490 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd2a69-aac0-4006-be72-147fc2c13e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:46.745188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd2a69-aac0-4006-be72-147fc2c13e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:46.745789 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd2a69-aac0-4006-be72-147fc2c13e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:46.746318 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd2a69-aac0-4006-be72-147fc2c13e56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:46.747606 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd2a69-aac0-4006-be72-147fc2c13e56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:46.750089 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd2a69-aac0-4006-be72-147fc2c13e56 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:46.809216 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d3348-23ba-4c2c-816c-8527d450a294 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:46.817334 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1105/2207] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:46 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:56:46.822468 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d3348-23ba-4c2c-816c-8527d450a294 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:46.956699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05358842-cce0-4db5-bc97-3c113f0e8257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:46.958167 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05358842-cce0-4db5-bc97-3c113f0e8257 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:46.958771 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05358842-cce0-4db5-bc97-3c113f0e8257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:46.959249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05358842-cce0-4db5-bc97-3c113f0e8257 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:46.962699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05358842-cce0-4db5-bc97-3c113f0e8257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:46.969387 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05358842-cce0-4db5-bc97-3c113f0e8257 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:47.046839 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1103/2208] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:46 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:56:47.051007 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd2a69-aac0-4006-be72-147fc2c13e56 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:47.065770 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd2a69-aac0-4006-be72-147fc2c13e56 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:47.074290 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19c8f6-fb62-4581-ada7-6fd4e5104ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:47.075257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19c8f6-fb62-4581-ada7-6fd4e5104ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:47.075734 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19c8f6-fb62-4581-ada7-6fd4e5104ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:47.076241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19c8f6-fb62-4581-ada7-6fd4e5104ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:47.077247 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19c8f6-fb62-4581-ada7-6fd4e5104ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:47.079158 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19c8f6-fb62-4581-ada7-6fd4e5104ae2 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:47.109948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1106/2209] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:47.110874 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05358842-cce0-4db5-bc97-3c113f0e8257 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:47.142040 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05358842-cce0-4db5-bc97-3c113f0e8257 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:47.151455 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b584b-8747-449d-b25d-190c8be8ef1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:47.152427 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b584b-8747-449d-b25d-190c8be8ef1d admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:47.154183 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b584b-8747-449d-b25d-190c8be8ef1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:47.154723 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b584b-8747-449d-b25d-190c8be8ef1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:47.155771 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b584b-8747-449d-b25d-190c8be8ef1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:47.158093 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b584b-8747-449d-b25d-190c8be8ef1d admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:47.178383 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19c8f6-fb62-4581-ada7-6fd4e5104ae2 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:47.179240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1104/2210] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:47.184697 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:47.192247 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19c8f6-fb62-4581-ada7-6fd4e5104ae2 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:47.200491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cac19f-1f6f-4429-a8d8-ef033e7332ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:47.201842 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cac19f-1f6f-4429-a8d8-ef033e7332ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:47.202487 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cac19f-1f6f-4429-a8d8-ef033e7332ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:47.203103 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cac19f-1f6f-4429-a8d8-ef033e7332ce admin admin] PATH_INFO: `/v3/projects/ce420a87282043768ab880e12a5aa484/users/70171f9d72334ec8a0e1fc737106d844/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:47.223444 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cac19f-1f6f-4429-a8d8-ef033e7332ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce420a87282043768ab880e12a5aa484, user_id=70171f9d72334ec8a0e1fc737106d844, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:47.226672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cac19f-1f6f-4429-a8d8-ef033e7332ce admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:47.247242 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1107/2211] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:47 2022] PUT /identity/v3/projects/ce420a87282043768ab880e12a5aa484/users/70171f9d72334ec8a0e1fc737106d844/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:47.259269 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289511d5-9c92-4d2c-bce2-9f385bd62750 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:47.259709 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289511d5-9c92-4d2c-bce2-9f385bd62750 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:47.260065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289511d5-9c92-4d2c-bce2-9f385bd62750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:47.310170 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-289511d5-9c92-4d2c-bce2-9f385bd62750 None None] MFA Rules not processed for user `70171f9d72334ec8a0e1fc737106d844`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:47.313265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-289511d5-9c92-4d2c-bce2-9f385bd62750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:47.470733 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1105/2212] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:47.474620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cac19f-1f6f-4429-a8d8-ef033e7332ce admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:47.617381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cac19f-1f6f-4429-a8d8-ef033e7332ce admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:47.632926 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8e38b-15d4-4707-8ba5-b5d043cff447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:47.636722 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8e38b-15d4-4707-8ba5-b5d043cff447 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:47.637043 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8e38b-15d4-4707-8ba5-b5d043cff447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:47.638382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8e38b-15d4-4707-8ba5-b5d043cff447 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:47.639270 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8e38b-15d4-4707-8ba5-b5d043cff447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:47.646288 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8e38b-15d4-4707-8ba5-b5d043cff447 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:47.714379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1108/2213] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:47 2022] POST /identity/v3/projects => generated 385 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:47.718870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289511d5-9c92-4d2c-bce2-9f385bd62750 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:47.735943 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289511d5-9c92-4d2c-bce2-9f385bd62750 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:47.744917 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:47.816648 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bad63-8e93-48cb-af31-525b0f0545a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:47.821154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bad63-8e93-48cb-af31-525b0f0545a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:47.821154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bad63-8e93-48cb-af31-525b0f0545a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:47.821154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bad63-8e93-48cb-af31-525b0f0545a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:47.821873 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7bad63-8e93-48cb-af31-525b0f0545a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:47.823972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7bad63-8e93-48cb-af31-525b0f0545a0 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:47.862438 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1106/2214] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:47 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:47.863051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8e38b-15d4-4707-8ba5-b5d043cff447 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:47.878954 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8e38b-15d4-4707-8ba5-b5d043cff447 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:47.887045 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc633915-4112-4184-9793-a658c5339857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:47.888174 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc633915-4112-4184-9793-a658c5339857 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:47.888637 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc633915-4112-4184-9793-a658c5339857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:47.888967 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc633915-4112-4184-9793-a658c5339857 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:47.889897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc633915-4112-4184-9793-a658c5339857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:47.892480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc633915-4112-4184-9793-a658c5339857 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:47.911554 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1109/2215] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:47.916494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bad63-8e93-48cb-af31-525b0f0545a0 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:47.928393 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bad63-8e93-48cb-af31-525b0f0545a0 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:47.937023 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f1baf-3ff4-47f3-9ee9-1a2876b7985d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:47.938368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f1baf-3ff4-47f3-9ee9-1a2876b7985d admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:47.938720 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f1baf-3ff4-47f3-9ee9-1a2876b7985d admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:47.939070 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f1baf-3ff4-47f3-9ee9-1a2876b7985d admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:47.940022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f1baf-3ff4-47f3-9ee9-1a2876b7985d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:47.943782 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f1baf-3ff4-47f3-9ee9-1a2876b7985d admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:47.973285 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1107/2216] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:47.975504 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc633915-4112-4184-9793-a658c5339857 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:47.988637 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc633915-4112-4184-9793-a658c5339857 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:47.994929 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336376e-3306-4204-acc7-426e92c77a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:47.995858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336376e-3306-4204-acc7-426e92c77a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:47.996234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336376e-3306-4204-acc7-426e92c77a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:47.999723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336376e-3306-4204-acc7-426e92c77a0a admin admin] PATH_INFO: `/v3/projects/410fac42cfcc4b9abd43622944de7aca/users/f61e5a71d98c4467aa7f27c0e3f5662c/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:48.019786 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336376e-3306-4204-acc7-426e92c77a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=410fac42cfcc4b9abd43622944de7aca, user_id=f61e5a71d98c4467aa7f27c0e3f5662c, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:48.020894 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336376e-3306-4204-acc7-426e92c77a0a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:48.042778 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1110/2217] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:47 2022] PUT /identity/v3/projects/410fac42cfcc4b9abd43622944de7aca/users/f61e5a71d98c4467aa7f27c0e3f5662c/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:48.056900 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202c700-40c9-4f89-b9bf-f0165c0c1b88 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:48.057554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202c700-40c9-4f89-b9bf-f0165c0c1b88 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:48.057554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202c700-40c9-4f89-b9bf-f0165c0c1b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:48.104837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-8202c700-40c9-4f89-b9bf-f0165c0c1b88 None None] MFA Rules not processed for user `f61e5a71d98c4467aa7f27c0e3f5662c`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:48.106069 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-8202c700-40c9-4f89-b9bf-f0165c0c1b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:48.212205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1108/2218] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:48.216819 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336376e-3306-4204-acc7-426e92c77a0a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:48.285488 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336376e-3306-4204-acc7-426e92c77a0a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:48.290286 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b29161-f622-4fc4-b693-fe78124d130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:48.290908 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b29161-f622-4fc4-b693-fe78124d130a admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:48.291167 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b29161-f622-4fc4-b693-fe78124d130a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:48.291438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b29161-f622-4fc4-b693-fe78124d130a admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:48.292118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b29161-f622-4fc4-b693-fe78124d130a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:48.294079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b29161-f622-4fc4-b693-fe78124d130a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:48.326361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1111/2219] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:48 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:56:48.331208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202c700-40c9-4f89-b9bf-f0165c0c1b88 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:48.344159 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202c700-40c9-4f89-b9bf-f0165c0c1b88 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:48.402201 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0a3d3-318f-430f-9a98-2b0bebb11e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:48.402873 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0a3d3-318f-430f-9a98-2b0bebb11e70 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:48.403145 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0a3d3-318f-430f-9a98-2b0bebb11e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:48.403420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0a3d3-318f-430f-9a98-2b0bebb11e70 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:48.404106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0a3d3-318f-430f-9a98-2b0bebb11e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:48.406083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0a3d3-318f-430f-9a98-2b0bebb11e70 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:48.432266 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1109/2220] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:48 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:48.436752 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b29161-f622-4fc4-b693-fe78124d130a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:48.448575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b29161-f622-4fc4-b693-fe78124d130a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:48.453501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0585967-40be-416c-bfbe-0b111ca304a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:48.454144 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0585967-40be-416c-bfbe-0b111ca304a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:48.454413 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0585967-40be-416c-bfbe-0b111ca304a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:48.454686 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0585967-40be-416c-bfbe-0b111ca304a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:48.455385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0585967-40be-416c-bfbe-0b111ca304a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:48.456985 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0585967-40be-416c-bfbe-0b111ca304a1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:48.467923 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1112/2221] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:48.472330 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0a3d3-318f-430f-9a98-2b0bebb11e70 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:48.483081 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0a3d3-318f-430f-9a98-2b0bebb11e70 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:48.488598 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9aa992-7747-4069-b04d-4447ad8df544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:48.489267 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aa992-7747-4069-b04d-4447ad8df544 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:48.489569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aa992-7747-4069-b04d-4447ad8df544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:48.489839 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aa992-7747-4069-b04d-4447ad8df544 admin admin] PATH_INFO: `/v3/projects/2193d71023ff4431a372ce5d93e78f02/users/70e205b7104540dba12cc9fc503de2c1/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:48.492311 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:48.507568 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9aa992-7747-4069-b04d-4447ad8df544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2193d71023ff4431a372ce5d93e78f02, user_id=70e205b7104540dba12cc9fc503de2c1, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:48.510312 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9aa992-7747-4069-b04d-4447ad8df544 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:48.525516 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1110/2222] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:48 2022] PUT /identity/v3/projects/2193d71023ff4431a372ce5d93e78f02/users/70e205b7104540dba12cc9fc503de2c1/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:48.537524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0585967-40be-416c-bfbe-0b111ca304a1 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:48.543027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:48.549868 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0585967-40be-416c-bfbe-0b111ca304a1 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:48.622867 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28d0fd-6dd9-4a17-889b-5aecd5e4a5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:48.623512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28d0fd-6dd9-4a17-889b-5aecd5e4a5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:48.623799 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28d0fd-6dd9-4a17-889b-5aecd5e4a5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:48.624070 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28d0fd-6dd9-4a17-889b-5aecd5e4a5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:48.624763 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28d0fd-6dd9-4a17-889b-5aecd5e4a5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:48.626447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28d0fd-6dd9-4a17-889b-5aecd5e4a5c2 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:48.637989 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1113/2223] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:48.642561 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9aa992-7747-4069-b04d-4447ad8df544 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:48.653759 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9aa992-7747-4069-b04d-4447ad8df544 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:48.658495 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267ed1b-f41e-40aa-a828-34ca4fe58899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:48.659163 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267ed1b-f41e-40aa-a828-34ca4fe58899 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:48.659439 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267ed1b-f41e-40aa-a828-34ca4fe58899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:48.659710 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267ed1b-f41e-40aa-a828-34ca4fe58899 admin admin] PATH_INFO: `/v3/projects/2193d71023ff4431a372ce5d93e78f02/users/70e205b7104540dba12cc9fc503de2c1/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:48.661715 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267ed1b-f41e-40aa-a828-34ca4fe58899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2193d71023ff4431a372ce5d93e78f02, user_id=70e205b7104540dba12cc9fc503de2c1, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:48.664408 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267ed1b-f41e-40aa-a828-34ca4fe58899 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:48.677633 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1111/2224] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:48 2022] PUT /identity/v3/projects/2193d71023ff4431a372ce5d93e78f02/users/70e205b7104540dba12cc9fc503de2c1/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:48.688038 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de987d-0017-4f72-9eea-61038c116860 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:48.688331 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de987d-0017-4f72-9eea-61038c116860 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:48.688615 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de987d-0017-4f72-9eea-61038c116860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:48.717960 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-30de987d-0017-4f72-9eea-61038c116860 None None] MFA Rules not processed for user `70e205b7104540dba12cc9fc503de2c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:48.719211 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-30de987d-0017-4f72-9eea-61038c116860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:48.801976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1114/2225] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:48.814766 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267ed1b-f41e-40aa-a828-34ca4fe58899 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:48.816486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e267ed1b-f41e-40aa-a828-34ca4fe58899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:48.877545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267ed1b-f41e-40aa-a828-34ca4fe58899 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:48.881670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5deef-4725-4aa1-ac76-7c26723e1cab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:48.882349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5deef-4725-4aa1-ac76-7c26723e1cab service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:48.882857 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5deef-4725-4aa1-ac76-7c26723e1cab service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:48.883143 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5deef-4725-4aa1-ac76-7c26723e1cab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:48.948581 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5deef-4725-4aa1-ac76-7c26723e1cab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:48.951375 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5deef-4725-4aa1-ac76-7c26723e1cab service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:48.961755 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1112/2226] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:50.579207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de987d-0017-4f72-9eea-61038c116860 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:50.580648 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-30de987d-0017-4f72-9eea-61038c116860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:50.593954 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de987d-0017-4f72-9eea-61038c116860 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:50.597729 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468d1c9-43ea-4b58-b7ce-5dcf2d41b506 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:50.598421 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468d1c9-43ea-4b58-b7ce-5dcf2d41b506 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:50.598781 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468d1c9-43ea-4b58-b7ce-5dcf2d41b506 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:50.599212 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468d1c9-43ea-4b58-b7ce-5dcf2d41b506 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:50.673409 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468d1c9-43ea-4b58-b7ce-5dcf2d41b506 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:50.676018 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468d1c9-43ea-4b58-b7ce-5dcf2d41b506 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:50.687788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1115/2227] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:50.970717 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5deef-4725-4aa1-ac76-7c26723e1cab service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:50.972423 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-abc5deef-4725-4aa1-ac76-7c26723e1cab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:51.071063 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5deef-4725-4aa1-ac76-7c26723e1cab service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:51.076165 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35f0e7-cb47-4f9e-98ea-16a9c4c0d90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:51.076821 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35f0e7-cb47-4f9e-98ea-16a9c4c0d90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:51.077475 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35f0e7-cb47-4f9e-98ea-16a9c4c0d90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:51.077902 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35f0e7-cb47-4f9e-98ea-16a9c4c0d90f admin admin] PATH_INFO: `/v3/users/e9209400251e4e078d2b5ca4b64a22ed` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:51.079427 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35f0e7-cb47-4f9e-98ea-16a9c4c0d90f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9209400251e4e078d2b5ca4b64a22ed)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:51.081689 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35f0e7-cb47-4f9e-98ea-16a9c4c0d90f admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:51.116814 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:51.142016 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-ca35f0e7-cb47-4f9e-98ea-16a9c4c0d90f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9209400251e4e078d2b5ca4b64a22ed'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:51.159360 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-ca35f0e7-cb47-4f9e-98ea-16a9c4c0d90f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9209400251e4e078d2b5ca4b64a22ed'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:51.169888 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-ca35f0e7-cb47-4f9e-98ea-16a9c4c0d90f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9209400251e4e078d2b5ca4b64a22ed'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:51.178762 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-ca35f0e7-cb47-4f9e-98ea-16a9c4c0d90f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9209400251e4e078d2b5ca4b64a22ed'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:51.180078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-ca35f0e7-cb47-4f9e-98ea-16a9c4c0d90f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9209400251e4e078d2b5ca4b64a22ed'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:51.193142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1113/2228] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:50 2022] DELETE /identity/v3/users/e9209400251e4e078d2b5ca4b64a22ed => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:51.195341 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca71ba3-0aca-4612-9264-ba88de84d42e None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:51.195767 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca71ba3-0aca-4612-9264-ba88de84d42e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:51.196125 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca71ba3-0aca-4612-9264-ba88de84d42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:51.222460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-eca71ba3-0aca-4612-9264-ba88de84d42e None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:51.223838 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-eca71ba3-0aca-4612-9264-ba88de84d42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:51.248851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:51.318003 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1116/2229] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:51.330501 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35f0e7-cb47-4f9e-98ea-16a9c4c0d90f admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:51.332500 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ca35f0e7-cb47-4f9e-98ea-16a9c4c0d90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:51.420193 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca71ba3-0aca-4612-9264-ba88de84d42e None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:51.423111 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-eca71ba3-0aca-4612-9264-ba88de84d42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:51.441898 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35f0e7-cb47-4f9e-98ea-16a9c4c0d90f admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:51.455052 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b8b4a-e7fd-4d38-bd3f-592303699233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:51.457276 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b8b4a-e7fd-4d38-bd3f-592303699233 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:51.458312 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b8b4a-e7fd-4d38-bd3f-592303699233 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:51.458950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b8b4a-e7fd-4d38-bd3f-592303699233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:51.473814 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b8b4a-e7fd-4d38-bd3f-592303699233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:51.476757 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b8b4a-e7fd-4d38-bd3f-592303699233 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:51.532329 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca71ba3-0aca-4612-9264-ba88de84d42e None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:51.538179 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ef3d0-319e-4130-bb93-71929f480a74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:51.539203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ef3d0-319e-4130-bb93-71929f480a74 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:51.540752 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ef3d0-319e-4130-bb93-71929f480a74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:51.541016 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1114/2230] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:51.541427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ef3d0-319e-4130-bb93-71929f480a74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:51.543690 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2b1ef3d0-319e-4130-bb93-71929f480a74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:51.646883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ef3d0-319e-4130-bb93-71929f480a74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:51.648934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ef3d0-319e-4130-bb93-71929f480a74 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:51.662510 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1117/2231] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:51.999898 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b8b4a-e7fd-4d38-bd3f-592303699233 service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:52.002425 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9e7b8b4a-e7fd-4d38-bd3f-592303699233 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:52.043039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b8b4a-e7fd-4d38-bd3f-592303699233 service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:52.048360 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ff806-c7ea-4744-aafc-bf45df44899d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:52.049141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ff806-c7ea-4744-aafc-bf45df44899d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:52.049427 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ff806-c7ea-4744-aafc-bf45df44899d admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:52.049705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ff806-c7ea-4744-aafc-bf45df44899d admin admin] PATH_INFO: `/v3/projects/3a0559273d254257a88c013ee3e175ec` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:52.050999 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ff806-c7ea-4744-aafc-bf45df44899d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0559273d254257a88c013ee3e175ec)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:52.052899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ff806-c7ea-4744-aafc-bf45df44899d admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:52.107630 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f56ff806-c7ea-4744-aafc-bf45df44899d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0559273d254257a88c013ee3e175ec', 'request_id': 'req-f56ff806-c7ea-4744-aafc-bf45df44899d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:52.118242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f56ff806-c7ea-4744-aafc-bf45df44899d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0559273d254257a88c013ee3e175ec', 'request_id': 'req-f56ff806-c7ea-4744-aafc-bf45df44899d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:52.134092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f56ff806-c7ea-4744-aafc-bf45df44899d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0559273d254257a88c013ee3e175ec', 'request_id': 'req-f56ff806-c7ea-4744-aafc-bf45df44899d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:52.147417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f56ff806-c7ea-4744-aafc-bf45df44899d admin admin] The token cache is being invalidate because project 3a0559273d254257a88c013ee3e175ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:52.147889 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f56ff806-c7ea-4744-aafc-bf45df44899d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:52.149158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f56ff806-c7ea-4744-aafc-bf45df44899d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:52.153176 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1115/2232] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:51 2022] DELETE /identity/v3/projects/3a0559273d254257a88c013ee3e175ec => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:52.157004 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8570e-daed-4b6b-b626-b2c329b5971c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:52.157579 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8570e-daed-4b6b-b626-b2c329b5971c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:52.158025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8570e-daed-4b6b-b626-b2c329b5971c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:52.186917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-56a8570e-daed-4b6b-b626-b2c329b5971c None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:52.188532 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-56a8570e-daed-4b6b-b626-b2c329b5971c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:52.264559 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1118/2233] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:52.273533 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f9b3f-24c6-424e-8034-6f74553fedbb None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:52.273797 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f9b3f-24c6-424e-8034-6f74553fedbb None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:52.274079 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f9b3f-24c6-424e-8034-6f74553fedbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:52.297651 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-b63f9b3f-24c6-424e-8034-6f74553fedbb None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:52.298938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b63f9b3f-24c6-424e-8034-6f74553fedbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:52.309706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1116/2234] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:52.317420 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8570e-daed-4b6b-b626-b2c329b5971c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:52.328541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8570e-daed-4b6b-b626-b2c329b5971c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:52.333407 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e3842-5861-4d57-95a7-201b4802b038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:52.333970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e3842-5861-4d57-95a7-201b4802b038 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:52.334241 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e3842-5861-4d57-95a7-201b4802b038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:52.334508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e3842-5861-4d57-95a7-201b4802b038 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:52.335204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e3842-5861-4d57-95a7-201b4802b038 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:52.335503 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e3842-5861-4d57-95a7-201b4802b038 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:52.337183 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e3842-5861-4d57-95a7-201b4802b038 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:52.347179 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:52.351941 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1119/2235] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:56:52.356320 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f9b3f-24c6-424e-8034-6f74553fedbb None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:52.369505 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f9b3f-24c6-424e-8034-6f74553fedbb None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:52.376795 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5764d41-7367-400b-9e24-6d1e5de17fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:52.377536 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5764d41-7367-400b-9e24-6d1e5de17fec admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:52.377821 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5764d41-7367-400b-9e24-6d1e5de17fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:52.378114 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5764d41-7367-400b-9e24-6d1e5de17fec admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:52.378932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5764d41-7367-400b-9e24-6d1e5de17fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:52.380866 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5764d41-7367-400b-9e24-6d1e5de17fec admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:52.428895 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:52.445591 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1117/2236] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:52 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:52.451546 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e3842-5861-4d57-95a7-201b4802b038 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:52.468195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e3842-5861-4d57-95a7-201b4802b038 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:52.553698 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be37280-a133-41c6-8203-7d2c3526509a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:52.554468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be37280-a133-41c6-8203-7d2c3526509a admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:52.555107 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be37280-a133-41c6-8203-7d2c3526509a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:52.555262 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be37280-a133-41c6-8203-7d2c3526509a admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:52.556045 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be37280-a133-41c6-8203-7d2c3526509a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:52.558110 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be37280-a133-41c6-8203-7d2c3526509a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:52.581221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1120/2237] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:52 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:56:52.586158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5764d41-7367-400b-9e24-6d1e5de17fec admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:52.595933 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5764d41-7367-400b-9e24-6d1e5de17fec admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:52.600659 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a9729-2aec-474f-87df-55b7ee8d7478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:52.601414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a9729-2aec-474f-87df-55b7ee8d7478 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:52.601962 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a9729-2aec-474f-87df-55b7ee8d7478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:52.602293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a9729-2aec-474f-87df-55b7ee8d7478 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:52.603473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a9729-2aec-474f-87df-55b7ee8d7478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:52.606109 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a9729-2aec-474f-87df-55b7ee8d7478 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:52.619574 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1118/2238] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:56:52.620931 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be37280-a133-41c6-8203-7d2c3526509a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:52.636401 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be37280-a133-41c6-8203-7d2c3526509a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:52.641265 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd5fdf-073f-409e-b72b-1534a7cc20de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:52.641899 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd5fdf-073f-409e-b72b-1534a7cc20de admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:52.642182 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd5fdf-073f-409e-b72b-1534a7cc20de admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:52.642456 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd5fdf-073f-409e-b72b-1534a7cc20de admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:52.643151 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd5fdf-073f-409e-b72b-1534a7cc20de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:52.645120 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd5fdf-073f-409e-b72b-1534a7cc20de admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:52.670242 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1121/2239] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:52.672493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a9729-2aec-474f-87df-55b7ee8d7478 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:52.696673 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a9729-2aec-474f-87df-55b7ee8d7478 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:52.705853 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b182fc-d620-44e7-9cd6-c7423450a611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:52.706550 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b182fc-d620-44e7-9cd6-c7423450a611 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:52.706845 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b182fc-d620-44e7-9cd6-c7423450a611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:52.707367 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b182fc-d620-44e7-9cd6-c7423450a611 admin admin] PATH_INFO: `/v3/projects/048b3ae62fec46c0b62d3367ac401ac5/users/61c02a2d4f6647e79ebd785bfb342aaf/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:52.724256 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b182fc-d620-44e7-9cd6-c7423450a611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=048b3ae62fec46c0b62d3367ac401ac5, user_id=61c02a2d4f6647e79ebd785bfb342aaf, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:52.727150 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b182fc-d620-44e7-9cd6-c7423450a611 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:52.743880 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1119/2240] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:52 2022] PUT /identity/v3/projects/048b3ae62fec46c0b62d3367ac401ac5/users/61c02a2d4f6647e79ebd785bfb342aaf/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:56:52.755304 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a3e37-f79b-4391-8488-e6a933f9c9d1 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:52.755599 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a3e37-f79b-4391-8488-e6a933f9c9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:52.756050 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a3e37-f79b-4391-8488-e6a933f9c9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:52.786049 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a52a3e37-f79b-4391-8488-e6a933f9c9d1 None None] MFA Rules not processed for user `61c02a2d4f6647e79ebd785bfb342aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:52.787322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a52a3e37-f79b-4391-8488-e6a933f9c9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:52.874600 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1122/2241] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:52.884012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b182fc-d620-44e7-9cd6-c7423450a611 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:52.886301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-83b182fc-d620-44e7-9cd6-c7423450a611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:52.999286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b182fc-d620-44e7-9cd6-c7423450a611 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:53.013777 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49078b3-c3de-415d-8dce-520430fb5473 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:53.015983 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49078b3-c3de-415d-8dce-520430fb5473 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:53.017887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49078b3-c3de-415d-8dce-520430fb5473 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:53.018525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49078b3-c3de-415d-8dce-520430fb5473 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:53.040061 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49078b3-c3de-415d-8dce-520430fb5473 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:53.042238 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49078b3-c3de-415d-8dce-520430fb5473 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:53.058865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1120/2242] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:56.165848 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a3e37-f79b-4391-8488-e6a933f9c9d1 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:56.167457 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a52a3e37-f79b-4391-8488-e6a933f9c9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:56.235006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a3e37-f79b-4391-8488-e6a933f9c9d1 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:56.240085 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc0ed0-f90d-4f5b-975d-ff84a7a984b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:56.240728 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc0ed0-f90d-4f5b-975d-ff84a7a984b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:56.241009 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc0ed0-f90d-4f5b-975d-ff84a7a984b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:56.241321 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc0ed0-f90d-4f5b-975d-ff84a7a984b8 admin admin] PATH_INFO: `/v3/users/70171f9d72334ec8a0e1fc737106d844` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:56.242550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc0ed0-f90d-4f5b-975d-ff84a7a984b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70171f9d72334ec8a0e1fc737106d844)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:56.244579 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc0ed0-f90d-4f5b-975d-ff84a7a984b8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:56.255083 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:56.296643 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-09dc0ed0-f90d-4f5b-975d-ff84a7a984b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70171f9d72334ec8a0e1fc737106d844'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:56.297374 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-09dc0ed0-f90d-4f5b-975d-ff84a7a984b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70171f9d72334ec8a0e1fc737106d844'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:56.305356 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-09dc0ed0-f90d-4f5b-975d-ff84a7a984b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70171f9d72334ec8a0e1fc737106d844'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:56.321461 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-09dc0ed0-f90d-4f5b-975d-ff84a7a984b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70171f9d72334ec8a0e1fc737106d844'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:56.322267 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-09dc0ed0-f90d-4f5b-975d-ff84a7a984b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70171f9d72334ec8a0e1fc737106d844'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:56.338842 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1123/2243] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:56 2022] DELETE /identity/v3/users/70171f9d72334ec8a0e1fc737106d844 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:56.343527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84190742-a35f-4021-8546-b7bdddf5810b None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:56.344036 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84190742-a35f-4021-8546-b7bdddf5810b None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:56.344141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84190742-a35f-4021-8546-b7bdddf5810b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:56.364065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-84190742-a35f-4021-8546-b7bdddf5810b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:56.365295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-84190742-a35f-4021-8546-b7bdddf5810b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:56.428291 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1121/2244] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:56.438436 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc0ed0-f90d-4f5b-975d-ff84a7a984b8 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:56.440255 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-09dc0ed0-f90d-4f5b-975d-ff84a7a984b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:56.505267 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc0ed0-f90d-4f5b-975d-ff84a7a984b8 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:56.509610 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ad6d7-3f74-4639-96db-ce55969e94f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:56.510356 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ad6d7-3f74-4639-96db-ce55969e94f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:56.510679 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ad6d7-3f74-4639-96db-ce55969e94f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:56.510965 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ad6d7-3f74-4639-96db-ce55969e94f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:56.521137 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ad6d7-3f74-4639-96db-ce55969e94f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:56.522594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ad6d7-3f74-4639-96db-ce55969e94f2 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:56.532608 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1124/2245] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:56.751290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84190742-a35f-4021-8546-b7bdddf5810b None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:56.752765 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-84190742-a35f-4021-8546-b7bdddf5810b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:56.766038 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84190742-a35f-4021-8546-b7bdddf5810b None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:56.771236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173dc45-71fe-4e2e-9740-3b15c5bd638b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:56.771963 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173dc45-71fe-4e2e-9740-3b15c5bd638b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:56.772248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173dc45-71fe-4e2e-9740-3b15c5bd638b admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:56.772544 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173dc45-71fe-4e2e-9740-3b15c5bd638b admin admin] PATH_INFO: `/v3/users/61c02a2d4f6647e79ebd785bfb342aaf` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:56.774361 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173dc45-71fe-4e2e-9740-3b15c5bd638b admin admin] RBAC: Authorizing `identity:delete_user(user_id=61c02a2d4f6647e79ebd785bfb342aaf)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:56.776247 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173dc45-71fe-4e2e-9740-3b15c5bd638b admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:56.843918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-d173dc45-71fe-4e2e-9740-3b15c5bd638b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61c02a2d4f6647e79ebd785bfb342aaf'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:56.860691 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ad6d7-3f74-4639-96db-ce55969e94f2 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:56.864407 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-224ad6d7-3f74-4639-96db-ce55969e94f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:56.864857 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-d173dc45-71fe-4e2e-9740-3b15c5bd638b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61c02a2d4f6647e79ebd785bfb342aaf'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:56.880267 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:56.880267 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-d173dc45-71fe-4e2e-9740-3b15c5bd638b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61c02a2d4f6647e79ebd785bfb342aaf'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:56.892802 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ad6d7-3f74-4639-96db-ce55969e94f2 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:56.903050 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295ee96-a186-417d-96e8-74c5f816e756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:56.903805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295ee96-a186-417d-96e8-74c5f816e756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:56.904093 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295ee96-a186-417d-96e8-74c5f816e756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:56.904412 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295ee96-a186-417d-96e8-74c5f816e756 admin admin] PATH_INFO: `/v3/projects/ce420a87282043768ab880e12a5aa484` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:56.906937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295ee96-a186-417d-96e8-74c5f816e756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce420a87282043768ab880e12a5aa484)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:56.908094 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-d173dc45-71fe-4e2e-9740-3b15c5bd638b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61c02a2d4f6647e79ebd785bfb342aaf'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:56.909182 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-d173dc45-71fe-4e2e-9740-3b15c5bd638b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61c02a2d4f6647e79ebd785bfb342aaf'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:56.909847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295ee96-a186-417d-96e8-74c5f816e756 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:56.929121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1122/2246] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:56 2022] DELETE /identity/v3/users/61c02a2d4f6647e79ebd785bfb342aaf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:56.932609 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bebe27-07a3-4aad-94ff-5e0ede68fe5a None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:56.932789 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bebe27-07a3-4aad-94ff-5e0ede68fe5a None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:56.933094 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bebe27-07a3-4aad-94ff-5e0ede68fe5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:56.956785 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-22bebe27-07a3-4aad-94ff-5e0ede68fe5a None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:56.958150 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-22bebe27-07a3-4aad-94ff-5e0ede68fe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:57.000585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6295ee96-a186-417d-96e8-74c5f816e756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce420a87282043768ab880e12a5aa484', 'request_id': 'req-6295ee96-a186-417d-96e8-74c5f816e756'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:57.030339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6295ee96-a186-417d-96e8-74c5f816e756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce420a87282043768ab880e12a5aa484', 'request_id': 'req-6295ee96-a186-417d-96e8-74c5f816e756'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:57.043470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6295ee96-a186-417d-96e8-74c5f816e756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce420a87282043768ab880e12a5aa484', 'request_id': 'req-6295ee96-a186-417d-96e8-74c5f816e756'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:57.055700 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6295ee96-a186-417d-96e8-74c5f816e756 admin admin] The token cache is being invalidate because project ce420a87282043768ab880e12a5aa484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:57.056190 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6295ee96-a186-417d-96e8-74c5f816e756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:57.057028 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6295ee96-a186-417d-96e8-74c5f816e756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:57.062125 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1125/2247] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:56 2022] DELETE /identity/v3/projects/ce420a87282043768ab880e12a5aa484 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:56:57.063040 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295ee96-a186-417d-96e8-74c5f816e756 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:57.064587 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6295ee96-a186-417d-96e8-74c5f816e756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:57.080564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:57.097849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1123/2248] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:56:57.110336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bebe27-07a3-4aad-94ff-5e0ede68fe5a None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:57.112564 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-22bebe27-07a3-4aad-94ff-5e0ede68fe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:57.159518 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295ee96-a186-417d-96e8-74c5f816e756 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:57.167452 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bbf12-555c-4ccf-a753-a67abcf1adb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:57.168121 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bbf12-555c-4ccf-a753-a67abcf1adb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:57.168564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bbf12-555c-4ccf-a753-a67abcf1adb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:57.168984 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bbf12-555c-4ccf-a753-a67abcf1adb2 admin admin] PATH_INFO: `/v3/users/f61e5a71d98c4467aa7f27c0e3f5662c` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:57.170358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6bbf12-555c-4ccf-a753-a67abcf1adb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f61e5a71d98c4467aa7f27c0e3f5662c)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:57.173007 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6bbf12-555c-4ccf-a753-a67abcf1adb2 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:57.193520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bebe27-07a3-4aad-94ff-5e0ede68fe5a None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:57.255885 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-bc6bbf12-555c-4ccf-a753-a67abcf1adb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f61e5a71d98c4467aa7f27c0e3f5662c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:57.258234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-bc6bbf12-555c-4ccf-a753-a67abcf1adb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f61e5a71d98c4467aa7f27c0e3f5662c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:57.270953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-bc6bbf12-555c-4ccf-a753-a67abcf1adb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f61e5a71d98c4467aa7f27c0e3f5662c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:57.287593 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-bc6bbf12-555c-4ccf-a753-a67abcf1adb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f61e5a71d98c4467aa7f27c0e3f5662c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:57.287758 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112f80f-b299-4b22-b916-e92ec2f94396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:57.288621 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-bc6bbf12-555c-4ccf-a753-a67abcf1adb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f61e5a71d98c4467aa7f27c0e3f5662c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:57.289083 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112f80f-b299-4b22-b916-e92ec2f94396 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:57.289200 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112f80f-b299-4b22-b916-e92ec2f94396 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:57.289501 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112f80f-b299-4b22-b916-e92ec2f94396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:57.294321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e112f80f-b299-4b22-b916-e92ec2f94396 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:57.307294 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1126/2249] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:57 2022] DELETE /identity/v3/users/f61e5a71d98c4467aa7f27c0e3f5662c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:57.307754 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112f80f-b299-4b22-b916-e92ec2f94396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:57.312436 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112f80f-b299-4b22-b916-e92ec2f94396 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:57.323819 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1124/2250] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:57.814169 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bbf12-555c-4ccf-a753-a67abcf1adb2 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:57.815900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-bc6bbf12-555c-4ccf-a753-a67abcf1adb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:57.826780 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112f80f-b299-4b22-b916-e92ec2f94396 service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:57.829556 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e112f80f-b299-4b22-b916-e92ec2f94396 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:57.844277 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112f80f-b299-4b22-b916-e92ec2f94396 service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:57.892208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:57.917643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604db3c-9793-4e0a-bad1-4428582a0009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:57.918307 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604db3c-9793-4e0a-bad1-4428582a0009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:57.918698 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604db3c-9793-4e0a-bad1-4428582a0009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:57.919037 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604db3c-9793-4e0a-bad1-4428582a0009 admin admin] PATH_INFO: `/v3/projects/048b3ae62fec46c0b62d3367ac401ac5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:57.920290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604db3c-9793-4e0a-bad1-4428582a0009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=048b3ae62fec46c0b62d3367ac401ac5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:57.920690 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bbf12-555c-4ccf-a753-a67abcf1adb2 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:57.922718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604db3c-9793-4e0a-bad1-4428582a0009 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:57.926601 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e22177-ef0c-46d3-8df6-66e720dedb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:57.927386 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e22177-ef0c-46d3-8df6-66e720dedb39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:57.927730 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e22177-ef0c-46d3-8df6-66e720dedb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:57.928069 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e22177-ef0c-46d3-8df6-66e720dedb39 admin admin] PATH_INFO: `/v3/projects/410fac42cfcc4b9abd43622944de7aca` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:57.929321 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e22177-ef0c-46d3-8df6-66e720dedb39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=410fac42cfcc4b9abd43622944de7aca)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:57.931427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e22177-ef0c-46d3-8df6-66e720dedb39 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:57.991877 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:58.027019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4604db3c-9793-4e0a-bad1-4428582a0009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '048b3ae62fec46c0b62d3367ac401ac5', 'request_id': 'req-4604db3c-9793-4e0a-bad1-4428582a0009'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:58.035824 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b4e22177-ef0c-46d3-8df6-66e720dedb39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410fac42cfcc4b9abd43622944de7aca', 'request_id': 'req-b4e22177-ef0c-46d3-8df6-66e720dedb39'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:58.039623 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4604db3c-9793-4e0a-bad1-4428582a0009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '048b3ae62fec46c0b62d3367ac401ac5', 'request_id': 'req-4604db3c-9793-4e0a-bad1-4428582a0009'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:58.048846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4604db3c-9793-4e0a-bad1-4428582a0009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '048b3ae62fec46c0b62d3367ac401ac5', 'request_id': 'req-4604db3c-9793-4e0a-bad1-4428582a0009'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:58.049525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b4e22177-ef0c-46d3-8df6-66e720dedb39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410fac42cfcc4b9abd43622944de7aca', 'request_id': 'req-b4e22177-ef0c-46d3-8df6-66e720dedb39'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:58.063322 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b4e22177-ef0c-46d3-8df6-66e720dedb39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410fac42cfcc4b9abd43622944de7aca', 'request_id': 'req-b4e22177-ef0c-46d3-8df6-66e720dedb39'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:58.069180 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4604db3c-9793-4e0a-bad1-4428582a0009 admin admin] The token cache is being invalidate because project 048b3ae62fec46c0b62d3367ac401ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:58.069682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4604db3c-9793-4e0a-bad1-4428582a0009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:58.071410 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-4604db3c-9793-4e0a-bad1-4428582a0009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:58.076854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1125/2251] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:57 2022] DELETE /identity/v3/projects/048b3ae62fec46c0b62d3367ac401ac5 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:58.078216 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf03f8-e625-43be-83f3-7a82da507d4a None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:58.078499 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf03f8-e625-43be-83f3-7a82da507d4a None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:58.078774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf03f8-e625-43be-83f3-7a82da507d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:58.098942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b4e22177-ef0c-46d3-8df6-66e720dedb39 admin admin] The token cache is being invalidate because project 410fac42cfcc4b9abd43622944de7aca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:58.099289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b4e22177-ef0c-46d3-8df6-66e720dedb39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:58.100596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b4e22177-ef0c-46d3-8df6-66e720dedb39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:58.102537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1127/2252] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:57 2022] DELETE /identity/v3/projects/410fac42cfcc4b9abd43622944de7aca => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:58.106311 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-9dbf03f8-e625-43be-83f3-7a82da507d4a None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:58.106847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e22177-ef0c-46d3-8df6-66e720dedb39 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:58.108286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9dbf03f8-e625-43be-83f3-7a82da507d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:58.108669 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b4e22177-ef0c-46d3-8df6-66e720dedb39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:58.213723 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1126/2253] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:58.222589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9bd74-fc53-4c8a-a45e-30cc5a7bb3fc None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:58.222994 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9bd74-fc53-4c8a-a45e-30cc5a7bb3fc None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:58.223340 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9bd74-fc53-4c8a-a45e-30cc5a7bb3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:58.224664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e22177-ef0c-46d3-8df6-66e720dedb39 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:58.230155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50985752-f2b0-4e76-be28-db0e73a5a833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:58.231190 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50985752-f2b0-4e76-be28-db0e73a5a833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:58.231540 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50985752-f2b0-4e76-be28-db0e73a5a833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:58.231882 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50985752-f2b0-4e76-be28-db0e73a5a833 admin admin] PATH_INFO: `/v3/users/70e205b7104540dba12cc9fc503de2c1` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:58.233345 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50985752-f2b0-4e76-be28-db0e73a5a833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70e205b7104540dba12cc9fc503de2c1)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:58.235646 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50985752-f2b0-4e76-be28-db0e73a5a833 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:58.260426 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-09a9bd74-fc53-4c8a-a45e-30cc5a7bb3fc None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:58.262663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-09a9bd74-fc53-4c8a-a45e-30cc5a7bb3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:58.287072 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1127/2254] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:58.291101 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9bd74-fc53-4c8a-a45e-30cc5a7bb3fc None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:58.316394 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9bd74-fc53-4c8a-a45e-30cc5a7bb3fc None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:58.328586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c2779-4393-460a-90e3-83ca942cfb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:58.330056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c2779-4393-460a-90e3-83ca942cfb16 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:58.330627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c2779-4393-460a-90e3-83ca942cfb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:58.331141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c2779-4393-460a-90e3-83ca942cfb16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:58.332453 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c2779-4393-460a-90e3-83ca942cfb16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:58.333461 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c2779-4393-460a-90e3-83ca942cfb16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:58.336085 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c2779-4393-460a-90e3-83ca942cfb16 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:58.343764 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-50985752-f2b0-4e76-be28-db0e73a5a833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70e205b7104540dba12cc9fc503de2c1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:58.344586 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-50985752-f2b0-4e76-be28-db0e73a5a833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70e205b7104540dba12cc9fc503de2c1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:58.355767 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1128/2255] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:56:58.360607 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c2779-4393-460a-90e3-83ca942cfb16 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:58.361776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-50985752-f2b0-4e76-be28-db0e73a5a833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70e205b7104540dba12cc9fc503de2c1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:58.364740 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ed1c2779-4393-460a-90e3-83ca942cfb16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:58.378215 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-50985752-f2b0-4e76-be28-db0e73a5a833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70e205b7104540dba12cc9fc503de2c1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:58.379337 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-50985752-f2b0-4e76-be28-db0e73a5a833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70e205b7104540dba12cc9fc503de2c1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:58.380984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c2779-4393-460a-90e3-83ca942cfb16 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:58.388242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aef2c5-fde3-4b51-aa0c-a02acaba7d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:58.389231 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aef2c5-fde3-4b51-aa0c-a02acaba7d16 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:58.389708 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aef2c5-fde3-4b51-aa0c-a02acaba7d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:58.390015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aef2c5-fde3-4b51-aa0c-a02acaba7d16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:58.390756 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aef2c5-fde3-4b51-aa0c-a02acaba7d16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:58.393664 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aef2c5-fde3-4b51-aa0c-a02acaba7d16 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:58.403572 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1128/2256] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:56:58 2022] DELETE /identity/v3/users/70e205b7104540dba12cc9fc503de2c1 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:58.441041 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1129/2257] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:58 2022] POST /identity/v3/projects => generated 381 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:56:58.442169 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50985752-f2b0-4e76-be28-db0e73a5a833 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:58.494908 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:58.533153 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50985752-f2b0-4e76-be28-db0e73a5a833 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:58.652526 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569575ec-5440-4775-81ac-5b74e6607372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:58.654224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569575ec-5440-4775-81ac-5b74e6607372 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:58.654570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569575ec-5440-4775-81ac-5b74e6607372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:58.654857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569575ec-5440-4775-81ac-5b74e6607372 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:58.655678 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569575ec-5440-4775-81ac-5b74e6607372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:58.658371 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569575ec-5440-4775-81ac-5b74e6607372 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:58.694523 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aef2c5-fde3-4b51-aa0c-a02acaba7d16 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:58.701912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1129/2258] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:56:58 2022] POST /identity/v3/users => generated 291 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:56:58.709548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aef2c5-fde3-4b51-aa0c-a02acaba7d16 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:58.720190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16f1e4-4f51-4287-83d5-6255e53edb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:58.721039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16f1e4-4f51-4287-83d5-6255e53edb35 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:58.721501 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16f1e4-4f51-4287-83d5-6255e53edb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:58.722025 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16f1e4-4f51-4287-83d5-6255e53edb35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:58.722942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16f1e4-4f51-4287-83d5-6255e53edb35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:58.726682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16f1e4-4f51-4287-83d5-6255e53edb35 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:58.750730 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569575ec-5440-4775-81ac-5b74e6607372 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:58.750829 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1130/2259] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:58.765141 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569575ec-5440-4775-81ac-5b74e6607372 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:58.773208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d429480-1160-41b7-9691-6fc965866e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:58.774220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d429480-1160-41b7-9691-6fc965866e75 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:58.774737 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d429480-1160-41b7-9691-6fc965866e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:58.775263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d429480-1160-41b7-9691-6fc965866e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:58.776095 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d429480-1160-41b7-9691-6fc965866e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:58.778223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d429480-1160-41b7-9691-6fc965866e75 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:58.801602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16f1e4-4f51-4287-83d5-6255e53edb35 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:58.802902 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1130/2260] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:56:58.822503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16f1e4-4f51-4287-83d5-6255e53edb35 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:58.828956 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b5479-c2ac-471b-8f8a-5318800d81cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:58.830171 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b5479-c2ac-471b-8f8a-5318800d81cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:58.830544 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b5479-c2ac-471b-8f8a-5318800d81cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:58.830890 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b5479-c2ac-471b-8f8a-5318800d81cc admin admin] PATH_INFO: `/v3/projects/2cca5e0418c74b478474f23bae70dd8b/users/0d7099453cf9439884ff8e77d65af242/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:58.858317 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b5479-c2ac-471b-8f8a-5318800d81cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cca5e0418c74b478474f23bae70dd8b, user_id=0d7099453cf9439884ff8e77d65af242, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:58.861841 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b5479-c2ac-471b-8f8a-5318800d81cc admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:58.866090 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:58.901730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1131/2261] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:56:58 2022] PUT /identity/v3/projects/2cca5e0418c74b478474f23bae70dd8b/users/0d7099453cf9439884ff8e77d65af242/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:58.907084 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e416b7-a94e-4645-b710-40e2db6d7632 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:58.907374 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e416b7-a94e-4645-b710-40e2db6d7632 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:58.907655 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e416b7-a94e-4645-b710-40e2db6d7632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:58.932497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-11e416b7-a94e-4645-b710-40e2db6d7632 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:58.934034 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-11e416b7-a94e-4645-b710-40e2db6d7632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:59.047804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1131/2262] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:59.075893 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b5479-c2ac-471b-8f8a-5318800d81cc admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:59.078388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e27b5479-c2ac-471b-8f8a-5318800d81cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:59.159126 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b5479-c2ac-471b-8f8a-5318800d81cc admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:59.163678 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f98be6-6c29-4deb-84c7-72be6a8b9985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:59.164751 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f98be6-6c29-4deb-84c7-72be6a8b9985 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:59.165246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f98be6-6c29-4deb-84c7-72be6a8b9985 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:59.165706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f98be6-6c29-4deb-84c7-72be6a8b9985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:59.180050 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f98be6-6c29-4deb-84c7-72be6a8b9985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:59.182237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f98be6-6c29-4deb-84c7-72be6a8b9985 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:59.200715 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1132/2263] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:56:59.310899 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e416b7-a94e-4645-b710-40e2db6d7632 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:59.315740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-11e416b7-a94e-4645-b710-40e2db6d7632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:59.352835 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e416b7-a94e-4645-b710-40e2db6d7632 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:59.362067 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8606a5-43b2-41a5-b4f4-a2a022cd6d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:59.363038 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8606a5-43b2-41a5-b4f4-a2a022cd6d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:59.363402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8606a5-43b2-41a5-b4f4-a2a022cd6d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:59.363889 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8606a5-43b2-41a5-b4f4-a2a022cd6d95 admin admin] PATH_INFO: `/v3/projects/2193d71023ff4431a372ce5d93e78f02` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:59.370095 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8606a5-43b2-41a5-b4f4-a2a022cd6d95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2193d71023ff4431a372ce5d93e78f02)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:59.372933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8606a5-43b2-41a5-b4f4-a2a022cd6d95 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:59.432847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-3d8606a5-43b2-41a5-b4f4-a2a022cd6d95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2193d71023ff4431a372ce5d93e78f02', 'request_id': 'req-3d8606a5-43b2-41a5-b4f4-a2a022cd6d95'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:59.456623 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-3d8606a5-43b2-41a5-b4f4-a2a022cd6d95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2193d71023ff4431a372ce5d93e78f02', 'request_id': 'req-3d8606a5-43b2-41a5-b4f4-a2a022cd6d95'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:59.467919 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-3d8606a5-43b2-41a5-b4f4-a2a022cd6d95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2193d71023ff4431a372ce5d93e78f02', 'request_id': 'req-3d8606a5-43b2-41a5-b4f4-a2a022cd6d95'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:59.470748 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:59.485768 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-3d8606a5-43b2-41a5-b4f4-a2a022cd6d95 admin admin] The token cache is being invalidate because project 2193d71023ff4431a372ce5d93e78f02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:56:59.486639 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-3d8606a5-43b2-41a5-b4f4-a2a022cd6d95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:59.487839 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-3d8606a5-43b2-41a5-b4f4-a2a022cd6d95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:56:59.493174 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1132/2264] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:56:59 2022] DELETE /identity/v3/projects/2193d71023ff4431a372ce5d93e78f02 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:56:59.494921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a432d-9767-4def-8a65-c068154cdf1e None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:59.495204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a432d-9767-4def-8a65-c068154cdf1e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:59.495477 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a432d-9767-4def-8a65-c068154cdf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:59.538290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-ec3a432d-9767-4def-8a65-c068154cdf1e None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:59.540591 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ec3a432d-9767-4def-8a65-c068154cdf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:59.657544 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1133/2265] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:59.667943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3530ae3-f83a-4571-a4bf-935ec1be4237 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:59.668233 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3530ae3-f83a-4571-a4bf-935ec1be4237 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:59.668514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3530ae3-f83a-4571-a4bf-935ec1be4237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:59.733304 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f3530ae3-f83a-4571-a4bf-935ec1be4237 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:56:59.734742 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f3530ae3-f83a-4571-a4bf-935ec1be4237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:56:59.750260 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1133/2266] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:56:59.751139 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a432d-9767-4def-8a65-c068154cdf1e None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:59.767478 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a432d-9767-4def-8a65-c068154cdf1e None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:59.795609 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50672556-1491-41dc-85dd-bd89e564a6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:59.797639 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50672556-1491-41dc-85dd-bd89e564a6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:59.798291 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50672556-1491-41dc-85dd-bd89e564a6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:59.799468 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50672556-1491-41dc-85dd-bd89e564a6a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:59.802274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50672556-1491-41dc-85dd-bd89e564a6a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:56:59.802670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50672556-1491-41dc-85dd-bd89e564a6a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:59.806762 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50672556-1491-41dc-85dd-bd89e564a6a1 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:56:59.828380 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1134/2267] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:56:59.833612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3530ae3-f83a-4571-a4bf-935ec1be4237 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:56:59.858490 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3530ae3-f83a-4571-a4bf-935ec1be4237 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:56:59.871941 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8f9c6-dee3-4230-9683-695cbc5279ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:56:59.873184 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8f9c6-dee3-4230-9683-695cbc5279ef admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:56:59.873533 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8f9c6-dee3-4230-9683-695cbc5279ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:56:59.874347 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8f9c6-dee3-4230-9683-695cbc5279ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:56:59.882804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8f9c6-dee3-4230-9683-695cbc5279ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:56:59.910814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8f9c6-dee3-4230-9683-695cbc5279ef admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:00.016186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1134/2268] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:56:59 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:57:00.017867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50672556-1491-41dc-85dd-bd89e564a6a1 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:00.038480 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50672556-1491-41dc-85dd-bd89e564a6a1 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:00.156902 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c1ab8-79fe-4d7b-be8e-80b62630882a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:00.157884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c1ab8-79fe-4d7b-be8e-80b62630882a admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:00.158170 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c1ab8-79fe-4d7b-be8e-80b62630882a admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:00.158444 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c1ab8-79fe-4d7b-be8e-80b62630882a admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:00.159322 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c1ab8-79fe-4d7b-be8e-80b62630882a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:00.161323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c1ab8-79fe-4d7b-be8e-80b62630882a admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:00.197075 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1135/2269] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:57:00 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:57:00.199442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8f9c6-dee3-4230-9683-695cbc5279ef admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:00.211971 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8f9c6-dee3-4230-9683-695cbc5279ef admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:00.220819 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d52d4-32a8-480f-acab-df41647e9efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:00.221558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d52d4-32a8-480f-acab-df41647e9efc admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:00.222086 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d52d4-32a8-480f-acab-df41647e9efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:00.222390 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d52d4-32a8-480f-acab-df41647e9efc admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:00.223434 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d52d4-32a8-480f-acab-df41647e9efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:00.225369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d52d4-32a8-480f-acab-df41647e9efc admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:00.242155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1135/2270] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:57:00.244028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c1ab8-79fe-4d7b-be8e-80b62630882a admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:00.256705 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c1ab8-79fe-4d7b-be8e-80b62630882a admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:00.263181 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60b329-0b9f-409f-be5e-275c0e118c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:00.263944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60b329-0b9f-409f-be5e-275c0e118c84 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:00.264330 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60b329-0b9f-409f-be5e-275c0e118c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:00.265092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60b329-0b9f-409f-be5e-275c0e118c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:00.265958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60b329-0b9f-409f-be5e-275c0e118c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:00.267779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60b329-0b9f-409f-be5e-275c0e118c84 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:00.282620 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1136/2271] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:57:00.287234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d52d4-32a8-480f-acab-df41647e9efc admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:00.302859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d52d4-32a8-480f-acab-df41647e9efc admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:00.308069 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce406d-1997-4eb1-a081-6a34be2767f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:00.317433 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce406d-1997-4eb1-a081-6a34be2767f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:00.317433 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce406d-1997-4eb1-a081-6a34be2767f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:00.317433 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce406d-1997-4eb1-a081-6a34be2767f9 admin admin] PATH_INFO: `/v3/projects/444e8687e2234a4db01822379b74eda8/users/3833d41f95df4e059afe2fb30c30629f/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:00.332132 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce406d-1997-4eb1-a081-6a34be2767f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=444e8687e2234a4db01822379b74eda8, user_id=3833d41f95df4e059afe2fb30c30629f, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:00.334953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce406d-1997-4eb1-a081-6a34be2767f9 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:00.366389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1136/2272] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:57:00 2022] PUT /identity/v3/projects/444e8687e2234a4db01822379b74eda8/users/3833d41f95df4e059afe2fb30c30629f/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:57:00.437170 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ee3de-659b-42b1-9ae0-110b7016fc31 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:00.437481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ee3de-659b-42b1-9ae0-110b7016fc31 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:00.437769 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ee3de-659b-42b1-9ae0-110b7016fc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:00.447784 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:00.484353 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-ce9ee3de-659b-42b1-9ae0-110b7016fc31 None None] MFA Rules not processed for user `3833d41f95df4e059afe2fb30c30629f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:00.486181 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ce9ee3de-659b-42b1-9ae0-110b7016fc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:00.645652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1137/2273] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:00.654016 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce406d-1997-4eb1-a081-6a34be2767f9 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:00.657119 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e6ce406d-1997-4eb1-a081-6a34be2767f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:00.741723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce406d-1997-4eb1-a081-6a34be2767f9 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:00.746635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660dda9-9a66-4f24-8919-740522b009a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:00.747455 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660dda9-9a66-4f24-8919-740522b009a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:00.747772 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660dda9-9a66-4f24-8919-740522b009a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:00.748055 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660dda9-9a66-4f24-8919-740522b009a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:00.765566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660dda9-9a66-4f24-8919-740522b009a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:00.767081 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660dda9-9a66-4f24-8919-740522b009a7 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:00.780822 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1137/2274] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:00.860033 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473a051-b4df-4072-a2aa-187676417837 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:00.860414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473a051-b4df-4072-a2aa-187676417837 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:00.860708 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473a051-b4df-4072-a2aa-187676417837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:00.901547 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-2473a051-b4df-4072-a2aa-187676417837 None None] MFA Rules not processed for user `0d7099453cf9439884ff8e77d65af242`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:00.902940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-2473a051-b4df-4072-a2aa-187676417837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:00.973079 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1138/2275] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:00.987177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660dda9-9a66-4f24-8919-740522b009a7 service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:00.988865 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a660dda9-9a66-4f24-8919-740522b009a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:01.004406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660dda9-9a66-4f24-8919-740522b009a7 service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:01.021990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c945a-5895-41ab-9165-0b7891f95174 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:01.022646 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c945a-5895-41ab-9165-0b7891f95174 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:01.022927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c945a-5895-41ab-9165-0b7891f95174 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:01.023842 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c945a-5895-41ab-9165-0b7891f95174 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:01.034133 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c945a-5895-41ab-9165-0b7891f95174 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:01.035809 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c945a-5895-41ab-9165-0b7891f95174 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:01.049653 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1138/2276] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:01.919668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e45f8-eaf5-4d75-8878-f2700efbe586 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:01.920422 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e45f8-eaf5-4d75-8878-f2700efbe586 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:01.920422 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e45f8-eaf5-4d75-8878-f2700efbe586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:01.939734 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-c80e45f8-eaf5-4d75-8878-f2700efbe586 None None] MFA Rules not processed for user `a8330780c04d4ab9a43b5f49a1e7e4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:01.940957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-c80e45f8-eaf5-4d75-8878-f2700efbe586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:01.995751 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1139/2277] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:02.374771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255b828-d899-4bb2-8c4e-43dcb6ed8940 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:02.375302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255b828-d899-4bb2-8c4e-43dcb6ed8940 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:02.375302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255b828-d899-4bb2-8c4e-43dcb6ed8940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:02.398108 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c255b828-d899-4bb2-8c4e-43dcb6ed8940 None None] MFA Rules not processed for user `3833d41f95df4e059afe2fb30c30629f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:02.399566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c255b828-d899-4bb2-8c4e-43dcb6ed8940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:02.407132 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1139/2278] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:02.521107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f9a7e-903b-4719-921b-b473e9ae49c7 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:02.521643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f9a7e-903b-4719-921b-b473e9ae49c7 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:02.521926 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f9a7e-903b-4719-921b-b473e9ae49c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:02.563650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-3d7f9a7e-903b-4719-921b-b473e9ae49c7 None None] MFA Rules not processed for user `0d7099453cf9439884ff8e77d65af242`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:02.565236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-3d7f9a7e-903b-4719-921b-b473e9ae49c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:02.574642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1140/2279] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:05.244883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255b828-d899-4bb2-8c4e-43dcb6ed8940 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:05.246798 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c255b828-d899-4bb2-8c4e-43dcb6ed8940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:05.449192 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255b828-d899-4bb2-8c4e-43dcb6ed8940 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:05.458297 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e62b8-e83d-4e38-b61c-8a8b7b3addf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:05.459207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e62b8-e83d-4e38-b61c-8a8b7b3addf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:05.459581 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e62b8-e83d-4e38-b61c-8a8b7b3addf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:05.460085 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e62b8-e83d-4e38-b61c-8a8b7b3addf3 admin admin] PATH_INFO: `/v3/users/3090a1a7295544d88b74c66c56465add` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:05.461505 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e62b8-e83d-4e38-b61c-8a8b7b3addf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3090a1a7295544d88b74c66c56465add)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:05.464385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e62b8-e83d-4e38-b61c-8a8b7b3addf3 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:05.498050 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:05.604478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-815e62b8-e83d-4e38-b61c-8a8b7b3addf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3090a1a7295544d88b74c66c56465add'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:05.605286 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-815e62b8-e83d-4e38-b61c-8a8b7b3addf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3090a1a7295544d88b74c66c56465add'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:05.614105 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-815e62b8-e83d-4e38-b61c-8a8b7b3addf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3090a1a7295544d88b74c66c56465add'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:05.638174 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-815e62b8-e83d-4e38-b61c-8a8b7b3addf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3090a1a7295544d88b74c66c56465add'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:05.641515 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-815e62b8-e83d-4e38-b61c-8a8b7b3addf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3090a1a7295544d88b74c66c56465add'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:05.673813 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1140/2280] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:57:05 2022] DELETE /identity/v3/users/3090a1a7295544d88b74c66c56465add => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:57:05.678122 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e20ba8-07f0-411d-bcf4-2b44bf596d6b None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:05.678611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e20ba8-07f0-411d-bcf4-2b44bf596d6b None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:05.678723 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e20ba8-07f0-411d-bcf4-2b44bf596d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:05.707185 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-61e20ba8-07f0-411d-bcf4-2b44bf596d6b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:05.708415 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-61e20ba8-07f0-411d-bcf4-2b44bf596d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:05.725030 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:05.791211 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1141/2281] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:57:05.822096 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e62b8-e83d-4e38-b61c-8a8b7b3addf3 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:05.824529 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-815e62b8-e83d-4e38-b61c-8a8b7b3addf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:05.965693 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e62b8-e83d-4e38-b61c-8a8b7b3addf3 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:05.977799 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8bb63-c4eb-4a2f-94b6-35cbe86a037d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:05.978898 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8bb63-c4eb-4a2f-94b6-35cbe86a037d service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:05.978898 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8bb63-c4eb-4a2f-94b6-35cbe86a037d service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:05.979096 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8bb63-c4eb-4a2f-94b6-35cbe86a037d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:05.993963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8bb63-c4eb-4a2f-94b6-35cbe86a037d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:05.998190 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8bb63-c4eb-4a2f-94b6-35cbe86a037d service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:06.013920 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1141/2282] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:06.958572 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e20ba8-07f0-411d-bcf4-2b44bf596d6b None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:06.960921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-61e20ba8-07f0-411d-bcf4-2b44bf596d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:06.991359 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e20ba8-07f0-411d-bcf4-2b44bf596d6b None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:07.001733 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8ea6e-76e3-4008-9fa4-66a2d8c2fcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:07.005761 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8ea6e-76e3-4008-9fa4-66a2d8c2fcaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:07.006146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8ea6e-76e3-4008-9fa4-66a2d8c2fcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:07.006427 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8ea6e-76e3-4008-9fa4-66a2d8c2fcaa admin admin] PATH_INFO: `/v3/projects/684c8364fcef45858a32cb8d01c939c2` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:07.010015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8ea6e-76e3-4008-9fa4-66a2d8c2fcaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=684c8364fcef45858a32cb8d01c939c2)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:07.018555 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8ea6e-76e3-4008-9fa4-66a2d8c2fcaa admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:07.171868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-34b8ea6e-76e3-4008-9fa4-66a2d8c2fcaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '684c8364fcef45858a32cb8d01c939c2', 'request_id': 'req-34b8ea6e-76e3-4008-9fa4-66a2d8c2fcaa'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:07.194723 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-34b8ea6e-76e3-4008-9fa4-66a2d8c2fcaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '684c8364fcef45858a32cb8d01c939c2', 'request_id': 'req-34b8ea6e-76e3-4008-9fa4-66a2d8c2fcaa'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:07.214776 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-34b8ea6e-76e3-4008-9fa4-66a2d8c2fcaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '684c8364fcef45858a32cb8d01c939c2', 'request_id': 'req-34b8ea6e-76e3-4008-9fa4-66a2d8c2fcaa'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:07.238286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-34b8ea6e-76e3-4008-9fa4-66a2d8c2fcaa admin admin] The token cache is being invalidate because project 684c8364fcef45858a32cb8d01c939c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:57:07.238667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-34b8ea6e-76e3-4008-9fa4-66a2d8c2fcaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:07.239601 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-34b8ea6e-76e3-4008-9fa4-66a2d8c2fcaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:07.241296 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1142/2283] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:57:06 2022] DELETE /identity/v3/projects/684c8364fcef45858a32cb8d01c939c2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:57:07.247689 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9e25a-9c28-4075-b9ce-daca08e9ec2b None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:07.248146 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9e25a-9c28-4075-b9ce-daca08e9ec2b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:07.248256 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9e25a-9c28-4075-b9ce-daca08e9ec2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:07.300701 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d4a9e25a-9c28-4075-b9ce-daca08e9ec2b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:07.301999 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d4a9e25a-9c28-4075-b9ce-daca08e9ec2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:07.441118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1142/2284] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:07.448299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d18a0-8150-4ac6-8686-cb9de1caab60 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:07.448593 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d18a0-8150-4ac6-8686-cb9de1caab60 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:07.449227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d18a0-8150-4ac6-8686-cb9de1caab60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:07.480479 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-f52d18a0-8150-4ac6-8686-cb9de1caab60 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:07.481962 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f52d18a0-8150-4ac6-8686-cb9de1caab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:07.495177 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1143/2285] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:57:07.498717 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9e25a-9c28-4075-b9ce-daca08e9ec2b None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:07.518474 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9e25a-9c28-4075-b9ce-daca08e9ec2b None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:07.534821 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad458466-4c53-49b8-ba1e-1793294bb2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:07.535548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad458466-4c53-49b8-ba1e-1793294bb2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:07.535755 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad458466-4c53-49b8-ba1e-1793294bb2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:07.535993 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad458466-4c53-49b8-ba1e-1793294bb2f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:07.536695 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad458466-4c53-49b8-ba1e-1793294bb2f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:57:07.536996 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad458466-4c53-49b8-ba1e-1793294bb2f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:07.538917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad458466-4c53-49b8-ba1e-1793294bb2f7 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:07.576509 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1143/2286] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:57:07.577303 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d18a0-8150-4ac6-8686-cb9de1caab60 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:07.601252 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d18a0-8150-4ac6-8686-cb9de1caab60 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:07.618985 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1947d6-06aa-4749-9445-8a32e398b6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:07.622123 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1947d6-06aa-4749-9445-8a32e398b6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:07.622635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1947d6-06aa-4749-9445-8a32e398b6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:07.624319 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1947d6-06aa-4749-9445-8a32e398b6b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:07.631530 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1947d6-06aa-4749-9445-8a32e398b6b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:07.634504 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1947d6-06aa-4749-9445-8a32e398b6b6 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:07.739285 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1144/2287] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:57:07 2022] POST /identity/v3/projects => generated 371 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:57:07.743128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad458466-4c53-49b8-ba1e-1793294bb2f7 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:07.757122 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad458466-4c53-49b8-ba1e-1793294bb2f7 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:07.788589 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:07.921188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe677ae-9b91-455f-bd52-6f97eee44bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:07.929182 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe677ae-9b91-455f-bd52-6f97eee44bca admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:07.929870 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe677ae-9b91-455f-bd52-6f97eee44bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:07.931947 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe677ae-9b91-455f-bd52-6f97eee44bca admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:07.934433 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe677ae-9b91-455f-bd52-6f97eee44bca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:07.936947 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe677ae-9b91-455f-bd52-6f97eee44bca admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:07.992882 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1144/2288] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:57:07 2022] POST /identity/v3/users => generated 286 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:57:08.000091 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1947d6-06aa-4749-9445-8a32e398b6b6 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:08.019123 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1947d6-06aa-4749-9445-8a32e398b6b6 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:08.029939 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b3aba-fbb8-4da0-800e-a1acc7c31a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:08.030862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b3aba-fbb8-4da0-800e-a1acc7c31a03 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:08.031250 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b3aba-fbb8-4da0-800e-a1acc7c31a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:08.035838 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b3aba-fbb8-4da0-800e-a1acc7c31a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:08.040308 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b3aba-fbb8-4da0-800e-a1acc7c31a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:08.059042 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b3aba-fbb8-4da0-800e-a1acc7c31a03 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:08.089858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe677ae-9b91-455f-bd52-6f97eee44bca admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:08.098468 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1145/2289] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:57:08.102992 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe677ae-9b91-455f-bd52-6f97eee44bca admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:08.125718 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d3b66-0840-471a-aaac-deded15d1421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:08.126814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d3b66-0840-471a-aaac-deded15d1421 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:08.127462 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d3b66-0840-471a-aaac-deded15d1421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:08.128020 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d3b66-0840-471a-aaac-deded15d1421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:08.129334 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d3b66-0840-471a-aaac-deded15d1421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:08.133238 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d3b66-0840-471a-aaac-deded15d1421 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:08.166132 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1145/2290] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:57:08.167985 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b3aba-fbb8-4da0-800e-a1acc7c31a03 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:08.179997 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b3aba-fbb8-4da0-800e-a1acc7c31a03 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:08.189878 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58012f9-3941-423e-9bea-02e7f8464cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:08.213119 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58012f9-3941-423e-9bea-02e7f8464cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:08.221593 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58012f9-3941-423e-9bea-02e7f8464cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:08.224880 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58012f9-3941-423e-9bea-02e7f8464cf2 admin admin] PATH_INFO: `/v3/projects/a9c4e18008c649eab473e8fcd4cd13bd/users/b58d9d1ef4954e79ad98bd8abdc71dab/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:08.253590 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58012f9-3941-423e-9bea-02e7f8464cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9c4e18008c649eab473e8fcd4cd13bd, user_id=b58d9d1ef4954e79ad98bd8abdc71dab, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:08.258314 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58012f9-3941-423e-9bea-02e7f8464cf2 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:08.287279 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1146/2291] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:57:08 2022] PUT /identity/v3/projects/a9c4e18008c649eab473e8fcd4cd13bd/users/b58d9d1ef4954e79ad98bd8abdc71dab/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:57:08.294633 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414c6e1-20b0-451d-96bf-e41545fb8264 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:08.295186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414c6e1-20b0-451d-96bf-e41545fb8264 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:08.295527 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414c6e1-20b0-451d-96bf-e41545fb8264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:08.327235 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-9414c6e1-20b0-451d-96bf-e41545fb8264 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:08.330947 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9414c6e1-20b0-451d-96bf-e41545fb8264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:08.466199 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1146/2292] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:08.501535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58012f9-3941-423e-9bea-02e7f8464cf2 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:08.510522 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e58012f9-3941-423e-9bea-02e7f8464cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:08.582936 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:08.600602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58012f9-3941-423e-9bea-02e7f8464cf2 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:08.608604 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb4a82-43fa-42db-bbbe-a1238be65be5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:08.609894 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb4a82-43fa-42db-bbbe-a1238be65be5 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:08.610301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb4a82-43fa-42db-bbbe-a1238be65be5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:08.610711 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb4a82-43fa-42db-bbbe-a1238be65be5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:08.625225 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb4a82-43fa-42db-bbbe-a1238be65be5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:08.627382 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb4a82-43fa-42db-bbbe-a1238be65be5 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:08.641008 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1147/2293] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:11.177019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485fd11-975e-44f0-8ef1-02ed107f55be None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:11.177692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485fd11-975e-44f0-8ef1-02ed107f55be None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:11.178142 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485fd11-975e-44f0-8ef1-02ed107f55be None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:11.179539 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1147/2294] 10.222.0.96 () {54 vars in 921 bytes} [Thu Jul 28 17:57:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:57:11.198309 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07808741-9952-45cb-a09a-675057043438 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:11.198847 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07808741-9952-45cb-a09a-675057043438 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:11.199305 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07808741-9952-45cb-a09a-675057043438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:11.250568 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-07808741-9952-45cb-a09a-675057043438 None None] MFA Rules not processed for user `38257735924d44488e1407fefb886324`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:11.251842 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-07808741-9952-45cb-a09a-675057043438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:11.411840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1148/2295] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Jul 28 17:57:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:11.464963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485fd11-975e-44f0-8ef1-02ed107f55be None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:11.466751 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5485fd11-975e-44f0-8ef1-02ed107f55be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:11.500210 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485fd11-975e-44f0-8ef1-02ed107f55be None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:11.507669 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9bfbf-6883-4c7c-94b8-25579a608b02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38257735924d44488e1407fefb886324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:11.508467 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9bfbf-6883-4c7c-94b8-25579a608b02 service placement] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:11.508749 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9bfbf-6883-4c7c-94b8-25579a608b02 service placement] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:11.509050 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9bfbf-6883-4c7c-94b8-25579a608b02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:11.520089 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9bfbf-6883-4c7c-94b8-25579a608b02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:11.521743 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9bfbf-6883-4c7c-94b8-25579a608b02 service placement] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:11.537406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1148/2296] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:12.349657 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07808741-9952-45cb-a09a-675057043438 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:12.351626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-07808741-9952-45cb-a09a-675057043438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:12.373436 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07808741-9952-45cb-a09a-675057043438 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:12.386793 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a58983-6691-425a-9c94-021d9e35b7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:12.387464 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a58983-6691-425a-9c94-021d9e35b7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:12.387743 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a58983-6691-425a-9c94-021d9e35b7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:12.388018 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a58983-6691-425a-9c94-021d9e35b7d7 admin admin] PATH_INFO: `/v3/users/16e40996a8944be5ae15208328832aad` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:12.393288 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a58983-6691-425a-9c94-021d9e35b7d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e40996a8944be5ae15208328832aad)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:12.395244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a58983-6691-425a-9c94-021d9e35b7d7 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:12.507442 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f9a58983-6691-425a-9c94-021d9e35b7d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e40996a8944be5ae15208328832aad'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:12.536665 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f9a58983-6691-425a-9c94-021d9e35b7d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e40996a8944be5ae15208328832aad'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:12.557800 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f9a58983-6691-425a-9c94-021d9e35b7d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e40996a8944be5ae15208328832aad'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:12.568366 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f9a58983-6691-425a-9c94-021d9e35b7d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e40996a8944be5ae15208328832aad'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:12.571639 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f9a58983-6691-425a-9c94-021d9e35b7d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e40996a8944be5ae15208328832aad'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:12.591296 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1149/2297] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:57:12 2022] DELETE /identity/v3/users/16e40996a8944be5ae15208328832aad => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:57:13.135127 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9bfbf-6883-4c7c-94b8-25579a608b02 service placement] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:13.149878 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9bfbf-6883-4c7c-94b8-25579a608b02 service placement] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:13.214443 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae5ca8-dc3d-4789-b153-bc91caf93297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:13.215310 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae5ca8-dc3d-4789-b153-bc91caf93297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:13.215637 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae5ca8-dc3d-4789-b153-bc91caf93297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:13.215916 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae5ca8-dc3d-4789-b153-bc91caf93297 admin admin] PATH_INFO: `/v3/projects/8ac774a6a6184fce91242a4dac87405d` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:13.217143 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae5ca8-dc3d-4789-b153-bc91caf93297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ac774a6a6184fce91242a4dac87405d)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:13.219130 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae5ca8-dc3d-4789-b153-bc91caf93297 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:13.263163 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:13.284703 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1aae5ca8-dc3d-4789-b153-bc91caf93297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ac774a6a6184fce91242a4dac87405d', 'request_id': 'req-1aae5ca8-dc3d-4789-b153-bc91caf93297'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:13.295710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1aae5ca8-dc3d-4789-b153-bc91caf93297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ac774a6a6184fce91242a4dac87405d', 'request_id': 'req-1aae5ca8-dc3d-4789-b153-bc91caf93297'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:13.307234 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1aae5ca8-dc3d-4789-b153-bc91caf93297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ac774a6a6184fce91242a4dac87405d', 'request_id': 'req-1aae5ca8-dc3d-4789-b153-bc91caf93297'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:13.320835 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1aae5ca8-dc3d-4789-b153-bc91caf93297 admin admin] The token cache is being invalidate because project 8ac774a6a6184fce91242a4dac87405d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:57:13.321430 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1aae5ca8-dc3d-4789-b153-bc91caf93297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:13.322525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1aae5ca8-dc3d-4789-b153-bc91caf93297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:13.324653 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1149/2298] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:57:13 2022] DELETE /identity/v3/projects/8ac774a6a6184fce91242a4dac87405d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:57:13.329282 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a58983-6691-425a-9c94-021d9e35b7d7 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:13.331074 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f9a58983-6691-425a-9c94-021d9e35b7d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:13.346417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a58983-6691-425a-9c94-021d9e35b7d7 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:13.408079 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:13.421482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538a4bd-8547-4f36-bae7-564a672d9fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:13.422674 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538a4bd-8547-4f36-bae7-564a672d9fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:13.423405 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538a4bd-8547-4f36-bae7-564a672d9fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:13.424237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538a4bd-8547-4f36-bae7-564a672d9fdb admin admin] PATH_INFO: `/v3/users/fa41018d1d194992b7b0a9ca07fe0749` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:13.425751 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538a4bd-8547-4f36-bae7-564a672d9fdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa41018d1d194992b7b0a9ca07fe0749)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:13.428104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538a4bd-8547-4f36-bae7-564a672d9fdb admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:13.481125 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c538a4bd-8547-4f36-bae7-564a672d9fdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa41018d1d194992b7b0a9ca07fe0749'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:13.496146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c538a4bd-8547-4f36-bae7-564a672d9fdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa41018d1d194992b7b0a9ca07fe0749'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:13.504862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c538a4bd-8547-4f36-bae7-564a672d9fdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa41018d1d194992b7b0a9ca07fe0749'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:13.514634 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c538a4bd-8547-4f36-bae7-564a672d9fdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa41018d1d194992b7b0a9ca07fe0749'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:13.515379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c538a4bd-8547-4f36-bae7-564a672d9fdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa41018d1d194992b7b0a9ca07fe0749'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:13.526524 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1150/2299] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:57:13 2022] DELETE /identity/v3/users/fa41018d1d194992b7b0a9ca07fe0749 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:57:13.834681 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae5ca8-dc3d-4789-b153-bc91caf93297 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:13.836487 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1aae5ca8-dc3d-4789-b153-bc91caf93297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:13.859383 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae5ca8-dc3d-4789-b153-bc91caf93297 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:13.974122 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e7b4c-9597-4d1a-9033-a99ee65c2cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:13.974811 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e7b4c-9597-4d1a-9033-a99ee65c2cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:13.975498 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e7b4c-9597-4d1a-9033-a99ee65c2cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:13.975779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e7b4c-9597-4d1a-9033-a99ee65c2cb9 admin admin] PATH_INFO: `/v3/projects/7b26fe74e5f54ea096892b7e529c7977` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:13.977535 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e7b4c-9597-4d1a-9033-a99ee65c2cb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b26fe74e5f54ea096892b7e529c7977)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:13.980709 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e7b4c-9597-4d1a-9033-a99ee65c2cb9 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:14.062953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-615e7b4c-9597-4d1a-9033-a99ee65c2cb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b26fe74e5f54ea096892b7e529c7977', 'request_id': 'req-615e7b4c-9597-4d1a-9033-a99ee65c2cb9'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:14.073232 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-615e7b4c-9597-4d1a-9033-a99ee65c2cb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b26fe74e5f54ea096892b7e529c7977', 'request_id': 'req-615e7b4c-9597-4d1a-9033-a99ee65c2cb9'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:14.090053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-615e7b4c-9597-4d1a-9033-a99ee65c2cb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b26fe74e5f54ea096892b7e529c7977', 'request_id': 'req-615e7b4c-9597-4d1a-9033-a99ee65c2cb9'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:14.109400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-615e7b4c-9597-4d1a-9033-a99ee65c2cb9 admin admin] The token cache is being invalidate because project 7b26fe74e5f54ea096892b7e529c7977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:57:14.110377 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-615e7b4c-9597-4d1a-9033-a99ee65c2cb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:14.111622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-615e7b4c-9597-4d1a-9033-a99ee65c2cb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:14.115144 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1150/2300] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:57:13 2022] DELETE /identity/v3/projects/7b26fe74e5f54ea096892b7e529c7977 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:57:14.120133 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476ca7f-1384-4c5d-8228-c92e0a4a43af None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:14.120419 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476ca7f-1384-4c5d-8228-c92e0a4a43af None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:14.120693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476ca7f-1384-4c5d-8228-c92e0a4a43af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:14.150103 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-1476ca7f-1384-4c5d-8228-c92e0a4a43af None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:14.151508 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1476ca7f-1384-4c5d-8228-c92e0a4a43af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:14.257290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1151/2301] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:57:14.263194 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70427c6e-66ce-4a2b-8cf1-f7b4ebe381b5 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:14.263643 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70427c6e-66ce-4a2b-8cf1-f7b4ebe381b5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:14.263731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70427c6e-66ce-4a2b-8cf1-f7b4ebe381b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:14.291683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-70427c6e-66ce-4a2b-8cf1-f7b4ebe381b5 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:14.293276 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-70427c6e-66ce-4a2b-8cf1-f7b4ebe381b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:14.301612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1151/2302] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:14.306852 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476ca7f-1384-4c5d-8228-c92e0a4a43af None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:14.321769 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476ca7f-1384-4c5d-8228-c92e0a4a43af None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:14.328385 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c37c65-c3d7-4a3f-b705-6fd47cc5991e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:14.329162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c37c65-c3d7-4a3f-b705-6fd47cc5991e admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:14.329502 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c37c65-c3d7-4a3f-b705-6fd47cc5991e admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:14.330801 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c37c65-c3d7-4a3f-b705-6fd47cc5991e admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:14.332121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c37c65-c3d7-4a3f-b705-6fd47cc5991e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:57:14.332491 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c37c65-c3d7-4a3f-b705-6fd47cc5991e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:14.335439 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c37c65-c3d7-4a3f-b705-6fd47cc5991e admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:14.354954 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1152/2303] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:57:14.359426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70427c6e-66ce-4a2b-8cf1-f7b4ebe381b5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:14.370270 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70427c6e-66ce-4a2b-8cf1-f7b4ebe381b5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:14.379350 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a898cb9-a50d-4685-a58c-72e06d074ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:14.380044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a898cb9-a50d-4685-a58c-72e06d074ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:14.380294 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a898cb9-a50d-4685-a58c-72e06d074ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:14.380538 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a898cb9-a50d-4685-a58c-72e06d074ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:14.382066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a898cb9-a50d-4685-a58c-72e06d074ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:14.384211 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a898cb9-a50d-4685-a58c-72e06d074ca0 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:14.432506 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1152/2304] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:57:14 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:57:14.434860 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c37c65-c3d7-4a3f-b705-6fd47cc5991e admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:14.452414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c37c65-c3d7-4a3f-b705-6fd47cc5991e admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:14.585512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:14.611782 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be3407-e3d9-43d1-a200-ab051c670874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:14.613297 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be3407-e3d9-43d1-a200-ab051c670874 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:14.614556 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be3407-e3d9-43d1-a200-ab051c670874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:14.614905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be3407-e3d9-43d1-a200-ab051c670874 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:14.616944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be3407-e3d9-43d1-a200-ab051c670874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:14.622925 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be3407-e3d9-43d1-a200-ab051c670874 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:14.708504 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1153/2305] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:57:14 2022] POST /identity/v3/users => generated 292 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:57:14.709697 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a898cb9-a50d-4685-a58c-72e06d074ca0 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:14.745406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a898cb9-a50d-4685-a58c-72e06d074ca0 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:14.767025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d536f-5677-4073-98ff-a30e0a1b3317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:14.769100 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d536f-5677-4073-98ff-a30e0a1b3317 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:14.769100 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d536f-5677-4073-98ff-a30e0a1b3317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:14.769100 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d536f-5677-4073-98ff-a30e0a1b3317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:14.769100 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d536f-5677-4073-98ff-a30e0a1b3317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:14.770552 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d536f-5677-4073-98ff-a30e0a1b3317 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:14.793112 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1153/2306] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:57:14.797332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be3407-e3d9-43d1-a200-ab051c670874 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:14.826235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be3407-e3d9-43d1-a200-ab051c670874 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:14.838791 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef064d5-c98c-477f-a1f3-7f359a3118c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:14.839430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef064d5-c98c-477f-a1f3-7f359a3118c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:14.840357 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef064d5-c98c-477f-a1f3-7f359a3118c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:14.840357 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef064d5-c98c-477f-a1f3-7f359a3118c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:14.841198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef064d5-c98c-477f-a1f3-7f359a3118c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:14.843942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef064d5-c98c-477f-a1f3-7f359a3118c7 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:14.877171 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1154/2307] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:57:14.878700 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d536f-5677-4073-98ff-a30e0a1b3317 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:14.894142 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d536f-5677-4073-98ff-a30e0a1b3317 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:14.930928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4de6f-22a9-4439-9090-4741898e3c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:14.932614 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4de6f-22a9-4439-9090-4741898e3c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:14.932614 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4de6f-22a9-4439-9090-4741898e3c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:14.932805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4de6f-22a9-4439-9090-4741898e3c8d admin admin] PATH_INFO: `/v3/projects/dd82c7f90f8c4d629f1981e7e182676e/users/439f4394c7414a75a06059afd9a5ba6d/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:14.935310 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:14.959531 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4de6f-22a9-4439-9090-4741898e3c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd82c7f90f8c4d629f1981e7e182676e, user_id=439f4394c7414a75a06059afd9a5ba6d, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:14.961938 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4de6f-22a9-4439-9090-4741898e3c8d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:14.985555 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1154/2308] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:57:14 2022] PUT /identity/v3/projects/dd82c7f90f8c4d629f1981e7e182676e/users/439f4394c7414a75a06059afd9a5ba6d/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:57:14.996421 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4847e-5b69-41c1-a1b3-9021e92958cf None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:14.996712 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4847e-5b69-41c1-a1b3-9021e92958cf None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:14.996992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4847e-5b69-41c1-a1b3-9021e92958cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:15.052078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-0fd4847e-5b69-41c1-a1b3-9021e92958cf None None] MFA Rules not processed for user `439f4394c7414a75a06059afd9a5ba6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:15.053446 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-0fd4847e-5b69-41c1-a1b3-9021e92958cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:15.180871 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1155/2309] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:15.191259 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4de6f-22a9-4439-9090-4741898e3c8d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:15.193556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3da4de6f-22a9-4439-9090-4741898e3c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:15.289841 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4de6f-22a9-4439-9090-4741898e3c8d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:15.293852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76004b-d5b5-4daf-891f-e9951795931b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:15.294714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76004b-d5b5-4daf-891f-e9951795931b service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:15.295146 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76004b-d5b5-4daf-891f-e9951795931b service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:15.295585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76004b-d5b5-4daf-891f-e9951795931b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:15.306687 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76004b-d5b5-4daf-891f-e9951795931b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:15.308722 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76004b-d5b5-4daf-891f-e9951795931b service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:15.320299 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1155/2310] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:16.464263 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323bfdb-0466-4713-8b07-351fd76910c2 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:16.464844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323bfdb-0466-4713-8b07-351fd76910c2 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:16.465207 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323bfdb-0466-4713-8b07-351fd76910c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:16.526124 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-4323bfdb-0466-4713-8b07-351fd76910c2 None None] MFA Rules not processed for user `b58d9d1ef4954e79ad98bd8abdc71dab`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:16.527612 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-4323bfdb-0466-4713-8b07-351fd76910c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:16.610550 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1156/2311] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:16.611821 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76004b-d5b5-4daf-891f-e9951795931b service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:16.613506 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9e76004b-d5b5-4daf-891f-e9951795931b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:16.700519 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76004b-d5b5-4daf-891f-e9951795931b service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:16.706149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a6b89-88d7-4b86-a982-968f52e082a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:16.706433 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a6b89-88d7-4b86-a982-968f52e082a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:16.706716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a6b89-88d7-4b86-a982-968f52e082a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:16.706996 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a6b89-88d7-4b86-a982-968f52e082a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:16.707668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a6b89-88d7-4b86-a982-968f52e082a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:16.709661 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a6b89-88d7-4b86-a982-968f52e082a0 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:16.740511 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1156/2312] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:57:16 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:57:16.744827 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323bfdb-0466-4713-8b07-351fd76910c2 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:16.761393 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323bfdb-0466-4713-8b07-351fd76910c2 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:16.830347 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:16.837914 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91471831-51a9-4fa0-95ce-5f0d0fb93c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:16.839522 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91471831-51a9-4fa0-95ce-5f0d0fb93c43 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:16.840161 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91471831-51a9-4fa0-95ce-5f0d0fb93c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:16.840565 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91471831-51a9-4fa0-95ce-5f0d0fb93c43 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:16.841337 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91471831-51a9-4fa0-95ce-5f0d0fb93c43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:16.843742 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91471831-51a9-4fa0-95ce-5f0d0fb93c43 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:16.871017 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1157/2313] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:57:16 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:57:16.882662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a6b89-88d7-4b86-a982-968f52e082a0 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:16.895121 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a6b89-88d7-4b86-a982-968f52e082a0 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:16.900637 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae5b96-a706-421a-be89-7defee112ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:16.902547 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae5b96-a706-421a-be89-7defee112ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:16.903108 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae5b96-a706-421a-be89-7defee112ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:16.903536 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae5b96-a706-421a-be89-7defee112ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:16.904844 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae5b96-a706-421a-be89-7defee112ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:16.906901 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae5b96-a706-421a-be89-7defee112ed3 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:16.920195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1157/2314] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:57:16.924391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91471831-51a9-4fa0-95ce-5f0d0fb93c43 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:16.949583 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91471831-51a9-4fa0-95ce-5f0d0fb93c43 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:16.955949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3a69e-6929-4d57-894a-6e6195f671e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:16.956916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3a69e-6929-4d57-894a-6e6195f671e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:16.957337 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3a69e-6929-4d57-894a-6e6195f671e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:16.957873 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3a69e-6929-4d57-894a-6e6195f671e0 admin admin] PATH_INFO: `/v3/projects/97c6a56a130a4c59954d2e6e0152aea5/users/b4237b16661b4e0f859c0fa7e8f46562/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:17.013501 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3a69e-6929-4d57-894a-6e6195f671e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c6a56a130a4c59954d2e6e0152aea5, user_id=b4237b16661b4e0f859c0fa7e8f46562, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:17.016876 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3a69e-6929-4d57-894a-6e6195f671e0 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:17.051469 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1158/2315] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:57:16 2022] PUT /identity/v3/projects/97c6a56a130a4c59954d2e6e0152aea5/users/b4237b16661b4e0f859c0fa7e8f46562/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:57:17.057903 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae5b96-a706-421a-be89-7defee112ed3 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:17.077435 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae5b96-a706-421a-be89-7defee112ed3 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:17.220944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd3746-b0ce-4b51-b524-08cebf5d2be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:17.222003 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd3746-b0ce-4b51-b524-08cebf5d2be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:17.222432 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd3746-b0ce-4b51-b524-08cebf5d2be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:17.223087 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd3746-b0ce-4b51-b524-08cebf5d2be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:17.224065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd3746-b0ce-4b51-b524-08cebf5d2be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:17.226058 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd3746-b0ce-4b51-b524-08cebf5d2be4 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:17.227905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:17.245617 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1158/2316] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:57:17.255141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3a69e-6929-4d57-894a-6e6195f671e0 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:17.281313 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3a69e-6929-4d57-894a-6e6195f671e0 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:17.295179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2d161-69f3-4faf-b90b-2ca996eb29f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:17.298198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2d161-69f3-4faf-b90b-2ca996eb29f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:17.298198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2d161-69f3-4faf-b90b-2ca996eb29f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:17.298198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2d161-69f3-4faf-b90b-2ca996eb29f4 admin admin] PATH_INFO: `/v3/projects/97c6a56a130a4c59954d2e6e0152aea5/users/b4237b16661b4e0f859c0fa7e8f46562/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:17.311216 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2d161-69f3-4faf-b90b-2ca996eb29f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c6a56a130a4c59954d2e6e0152aea5, user_id=b4237b16661b4e0f859c0fa7e8f46562, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:17.313943 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2d161-69f3-4faf-b90b-2ca996eb29f4 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:17.344144 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1159/2317] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:57:17 2022] PUT /identity/v3/projects/97c6a56a130a4c59954d2e6e0152aea5/users/b4237b16661b4e0f859c0fa7e8f46562/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:57:21.874281 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd3746-b0ce-4b51-b524-08cebf5d2be4 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:21.888955 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd3746-b0ce-4b51-b524-08cebf5d2be4 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:22.051955 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13360f65-bd66-4929-b8c4-8c29c4b612b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:22.052894 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13360f65-bd66-4929-b8c4-8c29c4b612b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:22.053546 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13360f65-bd66-4929-b8c4-8c29c4b612b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:22.054020 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13360f65-bd66-4929-b8c4-8c29c4b612b5 admin admin] PATH_INFO: `/v3/users/439f4394c7414a75a06059afd9a5ba6d` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:22.055842 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13360f65-bd66-4929-b8c4-8c29c4b612b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=439f4394c7414a75a06059afd9a5ba6d)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:22.058208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13360f65-bd66-4929-b8c4-8c29c4b612b5 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:22.144323 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-13360f65-bd66-4929-b8c4-8c29c4b612b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '439f4394c7414a75a06059afd9a5ba6d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:22.145854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-13360f65-bd66-4929-b8c4-8c29c4b612b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '439f4394c7414a75a06059afd9a5ba6d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:22.163756 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-13360f65-bd66-4929-b8c4-8c29c4b612b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '439f4394c7414a75a06059afd9a5ba6d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:22.181781 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-13360f65-bd66-4929-b8c4-8c29c4b612b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '439f4394c7414a75a06059afd9a5ba6d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:22.182915 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-13360f65-bd66-4929-b8c4-8c29c4b612b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '439f4394c7414a75a06059afd9a5ba6d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:22.205245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1159/2318] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:57:21 2022] DELETE /identity/v3/users/439f4394c7414a75a06059afd9a5ba6d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:57:22.207100 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc7ff3-de02-4834-ac38-974a705bcda2 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:22.207571 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc7ff3-de02-4834-ac38-974a705bcda2 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:22.207950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc7ff3-de02-4834-ac38-974a705bcda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:22.230778 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-88dc7ff3-de02-4834-ac38-974a705bcda2 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:22.232192 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-88dc7ff3-de02-4834-ac38-974a705bcda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:22.337119 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1160/2319] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:57:22.348370 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13360f65-bd66-4929-b8c4-8c29c4b612b5 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:22.349680 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-13360f65-bd66-4929-b8c4-8c29c4b612b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:22.418388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13360f65-bd66-4929-b8c4-8c29c4b612b5 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:22.422188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bdf83-3473-4494-8933-747ddf2ca012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:22.423114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bdf83-3473-4494-8933-747ddf2ca012 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:22.423306 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bdf83-3473-4494-8933-747ddf2ca012 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:22.423796 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bdf83-3473-4494-8933-747ddf2ca012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:22.435614 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0bdf83-3473-4494-8933-747ddf2ca012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:22.437254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0bdf83-3473-4494-8933-747ddf2ca012 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:22.448741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1160/2320] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:22.915446 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc7ff3-de02-4834-ac38-974a705bcda2 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:22.917335 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-88dc7ff3-de02-4834-ac38-974a705bcda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:22.939120 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc7ff3-de02-4834-ac38-974a705bcda2 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:22.955400 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487047e8-0f37-475a-8514-8fa5ce1fc4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:22.956911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487047e8-0f37-475a-8514-8fa5ce1fc4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:22.957222 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487047e8-0f37-475a-8514-8fa5ce1fc4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:22.957535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487047e8-0f37-475a-8514-8fa5ce1fc4f6 admin admin] PATH_INFO: `/v3/projects/dd82c7f90f8c4d629f1981e7e182676e` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:22.960861 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487047e8-0f37-475a-8514-8fa5ce1fc4f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd82c7f90f8c4d629f1981e7e182676e)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:22.963938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487047e8-0f37-475a-8514-8fa5ce1fc4f6 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:23.139392 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-487047e8-0f37-475a-8514-8fa5ce1fc4f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd82c7f90f8c4d629f1981e7e182676e', 'request_id': 'req-487047e8-0f37-475a-8514-8fa5ce1fc4f6'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:23.166741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-487047e8-0f37-475a-8514-8fa5ce1fc4f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd82c7f90f8c4d629f1981e7e182676e', 'request_id': 'req-487047e8-0f37-475a-8514-8fa5ce1fc4f6'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:23.176010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-487047e8-0f37-475a-8514-8fa5ce1fc4f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd82c7f90f8c4d629f1981e7e182676e', 'request_id': 'req-487047e8-0f37-475a-8514-8fa5ce1fc4f6'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:23.190834 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-487047e8-0f37-475a-8514-8fa5ce1fc4f6 admin admin] The token cache is being invalidate because project dd82c7f90f8c4d629f1981e7e182676e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:57:23.192147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-487047e8-0f37-475a-8514-8fa5ce1fc4f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:23.193244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-487047e8-0f37-475a-8514-8fa5ce1fc4f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:23.195533 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1161/2321] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:57:22 2022] DELETE /identity/v3/projects/dd82c7f90f8c4d629f1981e7e182676e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:57:23.200515 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c60c95-e788-4c3c-8f1b-7ac0de9246e4 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:23.201588 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c60c95-e788-4c3c-8f1b-7ac0de9246e4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:23.202145 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c60c95-e788-4c3c-8f1b-7ac0de9246e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:23.224681 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f0c60c95-e788-4c3c-8f1b-7ac0de9246e4 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:23.226374 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f0c60c95-e788-4c3c-8f1b-7ac0de9246e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:23.242035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:23.373834 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1161/2322] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:23.384787 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5b51a-e8ae-49cd-94db-f733f5939934 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:23.385356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5b51a-e8ae-49cd-94db-f733f5939934 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:23.385455 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5b51a-e8ae-49cd-94db-f733f5939934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:23.433555 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-51b5b51a-e8ae-49cd-94db-f733f5939934 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:23.442740 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-51b5b51a-e8ae-49cd-94db-f733f5939934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:23.476320 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1162/2323] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:23.477619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c60c95-e788-4c3c-8f1b-7ac0de9246e4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:23.490718 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c60c95-e788-4c3c-8f1b-7ac0de9246e4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:23.502691 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea7a39-3332-474c-9827-0a10788821b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:23.503411 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea7a39-3332-474c-9827-0a10788821b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:23.503693 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea7a39-3332-474c-9827-0a10788821b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:23.503967 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea7a39-3332-474c-9827-0a10788821b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:23.509522 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea7a39-3332-474c-9827-0a10788821b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:57:23.510045 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea7a39-3332-474c-9827-0a10788821b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:23.511910 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea7a39-3332-474c-9827-0a10788821b8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:23.546221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1162/2324] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:57:23.547696 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5b51a-e8ae-49cd-94db-f733f5939934 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:23.562688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5b51a-e8ae-49cd-94db-f733f5939934 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:23.568092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1cfb6-39a4-4b52-87db-365c149cab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:23.568774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1cfb6-39a4-4b52-87db-365c149cab66 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:23.569074 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1cfb6-39a4-4b52-87db-365c149cab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:23.569346 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1cfb6-39a4-4b52-87db-365c149cab66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:23.570032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1cfb6-39a4-4b52-87db-365c149cab66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:23.572253 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1cfb6-39a4-4b52-87db-365c149cab66 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:23.637325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1163/2325] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:57:23 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:57:23.642096 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea7a39-3332-474c-9827-0a10788821b8 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:23.663989 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea7a39-3332-474c-9827-0a10788821b8 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:23.759915 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fc536-7871-4e7c-be84-56b20c089fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:23.760660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fc536-7871-4e7c-be84-56b20c089fcf admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:23.761193 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fc536-7871-4e7c-be84-56b20c089fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:23.761473 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fc536-7871-4e7c-be84-56b20c089fcf admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:23.762239 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5fc536-7871-4e7c-be84-56b20c089fcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:23.764870 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5fc536-7871-4e7c-be84-56b20c089fcf admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:23.802508 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1cfb6-39a4-4b52-87db-365c149cab66 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:23.803788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1163/2326] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:57:23 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:57:23.808625 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:23.815135 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1cfb6-39a4-4b52-87db-365c149cab66 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:23.822267 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c2ed1-294b-4e69-934a-4236bc13b49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:23.823063 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c2ed1-294b-4e69-934a-4236bc13b49d admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:23.823446 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c2ed1-294b-4e69-934a-4236bc13b49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:23.823914 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c2ed1-294b-4e69-934a-4236bc13b49d admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:23.825640 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c2ed1-294b-4e69-934a-4236bc13b49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:23.827747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c2ed1-294b-4e69-934a-4236bc13b49d admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:23.840035 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1164/2327] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:57:23.848981 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fc536-7871-4e7c-be84-56b20c089fcf admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:23.866059 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fc536-7871-4e7c-be84-56b20c089fcf admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:23.874744 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99127cc0-0392-4b47-91df-d8249c17aff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:23.875530 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99127cc0-0392-4b47-91df-d8249c17aff8 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:23.875818 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99127cc0-0392-4b47-91df-d8249c17aff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:23.876399 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99127cc0-0392-4b47-91df-d8249c17aff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:23.877387 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99127cc0-0392-4b47-91df-d8249c17aff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:23.880537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99127cc0-0392-4b47-91df-d8249c17aff8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:23.902535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c2ed1-294b-4e69-934a-4236bc13b49d admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:23.903064 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1164/2328] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:57:23.924033 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c2ed1-294b-4e69-934a-4236bc13b49d admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:23.934791 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4613c-4bc0-42b1-9c04-c56c5794bfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:23.935834 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4613c-4bc0-42b1-9c04-c56c5794bfa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:23.936123 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4613c-4bc0-42b1-9c04-c56c5794bfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:23.936396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4613c-4bc0-42b1-9c04-c56c5794bfa2 admin admin] PATH_INFO: `/v3/projects/259dac948047422bbf513cbf2d32518f/users/8576e847159e4fae8d36e2b5fb0ba6dc/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:23.956368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4613c-4bc0-42b1-9c04-c56c5794bfa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=259dac948047422bbf513cbf2d32518f, user_id=8576e847159e4fae8d36e2b5fb0ba6dc, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:23.960714 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4613c-4bc0-42b1-9c04-c56c5794bfa2 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:23.988309 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1165/2329] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:57:23 2022] PUT /identity/v3/projects/259dac948047422bbf513cbf2d32518f/users/8576e847159e4fae8d36e2b5fb0ba6dc/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:57:23.999910 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76c3b8-9eec-4251-8936-f72a8daad803 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:24.000963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76c3b8-9eec-4251-8936-f72a8daad803 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:24.001383 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76c3b8-9eec-4251-8936-f72a8daad803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:24.045788 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-9f76c3b8-9eec-4251-8936-f72a8daad803 None None] MFA Rules not processed for user `8576e847159e4fae8d36e2b5fb0ba6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:24.047487 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9f76c3b8-9eec-4251-8936-f72a8daad803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:24.138856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1165/2330] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:24.168078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4613c-4bc0-42b1-9c04-c56c5794bfa2 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:24.171194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-2cd4613c-4bc0-42b1-9c04-c56c5794bfa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:24.239002 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4613c-4bc0-42b1-9c04-c56c5794bfa2 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:24.243837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266261ee-b4d4-47a6-9fdc-6b28b82fe0a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:24.244820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266261ee-b4d4-47a6-9fdc-6b28b82fe0a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:24.245281 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266261ee-b4d4-47a6-9fdc-6b28b82fe0a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:24.246013 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266261ee-b4d4-47a6-9fdc-6b28b82fe0a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:24.255653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266261ee-b4d4-47a6-9fdc-6b28b82fe0a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:24.257119 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266261ee-b4d4-47a6-9fdc-6b28b82fe0a0 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:24.267440 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1166/2331] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:57:24.869371 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f444a08-8345-40ef-b46d-673ef4911a2c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:24.869967 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f444a08-8345-40ef-b46d-673ef4911a2c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:24.869967 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f444a08-8345-40ef-b46d-673ef4911a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:24.921919 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:24.926025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-1f444a08-8345-40ef-b46d-673ef4911a2c None None] MFA Rules not processed for user `b4237b16661b4e0f859c0fa7e8f46562`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:24.932460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1f444a08-8345-40ef-b46d-673ef4911a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:25.052525 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1166/2332] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:25.137777 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266261ee-b4d4-47a6-9fdc-6b28b82fe0a0 service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:25.139628 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-266261ee-b4d4-47a6-9fdc-6b28b82fe0a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:25.273408 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266261ee-b4d4-47a6-9fdc-6b28b82fe0a0 service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:25.280234 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b3af6-15ae-45c7-8844-cd26136521bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:25.281329 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b3af6-15ae-45c7-8844-cd26136521bd service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:25.281619 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b3af6-15ae-45c7-8844-cd26136521bd service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:25.282174 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b3af6-15ae-45c7-8844-cd26136521bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:25.284850 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b99b3af6-15ae-45c7-8844-cd26136521bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:25.383378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b3af6-15ae-45c7-8844-cd26136521bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:25.385134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b3af6-15ae-45c7-8844-cd26136521bd service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:25.398382 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1167/2333] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:26.915920 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec7383-a959-4d19-b7ec-9095184dec53 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:26.916382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec7383-a959-4d19-b7ec-9095184dec53 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:26.916472 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec7383-a959-4d19-b7ec-9095184dec53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:26.942331 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-17ec7383-a959-4d19-b7ec-9095184dec53 None None] MFA Rules not processed for user `b58d9d1ef4954e79ad98bd8abdc71dab`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:26.943750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-17ec7383-a959-4d19-b7ec-9095184dec53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:26.951683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1167/2334] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:27.175182 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b3af6-15ae-45c7-8844-cd26136521bd service nova] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:27.187513 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:27.293033 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b3af6-15ae-45c7-8844-cd26136521bd service nova] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:27.304866 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca21fe-f07f-4f8b-97db-3f10e2cdadc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:27.305729 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca21fe-f07f-4f8b-97db-3f10e2cdadc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:27.306215 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca21fe-f07f-4f8b-97db-3f10e2cdadc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:27.306570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca21fe-f07f-4f8b-97db-3f10e2cdadc3 admin admin] PATH_INFO: `/v3/users/8576e847159e4fae8d36e2b5fb0ba6dc` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:27.307985 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca21fe-f07f-4f8b-97db-3f10e2cdadc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8576e847159e4fae8d36e2b5fb0ba6dc)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:27.310241 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca21fe-f07f-4f8b-97db-3f10e2cdadc3 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:27.367608 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-6cca21fe-f07f-4f8b-97db-3f10e2cdadc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8576e847159e4fae8d36e2b5fb0ba6dc'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:27.380745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-6cca21fe-f07f-4f8b-97db-3f10e2cdadc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8576e847159e4fae8d36e2b5fb0ba6dc'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:27.387886 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-6cca21fe-f07f-4f8b-97db-3f10e2cdadc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8576e847159e4fae8d36e2b5fb0ba6dc'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:27.395867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-6cca21fe-f07f-4f8b-97db-3f10e2cdadc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8576e847159e4fae8d36e2b5fb0ba6dc'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:27.396605 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-6cca21fe-f07f-4f8b-97db-3f10e2cdadc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8576e847159e4fae8d36e2b5fb0ba6dc'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:27.408890 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c0113-da31-4fbc-a2ee-269d7334e2e7 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:27.409468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c0113-da31-4fbc-a2ee-269d7334e2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:27.409808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c0113-da31-4fbc-a2ee-269d7334e2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:27.413018 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1168/2335] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:57:27 2022] DELETE /identity/v3/users/8576e847159e4fae8d36e2b5fb0ba6dc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:57:27.436482 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-573c0113-da31-4fbc-a2ee-269d7334e2e7 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:27.438281 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-573c0113-da31-4fbc-a2ee-269d7334e2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:27.516572 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1168/2336] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:27.527996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca21fe-f07f-4f8b-97db-3f10e2cdadc3 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:27.530101 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6cca21fe-f07f-4f8b-97db-3f10e2cdadc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:27.658640 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca21fe-f07f-4f8b-97db-3f10e2cdadc3 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:27.662510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608b088-40db-485b-973d-6e7be9e9cf4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:27.663278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608b088-40db-485b-973d-6e7be9e9cf4a service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:27.664286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608b088-40db-485b-973d-6e7be9e9cf4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:27.664286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608b088-40db-485b-973d-6e7be9e9cf4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:27.682969 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608b088-40db-485b-973d-6e7be9e9cf4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:27.684660 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608b088-40db-485b-973d-6e7be9e9cf4a service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:27.696309 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1169/2337] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:28.147178 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c0113-da31-4fbc-a2ee-269d7334e2e7 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:28.148787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-573c0113-da31-4fbc-a2ee-269d7334e2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:28.190290 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c0113-da31-4fbc-a2ee-269d7334e2e7 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:28.197658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66529ba-61dc-4dd7-9457-d96e155a8c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:28.198396 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66529ba-61dc-4dd7-9457-d96e155a8c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:28.198766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66529ba-61dc-4dd7-9457-d96e155a8c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:28.199082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66529ba-61dc-4dd7-9457-d96e155a8c53 admin admin] PATH_INFO: `/v3/projects/259dac948047422bbf513cbf2d32518f` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:28.200408 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66529ba-61dc-4dd7-9457-d96e155a8c53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=259dac948047422bbf513cbf2d32518f)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:28.202449 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66529ba-61dc-4dd7-9457-d96e155a8c53 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:28.273410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b66529ba-61dc-4dd7-9457-d96e155a8c53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '259dac948047422bbf513cbf2d32518f', 'request_id': 'req-b66529ba-61dc-4dd7-9457-d96e155a8c53'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:28.283476 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b66529ba-61dc-4dd7-9457-d96e155a8c53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '259dac948047422bbf513cbf2d32518f', 'request_id': 'req-b66529ba-61dc-4dd7-9457-d96e155a8c53'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:28.298558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b66529ba-61dc-4dd7-9457-d96e155a8c53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '259dac948047422bbf513cbf2d32518f', 'request_id': 'req-b66529ba-61dc-4dd7-9457-d96e155a8c53'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:28.315589 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b66529ba-61dc-4dd7-9457-d96e155a8c53 admin admin] The token cache is being invalidate because project 259dac948047422bbf513cbf2d32518f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:57:28.316001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b66529ba-61dc-4dd7-9457-d96e155a8c53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:28.316671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b66529ba-61dc-4dd7-9457-d96e155a8c53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:28.318218 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1169/2338] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:57:28 2022] DELETE /identity/v3/projects/259dac948047422bbf513cbf2d32518f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:57:28.323267 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0245247-92f2-4ad0-8db0-03c5ed095124 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:28.323758 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0245247-92f2-4ad0-8db0-03c5ed095124 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:28.323873 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0245247-92f2-4ad0-8db0-03c5ed095124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:28.347365 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-a0245247-92f2-4ad0-8db0-03c5ed095124 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:28.348582 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-a0245247-92f2-4ad0-8db0-03c5ed095124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:28.380156 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:28.433403 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1170/2339] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:28.441678 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fb1d1-108d-40aa-9590-5706767b36a0 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:28.442079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fb1d1-108d-40aa-9590-5706767b36a0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:28.442356 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fb1d1-108d-40aa-9590-5706767b36a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:28.466646 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e73fb1d1-108d-40aa-9590-5706767b36a0 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:28.467900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e73fb1d1-108d-40aa-9590-5706767b36a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:28.476255 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1170/2340] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:28.482715 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0245247-92f2-4ad0-8db0-03c5ed095124 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:28.499319 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0245247-92f2-4ad0-8db0-03c5ed095124 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:28.504554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdced3-318b-455e-ae14-7aa5ff01ad1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:28.505381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdced3-318b-455e-ae14-7aa5ff01ad1f admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:28.505659 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdced3-318b-455e-ae14-7aa5ff01ad1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:28.505980 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdced3-318b-455e-ae14-7aa5ff01ad1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:28.506865 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdced3-318b-455e-ae14-7aa5ff01ad1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:57:28.507307 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdced3-318b-455e-ae14-7aa5ff01ad1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:28.509303 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdced3-318b-455e-ae14-7aa5ff01ad1f admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:28.521802 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1171/2341] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:57:28.526159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fb1d1-108d-40aa-9590-5706767b36a0 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:28.535302 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fb1d1-108d-40aa-9590-5706767b36a0 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:28.540229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f727cc-7f18-45d7-8658-a3c23a618148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:28.540838 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f727cc-7f18-45d7-8658-a3c23a618148 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:28.541155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f727cc-7f18-45d7-8658-a3c23a618148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:28.541443 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f727cc-7f18-45d7-8658-a3c23a618148 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:28.542175 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f727cc-7f18-45d7-8658-a3c23a618148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:28.544359 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f727cc-7f18-45d7-8658-a3c23a618148 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:28.555180 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:28.580191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1171/2342] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:57:28 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:57:28.580990 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdced3-318b-455e-ae14-7aa5ff01ad1f admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:28.592731 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdced3-318b-455e-ae14-7aa5ff01ad1f admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:28.660837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc09df-df68-4b1f-9792-74875f081aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:28.661531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc09df-df68-4b1f-9792-74875f081aeb admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:28.661808 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc09df-df68-4b1f-9792-74875f081aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:28.662074 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc09df-df68-4b1f-9792-74875f081aeb admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:28.662741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc09df-df68-4b1f-9792-74875f081aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:28.664880 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc09df-df68-4b1f-9792-74875f081aeb admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:28.690139 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1172/2343] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:57:28 2022] POST /identity/v3/users => generated 285 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:57:28.695194 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f727cc-7f18-45d7-8658-a3c23a618148 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:28.708233 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f727cc-7f18-45d7-8658-a3c23a618148 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:28.722458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f58bf8-1740-4c1e-a19a-ac171bbe230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:28.722458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f58bf8-1740-4c1e-a19a-ac171bbe230f admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:28.722458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f58bf8-1740-4c1e-a19a-ac171bbe230f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:28.722458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f58bf8-1740-4c1e-a19a-ac171bbe230f admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:28.722969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f58bf8-1740-4c1e-a19a-ac171bbe230f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:28.724552 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f58bf8-1740-4c1e-a19a-ac171bbe230f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:28.735373 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1172/2344] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:57:28.739404 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc09df-df68-4b1f-9792-74875f081aeb admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:28.750406 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc09df-df68-4b1f-9792-74875f081aeb admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:28.756227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910094f-8e6f-4be7-9100-358f1a211a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:28.756916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910094f-8e6f-4be7-9100-358f1a211a31 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:28.757336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910094f-8e6f-4be7-9100-358f1a211a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:28.757730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910094f-8e6f-4be7-9100-358f1a211a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:28.758499 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910094f-8e6f-4be7-9100-358f1a211a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:28.762720 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910094f-8e6f-4be7-9100-358f1a211a31 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:28.773530 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1173/2345] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:57:28.777954 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f58bf8-1740-4c1e-a19a-ac171bbe230f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:28.789380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f58bf8-1740-4c1e-a19a-ac171bbe230f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:28.796818 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fe374-e26b-4997-873f-2c998dbfcec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:28.797711 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fe374-e26b-4997-873f-2c998dbfcec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:28.798111 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fe374-e26b-4997-873f-2c998dbfcec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:28.798545 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fe374-e26b-4997-873f-2c998dbfcec8 admin admin] PATH_INFO: `/v3/projects/b1e41eff47774386b2f2542cf6e6e0d8/users/0087cd08b620451c84c86b433b8ea251/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:28.817179 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fe374-e26b-4997-873f-2c998dbfcec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1e41eff47774386b2f2542cf6e6e0d8, user_id=0087cd08b620451c84c86b433b8ea251, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:28.820000 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fe374-e26b-4997-873f-2c998dbfcec8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:28.841966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1173/2346] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:57:28 2022] PUT /identity/v3/projects/b1e41eff47774386b2f2542cf6e6e0d8/users/0087cd08b620451c84c86b433b8ea251/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:57:28.854100 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8a680-fb24-4bfd-acb5-5faa05088690 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:28.854387 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8a680-fb24-4bfd-acb5-5faa05088690 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:28.854655 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8a680-fb24-4bfd-acb5-5faa05088690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:28.889832 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-dcd8a680-fb24-4bfd-acb5-5faa05088690 None None] MFA Rules not processed for user `0087cd08b620451c84c86b433b8ea251`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:28.891250 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-dcd8a680-fb24-4bfd-acb5-5faa05088690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:28.972623 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1174/2347] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:36.730474 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9cef7-8505-4b0d-8525-8fe7282c6531 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:36.731048 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9cef7-8505-4b0d-8525-8fe7282c6531 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:36.731048 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9cef7-8505-4b0d-8525-8fe7282c6531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:36.751958 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f8c9cef7-8505-4b0d-8525-8fe7282c6531 None None] MFA Rules not processed for user `6f0d7343fee749b89293973a422c22a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:36.753220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f8c9cef7-8505-4b0d-8525-8fe7282c6531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:36.820545 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1174/2348] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:38.969091 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=86,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:45.178862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8a680-fb24-4bfd-acb5-5faa05088690 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:45.181261 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-dcd8a680-fb24-4bfd-acb5-5faa05088690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:45.245857 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8a680-fb24-4bfd-acb5-5faa05088690 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:45.249595 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e2d34-2462-4f13-980c-58baefd32de3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98465c2d73e540b5bf506f5a7423e035', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:45.250217 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e2d34-2462-4f13-980c-58baefd32de3 service glance] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:45.250688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e2d34-2462-4f13-980c-58baefd32de3 service glance] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:45.251312 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e2d34-2462-4f13-980c-58baefd32de3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:45.260602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e2d34-2462-4f13-980c-58baefd32de3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:45.262107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e2d34-2462-4f13-980c-58baefd32de3 service glance] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:45.272366 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1175/2349] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:45 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:45.521301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9facc-2b33-449c-8410-6e8e62839bdf None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:45.521808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9facc-2b33-449c-8410-6e8e62839bdf None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:45.521894 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9facc-2b33-449c-8410-6e8e62839bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:45.542463 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a3b9facc-2b33-449c-8410-6e8e62839bdf None None] MFA Rules not processed for user `a1936a2649c349d481f56304b3ee55b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:45.543724 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a3b9facc-2b33-449c-8410-6e8e62839bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:45.605416 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1175/2350] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Jul 28 17:57:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:45.655747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e2d34-2462-4f13-980c-58baefd32de3 service glance] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:45.658160 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-755e2d34-2462-4f13-980c-58baefd32de3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:45.740669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e2d34-2462-4f13-980c-58baefd32de3 service glance] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:45.747893 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5606e9-15d1-425c-a6ab-8930d451b3bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ea1a9023eaf427f96f86af909a803fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:45.748523 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5606e9-15d1-425c-a6ab-8930d451b3bc service swift] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:45.748797 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5606e9-15d1-425c-a6ab-8930d451b3bc service swift] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:45.749101 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5606e9-15d1-425c-a6ab-8930d451b3bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:45.759878 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5606e9-15d1-425c-a6ab-8930d451b3bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:45.762011 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5606e9-15d1-425c-a6ab-8930d451b3bc service swift] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:45.776320 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1176/2351] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Jul 28 17:57:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 17:57:46.500039 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d1a4f-7b61-434a-baf7-80d1cc6140d0 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:46.500378 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d1a4f-7b61-434a-baf7-80d1cc6140d0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:46.500772 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d1a4f-7b61-434a-baf7-80d1cc6140d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:46.522009 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-164d1a4f-7b61-434a-baf7-80d1cc6140d0 None None] MFA Rules not processed for user `a1936a2649c349d481f56304b3ee55b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:46.524097 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-164d1a4f-7b61-434a-baf7-80d1cc6140d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:46.546348 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1176/2352] 10.222.0.96 () {58 vars in 967 bytes} [Thu Jul 28 17:57:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:46.559994 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5606e9-15d1-425c-a6ab-8930d451b3bc service swift] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:46.571490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5606e9-15d1-425c-a6ab-8930d451b3bc service swift] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:46.583237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083c8f8-18f9-4c28-a1d9-e57603c59981 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ea1a9023eaf427f96f86af909a803fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:46.583943 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083c8f8-18f9-4c28-a1d9-e57603c59981 service swift] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:46.584421 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083c8f8-18f9-4c28-a1d9-e57603c59981 service swift] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:46.584630 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083c8f8-18f9-4c28-a1d9-e57603c59981 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:46.599444 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083c8f8-18f9-4c28-a1d9-e57603c59981 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:46.601202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083c8f8-18f9-4c28-a1d9-e57603c59981 service swift] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:46.611156 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1177/2353] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Jul 28 17:57:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 17:57:46.897514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3478f0-5d73-4e74-beb2-29ebd2701dd4 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:46.897805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3478f0-5d73-4e74-beb2-29ebd2701dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:46.898086 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3478f0-5d73-4e74-beb2-29ebd2701dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:46.917802 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-ed3478f0-5d73-4e74-beb2-29ebd2701dd4 None None] MFA Rules not processed for user `a1936a2649c349d481f56304b3ee55b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:46.919036 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ed3478f0-5d73-4e74-beb2-29ebd2701dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:46.927787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1177/2354] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Jul 28 17:57:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:46.939744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083c8f8-18f9-4c28-a1d9-e57603c59981 service swift] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:46.950562 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083c8f8-18f9-4c28-a1d9-e57603c59981 service swift] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:46.957480 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d6ee2-ac79-48d3-b868-413249d22e29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ea1a9023eaf427f96f86af909a803fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:46.958131 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d6ee2-ac79-48d3-b868-413249d22e29 service swift] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:46.958410 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d6ee2-ac79-48d3-b868-413249d22e29 service swift] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:46.958681 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d6ee2-ac79-48d3-b868-413249d22e29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:46.967960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d6ee2-ac79-48d3-b868-413249d22e29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:46.969946 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d6ee2-ac79-48d3-b868-413249d22e29 service swift] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:46.981532 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1178/2355] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Jul 28 17:57:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 17:57:47.189475 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598b069-6e67-43d6-8cd4-39f9576f5aa1 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:47.189765 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598b069-6e67-43d6-8cd4-39f9576f5aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:47.190041 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598b069-6e67-43d6-8cd4-39f9576f5aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:47.211673 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b598b069-6e67-43d6-8cd4-39f9576f5aa1 None None] MFA Rules not processed for user `a1936a2649c349d481f56304b3ee55b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:47.212991 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b598b069-6e67-43d6-8cd4-39f9576f5aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:47.220656 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1178/2356] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Jul 28 17:57:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:57:47.233344 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d6ee2-ac79-48d3-b868-413249d22e29 service swift] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:47.244490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d6ee2-ac79-48d3-b868-413249d22e29 service swift] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:47.256613 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a3e75-2e09-4ce6-a3b1-d596fe09ed5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ea1a9023eaf427f96f86af909a803fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:47.258013 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a3e75-2e09-4ce6-a3b1-d596fe09ed5e service swift] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:47.258426 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a3e75-2e09-4ce6-a3b1-d596fe09ed5e service swift] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:47.258792 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a3e75-2e09-4ce6-a3b1-d596fe09ed5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:47.271723 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a3e75-2e09-4ce6-a3b1-d596fe09ed5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:47.273532 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a3e75-2e09-4ce6-a3b1-d596fe09ed5e service swift] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:47.283733 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1179/2357] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Jul 28 17:57:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 17:57:47.734986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e2302-9962-4872-8ea5-d0d7bb7cbf37 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:47.735968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e2302-9962-4872-8ea5-d0d7bb7cbf37 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:47.736506 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e2302-9962-4872-8ea5-d0d7bb7cbf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:47.763170 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c70e2302-9962-4872-8ea5-d0d7bb7cbf37 None None] MFA Rules not processed for user `a1936a2649c349d481f56304b3ee55b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:47.764529 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c70e2302-9962-4872-8ea5-d0d7bb7cbf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:47.773325 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1179/2358] 10.222.0.96 () {58 vars in 967 bytes} [Thu Jul 28 17:57:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:47.794966 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a3e75-2e09-4ce6-a3b1-d596fe09ed5e service swift] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:47.815423 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a3e75-2e09-4ce6-a3b1-d596fe09ed5e service swift] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:47.820990 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b0b58-1d3c-4054-8d42-80f1e5415a2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ea1a9023eaf427f96f86af909a803fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:47.821657 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b0b58-1d3c-4054-8d42-80f1e5415a2d service swift] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:47.822061 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b0b58-1d3c-4054-8d42-80f1e5415a2d service swift] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:47.822335 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b0b58-1d3c-4054-8d42-80f1e5415a2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:47.831473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b0b58-1d3c-4054-8d42-80f1e5415a2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:47.833723 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b0b58-1d3c-4054-8d42-80f1e5415a2d service swift] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:47.844338 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1180/2359] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Jul 28 17:57:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 17:57:50.496293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e2302-9962-4872-8ea5-d0d7bb7cbf37 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:50.498397 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c70e2302-9962-4872-8ea5-d0d7bb7cbf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:50.588120 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:50.639440 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e2302-9962-4872-8ea5-d0d7bb7cbf37 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:50.652148 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e33de-ec03-46ac-8e01-f4cce5db2628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:50.653240 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e33de-ec03-46ac-8e01-f4cce5db2628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:50.653763 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e33de-ec03-46ac-8e01-f4cce5db2628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:50.654043 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e33de-ec03-46ac-8e01-f4cce5db2628 admin admin] PATH_INFO: `/v3/users/3833d41f95df4e059afe2fb30c30629f` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:50.655468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e33de-ec03-46ac-8e01-f4cce5db2628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3833d41f95df4e059afe2fb30c30629f)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:50.658591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e33de-ec03-46ac-8e01-f4cce5db2628 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:50.722831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-981e33de-ec03-46ac-8e01-f4cce5db2628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3833d41f95df4e059afe2fb30c30629f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:50.723626 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-981e33de-ec03-46ac-8e01-f4cce5db2628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3833d41f95df4e059afe2fb30c30629f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:50.732522 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-981e33de-ec03-46ac-8e01-f4cce5db2628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3833d41f95df4e059afe2fb30c30629f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:50.748119 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-981e33de-ec03-46ac-8e01-f4cce5db2628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3833d41f95df4e059afe2fb30c30629f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:50.748877 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-981e33de-ec03-46ac-8e01-f4cce5db2628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3833d41f95df4e059afe2fb30c30629f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:50.767298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1180/2360] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:57:50 2022] DELETE /identity/v3/users/3833d41f95df4e059afe2fb30c30629f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:57:50.771934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13710ae0-44a5-4371-9d3b-9ee819395d3b None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:50.772544 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13710ae0-44a5-4371-9d3b-9ee819395d3b None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:50.772802 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13710ae0-44a5-4371-9d3b-9ee819395d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:50.795184 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-13710ae0-44a5-4371-9d3b-9ee819395d3b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:50.796538 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-13710ae0-44a5-4371-9d3b-9ee819395d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:50.832761 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:50.859409 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1181/2361] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:57:50.871492 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e33de-ec03-46ac-8e01-f4cce5db2628 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:50.873134 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-981e33de-ec03-46ac-8e01-f4cce5db2628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:50.954836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e33de-ec03-46ac-8e01-f4cce5db2628 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:50.958840 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733c4be-e3dd-4b36-a99d-92d73eff46a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:50.959489 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733c4be-e3dd-4b36-a99d-92d73eff46a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:50.959776 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733c4be-e3dd-4b36-a99d-92d73eff46a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:50.960053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733c4be-e3dd-4b36-a99d-92d73eff46a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:50.972597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733c4be-e3dd-4b36-a99d-92d73eff46a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:50.974724 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733c4be-e3dd-4b36-a99d-92d73eff46a0 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:50.985924 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1181/2362] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:51.175919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13710ae0-44a5-4371-9d3b-9ee819395d3b None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:51.177771 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-13710ae0-44a5-4371-9d3b-9ee819395d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:51.192514 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13710ae0-44a5-4371-9d3b-9ee819395d3b None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:51.198731 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58915f2-fef2-4b97-8ed5-53137d4e78d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:51.199680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58915f2-fef2-4b97-8ed5-53137d4e78d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:51.200034 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58915f2-fef2-4b97-8ed5-53137d4e78d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:51.200363 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58915f2-fef2-4b97-8ed5-53137d4e78d6 admin admin] PATH_INFO: `/v3/projects/444e8687e2234a4db01822379b74eda8` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:51.201924 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58915f2-fef2-4b97-8ed5-53137d4e78d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=444e8687e2234a4db01822379b74eda8)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:51.205121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58915f2-fef2-4b97-8ed5-53137d4e78d6 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:51.264348 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a58915f2-fef2-4b97-8ed5-53137d4e78d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '444e8687e2234a4db01822379b74eda8', 'request_id': 'req-a58915f2-fef2-4b97-8ed5-53137d4e78d6'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:51.274126 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a58915f2-fef2-4b97-8ed5-53137d4e78d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '444e8687e2234a4db01822379b74eda8', 'request_id': 'req-a58915f2-fef2-4b97-8ed5-53137d4e78d6'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:51.281825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a58915f2-fef2-4b97-8ed5-53137d4e78d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '444e8687e2234a4db01822379b74eda8', 'request_id': 'req-a58915f2-fef2-4b97-8ed5-53137d4e78d6'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:51.295247 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a58915f2-fef2-4b97-8ed5-53137d4e78d6 admin admin] The token cache is being invalidate because project 444e8687e2234a4db01822379b74eda8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:57:51.295807 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a58915f2-fef2-4b97-8ed5-53137d4e78d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:51.296993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a58915f2-fef2-4b97-8ed5-53137d4e78d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:51.299150 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1182/2363] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:57:51 2022] DELETE /identity/v3/projects/444e8687e2234a4db01822379b74eda8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:57:51.306587 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170abbfb-8032-4f7a-8955-b643f8f972e6 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:51.307122 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170abbfb-8032-4f7a-8955-b643f8f972e6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:51.307486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170abbfb-8032-4f7a-8955-b643f8f972e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:51.350951 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-170abbfb-8032-4f7a-8955-b643f8f972e6 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:51.352737 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-170abbfb-8032-4f7a-8955-b643f8f972e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:51.431715 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:51.444207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1182/2364] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:51.452276 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd623d-f949-47ab-be6f-0c9c1419c3fb None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:51.452558 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd623d-f949-47ab-be6f-0c9c1419c3fb None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:51.452831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd623d-f949-47ab-be6f-0c9c1419c3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:51.473931 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-06bd623d-f949-47ab-be6f-0c9c1419c3fb None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:51.475182 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-06bd623d-f949-47ab-be6f-0c9c1419c3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:51.485132 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1183/2365] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:51.488488 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170abbfb-8032-4f7a-8955-b643f8f972e6 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:51.499012 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170abbfb-8032-4f7a-8955-b643f8f972e6 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:51.505053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601ea02-0008-42a0-ab9c-fb469b9b0a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:51.505717 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601ea02-0008-42a0-ab9c-fb469b9b0a6b admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:51.506000 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601ea02-0008-42a0-ab9c-fb469b9b0a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:51.506274 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601ea02-0008-42a0-ab9c-fb469b9b0a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:51.506984 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601ea02-0008-42a0-ab9c-fb469b9b0a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:57:51.507293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601ea02-0008-42a0-ab9c-fb469b9b0a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:51.509092 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601ea02-0008-42a0-ab9c-fb469b9b0a6b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:51.525183 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1183/2366] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:57:51.527096 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd623d-f949-47ab-be6f-0c9c1419c3fb None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:51.537039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd623d-f949-47ab-be6f-0c9c1419c3fb None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:51.542410 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96660184-3ab9-42f3-ac96-96e9115c12e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:51.543046 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96660184-3ab9-42f3-ac96-96e9115c12e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:51.543328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96660184-3ab9-42f3-ac96-96e9115c12e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:51.543603 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96660184-3ab9-42f3-ac96-96e9115c12e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:51.544337 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96660184-3ab9-42f3-ac96-96e9115c12e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:51.546368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96660184-3ab9-42f3-ac96-96e9115c12e1 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:51.578373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1184/2367] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:57:51 2022] POST /identity/v3/projects => generated 397 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:57:51.583471 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601ea02-0008-42a0-ab9c-fb469b9b0a6b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:51.594043 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601ea02-0008-42a0-ab9c-fb469b9b0a6b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:51.712538 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bed5f4-2183-41d2-9f38-bb4b05dfb3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:51.713673 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bed5f4-2183-41d2-9f38-bb4b05dfb3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:51.713962 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bed5f4-2183-41d2-9f38-bb4b05dfb3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:51.715006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bed5f4-2183-41d2-9f38-bb4b05dfb3c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:51.715700 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bed5f4-2183-41d2-9f38-bb4b05dfb3c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:51.719406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bed5f4-2183-41d2-9f38-bb4b05dfb3c3 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:51.792889 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1184/2368] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:57:51 2022] POST /identity/v3/users => generated 299 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:57:51.798587 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96660184-3ab9-42f3-ac96-96e9115c12e1 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:51.836173 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96660184-3ab9-42f3-ac96-96e9115c12e1 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:51.856639 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639f56c-a12a-40fe-9708-14d2f98a6850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:51.857343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639f56c-a12a-40fe-9708-14d2f98a6850 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:51.857602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639f56c-a12a-40fe-9708-14d2f98a6850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:51.858042 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639f56c-a12a-40fe-9708-14d2f98a6850 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:51.865582 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639f56c-a12a-40fe-9708-14d2f98a6850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:51.871189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639f56c-a12a-40fe-9708-14d2f98a6850 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:51.917116 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1185/2369] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:57:51.918037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bed5f4-2183-41d2-9f38-bb4b05dfb3c3 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:51.933442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bed5f4-2183-41d2-9f38-bb4b05dfb3c3 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:51.945910 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e66d08-eace-4969-9602-adde8a6a4c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:51.946585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e66d08-eace-4969-9602-adde8a6a4c8d admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:51.946871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e66d08-eace-4969-9602-adde8a6a4c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:51.947182 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e66d08-eace-4969-9602-adde8a6a4c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:51.963464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e66d08-eace-4969-9602-adde8a6a4c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:51.967422 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e66d08-eace-4969-9602-adde8a6a4c8d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:51.988248 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1185/2370] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:57:51.989697 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639f56c-a12a-40fe-9708-14d2f98a6850 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:52.022757 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639f56c-a12a-40fe-9708-14d2f98a6850 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:52.036233 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd8194-4ee1-4f8b-9d8a-30876f686e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:52.037013 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd8194-4ee1-4f8b-9d8a-30876f686e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:52.037313 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd8194-4ee1-4f8b-9d8a-30876f686e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:52.037588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd8194-4ee1-4f8b-9d8a-30876f686e63 admin admin] PATH_INFO: `/v3/projects/4bb94262e1434c279c5af7d89c85e0d3/users/ed5a5a6043a04ef796ebb9d94d8a0be4/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:52.081772 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd8194-4ee1-4f8b-9d8a-30876f686e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb94262e1434c279c5af7d89c85e0d3, user_id=ed5a5a6043a04ef796ebb9d94d8a0be4, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:52.083925 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd8194-4ee1-4f8b-9d8a-30876f686e63 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:52.105517 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1186/2371] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:57:51 2022] PUT /identity/v3/projects/4bb94262e1434c279c5af7d89c85e0d3/users/ed5a5a6043a04ef796ebb9d94d8a0be4/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:57:52.118079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64541f22-a0b0-4650-a371-b806d2c115aa None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:52.118371 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64541f22-a0b0-4650-a371-b806d2c115aa None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:52.118660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64541f22-a0b0-4650-a371-b806d2c115aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:52.156283 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-64541f22-a0b0-4650-a371-b806d2c115aa None None] MFA Rules not processed for user `ed5a5a6043a04ef796ebb9d94d8a0be4`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:52.158070 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-64541f22-a0b0-4650-a371-b806d2c115aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:52.288255 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1186/2372] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:52.301186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd8194-4ee1-4f8b-9d8a-30876f686e63 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:52.303240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-c2bd8194-4ee1-4f8b-9d8a-30876f686e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:52.392613 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd8194-4ee1-4f8b-9d8a-30876f686e63 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:52.396845 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34572858-9613-4010-b688-b6f614ce271a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:52.397709 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34572858-9613-4010-b688-b6f614ce271a service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:52.398159 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34572858-9613-4010-b688-b6f614ce271a service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:52.398588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34572858-9613-4010-b688-b6f614ce271a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:52.409669 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34572858-9613-4010-b688-b6f614ce271a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:52.411112 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34572858-9613-4010-b688-b6f614ce271a service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:52.421262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1187/2373] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:55.267190 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201bfb4-0322-45b0-be99-af0e2fb41a72 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:55.267918 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201bfb4-0322-45b0-be99-af0e2fb41a72 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:55.267918 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201bfb4-0322-45b0-be99-af0e2fb41a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:55.295319 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-0201bfb4-0322-45b0-be99-af0e2fb41a72 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:55.297298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0201bfb4-0322-45b0-be99-af0e2fb41a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:55.390340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:55.435597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1187/2374] 10.222.0.81 () {58 vars in 1016 bytes} [Thu Jul 28 17:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:57:55.768034 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34572858-9613-4010-b688-b6f614ce271a service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:55.769661 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-34572858-9613-4010-b688-b6f614ce271a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:55.776061 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:57:55.893674 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34572858-9613-4010-b688-b6f614ce271a service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:55.900591 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3845a-1513-4a0d-9331-22ec61eeb660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:55.901304 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3845a-1513-4a0d-9331-22ec61eeb660 service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:55.901713 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3845a-1513-4a0d-9331-22ec61eeb660 service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:55.901998 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3845a-1513-4a0d-9331-22ec61eeb660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:55.912639 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3845a-1513-4a0d-9331-22ec61eeb660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:55.914489 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3845a-1513-4a0d-9331-22ec61eeb660 service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:55.924350 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1188/2375] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:58.080025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201bfb4-0322-45b0-be99-af0e2fb41a72 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:58.092069 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201bfb4-0322-45b0-be99-af0e2fb41a72 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:58.101382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d377d6-998b-48b8-911d-e52993d57cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:58.102268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d377d6-998b-48b8-911d-e52993d57cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:58.102606 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d377d6-998b-48b8-911d-e52993d57cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:58.102987 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d377d6-998b-48b8-911d-e52993d57cdb admin admin] PATH_INFO: `/v3/users/ed5a5a6043a04ef796ebb9d94d8a0be4` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:58.105272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d377d6-998b-48b8-911d-e52993d57cdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed5a5a6043a04ef796ebb9d94d8a0be4)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:58.107374 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d377d6-998b-48b8-911d-e52993d57cdb admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:58.178238 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-49d377d6-998b-48b8-911d-e52993d57cdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed5a5a6043a04ef796ebb9d94d8a0be4'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:58.178939 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-49d377d6-998b-48b8-911d-e52993d57cdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed5a5a6043a04ef796ebb9d94d8a0be4'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:58.200228 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-49d377d6-998b-48b8-911d-e52993d57cdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed5a5a6043a04ef796ebb9d94d8a0be4'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:58.218411 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-49d377d6-998b-48b8-911d-e52993d57cdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed5a5a6043a04ef796ebb9d94d8a0be4'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:58.219530 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-49d377d6-998b-48b8-911d-e52993d57cdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed5a5a6043a04ef796ebb9d94d8a0be4'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:58.238248 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1188/2376] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:57:58 2022] DELETE /identity/v3/users/ed5a5a6043a04ef796ebb9d94d8a0be4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:57:58.244232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90434c7-51d8-42c2-b217-e240628acb7b None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:58.245085 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90434c7-51d8-42c2-b217-e240628acb7b None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:58.245085 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90434c7-51d8-42c2-b217-e240628acb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:58.269872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-b90434c7-51d8-42c2-b217-e240628acb7b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:57:58.271507 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b90434c7-51d8-42c2-b217-e240628acb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:58.340022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1189/2377] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:57:58.354336 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d377d6-998b-48b8-911d-e52993d57cdb admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:58.356415 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-49d377d6-998b-48b8-911d-e52993d57cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:58.420736 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d377d6-998b-48b8-911d-e52993d57cdb admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:58.424649 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed132b99-ce2f-494d-a43a-872649d7f6c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:58.425330 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed132b99-ce2f-494d-a43a-872649d7f6c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:58.425612 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed132b99-ce2f-494d-a43a-872649d7f6c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:58.425915 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed132b99-ce2f-494d-a43a-872649d7f6c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:58.436904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed132b99-ce2f-494d-a43a-872649d7f6c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:58.438463 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed132b99-ce2f-494d-a43a-872649d7f6c4 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:58.450163 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1189/2378] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:57:58.834788 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90434c7-51d8-42c2-b217-e240628acb7b None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:57:58.836680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b90434c7-51d8-42c2-b217-e240628acb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:57:58.850875 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90434c7-51d8-42c2-b217-e240628acb7b None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:57:58.857666 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8ff5b-0419-45fc-bf04-edb90d729052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:57:58.858427 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8ff5b-0419-45fc-bf04-edb90d729052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:57:58.858738 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8ff5b-0419-45fc-bf04-edb90d729052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:57:58.859075 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8ff5b-0419-45fc-bf04-edb90d729052 admin admin] PATH_INFO: `/v3/projects/4bb94262e1434c279c5af7d89c85e0d3` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:57:58.860441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8ff5b-0419-45fc-bf04-edb90d729052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb94262e1434c279c5af7d89c85e0d3)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:57:58.863388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8ff5b-0419-45fc-bf04-edb90d729052 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:57:58.918197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-dba8ff5b-0419-45fc-bf04-edb90d729052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb94262e1434c279c5af7d89c85e0d3', 'request_id': 'req-dba8ff5b-0419-45fc-bf04-edb90d729052'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:58.928309 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-dba8ff5b-0419-45fc-bf04-edb90d729052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb94262e1434c279c5af7d89c85e0d3', 'request_id': 'req-dba8ff5b-0419-45fc-bf04-edb90d729052'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:58.937039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-dba8ff5b-0419-45fc-bf04-edb90d729052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb94262e1434c279c5af7d89c85e0d3', 'request_id': 'req-dba8ff5b-0419-45fc-bf04-edb90d729052'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:58.950888 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-dba8ff5b-0419-45fc-bf04-edb90d729052 admin admin] The token cache is being invalidate because project 4bb94262e1434c279c5af7d89c85e0d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:57:58.951208 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-dba8ff5b-0419-45fc-bf04-edb90d729052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:58.952006 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-dba8ff5b-0419-45fc-bf04-edb90d729052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:57:58.953771 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1190/2379] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:57:58 2022] DELETE /identity/v3/projects/4bb94262e1434c279c5af7d89c85e0d3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:58:02.578118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09c646-b90c-4a24-8583-c445bc0b48c7 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:02.579149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09c646-b90c-4a24-8583-c445bc0b48c7 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:02.579542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09c646-b90c-4a24-8583-c445bc0b48c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:02.603172 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-8a09c646-b90c-4a24-8583-c445bc0b48c7 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:02.604767 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8a09c646-b90c-4a24-8583-c445bc0b48c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:02.682456 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1190/2380] 10.222.0.81 () {58 vars in 1016 bytes} [Thu Jul 28 17:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:02.707896 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8ff5b-0419-45fc-bf04-edb90d729052 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:02.710362 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-dba8ff5b-0419-45fc-bf04-edb90d729052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:02.730942 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:02.853329 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8ff5b-0419-45fc-bf04-edb90d729052 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:02.867056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046adaa-b086-4454-8914-3389a8b93b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:02.868069 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046adaa-b086-4454-8914-3389a8b93b2d service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:02.868196 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046adaa-b086-4454-8914-3389a8b93b2d service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:02.868592 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046adaa-b086-4454-8914-3389a8b93b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:02.886470 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046adaa-b086-4454-8914-3389a8b93b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:02.888931 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046adaa-b086-4454-8914-3389a8b93b2d service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:02.907892 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1191/2381] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:03.367231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2814477-755e-4d41-8d59-5cca6462755b None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:03.367577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2814477-755e-4d41-8d59-5cca6462755b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:03.367794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2814477-755e-4d41-8d59-5cca6462755b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:03.389877 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b2814477-755e-4d41-8d59-5cca6462755b None None] MFA Rules not processed for user `a00b6b9e5f8b4cceb8a3197e0349fa65`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:03.391194 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b2814477-755e-4d41-8d59-5cca6462755b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:03.396317 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:03.459958 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1191/2382] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:58:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:05.872048 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97aa80f-303a-426b-87da-a5085e1a7352 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:05.872621 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97aa80f-303a-426b-87da-a5085e1a7352 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:05.872621 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97aa80f-303a-426b-87da-a5085e1a7352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:05.898635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-f97aa80f-303a-426b-87da-a5085e1a7352 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:05.900121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f97aa80f-303a-426b-87da-a5085e1a7352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:05.909448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1192/2383] 10.222.0.81 () {58 vars in 1016 bytes} [Thu Jul 28 17:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:05.938529 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2814477-755e-4d41-8d59-5cca6462755b None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:05.954076 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2814477-755e-4d41-8d59-5cca6462755b None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:05.960842 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355221c2-8ac2-4c91-9167-b872e6442ff3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:05.961665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355221c2-8ac2-4c91-9167-b872e6442ff3 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:05.961992 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355221c2-8ac2-4c91-9167-b872e6442ff3 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:05.962270 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355221c2-8ac2-4c91-9167-b872e6442ff3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:05.972113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355221c2-8ac2-4c91-9167-b872e6442ff3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:05.974017 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355221c2-8ac2-4c91-9167-b872e6442ff3 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:05.987906 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1192/2384] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:08.942639 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03256f-8055-40af-a33d-61a7f1dc5269 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:08.943189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03256f-8055-40af-a33d-61a7f1dc5269 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:08.943189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03256f-8055-40af-a33d-61a7f1dc5269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:08.971070 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-ac03256f-8055-40af-a33d-61a7f1dc5269 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:08.972533 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ac03256f-8055-40af-a33d-61a7f1dc5269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:08.981889 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1193/2385] 10.222.0.81 () {58 vars in 1016 bytes} [Thu Jul 28 17:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:09.006341 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355221c2-8ac2-4c91-9167-b872e6442ff3 service nova] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:09.024574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355221c2-8ac2-4c91-9167-b872e6442ff3 service nova] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:09.033933 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b60c5c-1948-4e8f-a1ec-2ff48274cb7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:09.034783 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b60c5c-1948-4e8f-a1ec-2ff48274cb7c service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:09.035786 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b60c5c-1948-4e8f-a1ec-2ff48274cb7c service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:09.036529 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b60c5c-1948-4e8f-a1ec-2ff48274cb7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:09.050509 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b60c5c-1948-4e8f-a1ec-2ff48274cb7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:09.052634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b60c5c-1948-4e8f-a1ec-2ff48274cb7c service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:09.068470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1193/2386] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:13.251735 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c279e6-6e85-4388-a89b-eccc1c780675 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:13.252290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c279e6-6e85-4388-a89b-eccc1c780675 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:13.252290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c279e6-6e85-4388-a89b-eccc1c780675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:13.291094 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-54c279e6-6e85-4388-a89b-eccc1c780675 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:13.292703 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-54c279e6-6e85-4388-a89b-eccc1c780675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:13.303028 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1194/2387] 10.222.0.81 () {58 vars in 1016 bytes} [Thu Jul 28 17:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:13.349618 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b60c5c-1948-4e8f-a1ec-2ff48274cb7c service nova] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:13.353100 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a6b60c5c-1948-4e8f-a1ec-2ff48274cb7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:13.376959 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b60c5c-1948-4e8f-a1ec-2ff48274cb7c service nova] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:13.382959 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5859f3-2f42-48de-83a5-c3c1a7738437 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:13.383725 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5859f3-2f42-48de-83a5-c3c1a7738437 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:13.384070 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5859f3-2f42-48de-83a5-c3c1a7738437 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:13.384412 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5859f3-2f42-48de-83a5-c3c1a7738437 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:13.394690 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5859f3-2f42-48de-83a5-c3c1a7738437 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:13.397355 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5859f3-2f42-48de-83a5-c3c1a7738437 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:13.407830 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1194/2388] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:17.790528 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da174f-7670-4bea-bb00-2df6d16a09ad None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:17.791541 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da174f-7670-4bea-bb00-2df6d16a09ad None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:17.792024 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da174f-7670-4bea-bb00-2df6d16a09ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:17.813323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-35da174f-7670-4bea-bb00-2df6d16a09ad None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:17.814530 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-35da174f-7670-4bea-bb00-2df6d16a09ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:17.823312 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1195/2389] 10.222.0.81 () {58 vars in 1016 bytes} [Thu Jul 28 17:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:17.903800 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5859f3-2f42-48de-83a5-c3c1a7738437 service nova] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:17.921495 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5859f3-2f42-48de-83a5-c3c1a7738437 service nova] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:17.927793 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbb55f-8215-4f4b-b1a2-e2b36253c7ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:17.928791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbb55f-8215-4f4b-b1a2-e2b36253c7ad service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:17.929335 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbb55f-8215-4f4b-b1a2-e2b36253c7ad service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:17.929842 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbb55f-8215-4f4b-b1a2-e2b36253c7ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:17.943181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcbb55f-8215-4f4b-b1a2-e2b36253c7ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:17.944719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcbb55f-8215-4f4b-b1a2-e2b36253c7ad service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:17.955510 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1195/2390] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:20.403493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609caac-3ec5-4abb-a3b2-289029526300 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:20.404080 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609caac-3ec5-4abb-a3b2-289029526300 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:20.404080 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609caac-3ec5-4abb-a3b2-289029526300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:20.422989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-c609caac-3ec5-4abb-a3b2-289029526300 None None] MFA Rules not processed for user `a1936a2649c349d481f56304b3ee55b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:20.424194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-c609caac-3ec5-4abb-a3b2-289029526300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:20.487327 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1196/2391] 10.222.0.96 () {58 vars in 967 bytes} [Thu Jul 28 17:58:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:20.502764 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbb55f-8215-4f4b-b1a2-e2b36253c7ad service nova] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:20.504244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-cfcbb55f-8215-4f4b-b1a2-e2b36253c7ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:20.581918 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbb55f-8215-4f4b-b1a2-e2b36253c7ad service nova] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:20.587633 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8167b7d-f905-4a68-8a46-cac999f12cb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ea1a9023eaf427f96f86af909a803fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:20.588213 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8167b7d-f905-4a68-8a46-cac999f12cb5 service swift] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:20.588483 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8167b7d-f905-4a68-8a46-cac999f12cb5 service swift] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:20.588771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8167b7d-f905-4a68-8a46-cac999f12cb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:20.598765 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8167b7d-f905-4a68-8a46-cac999f12cb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:20.600399 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8167b7d-f905-4a68-8a46-cac999f12cb5 service swift] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:20.611599 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1196/2392] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Jul 28 17:58:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 17:58:22.679248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609caac-3ec5-4abb-a3b2-289029526300 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:22.684403 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-c609caac-3ec5-4abb-a3b2-289029526300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:22.720567 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609caac-3ec5-4abb-a3b2-289029526300 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:22.726193 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ebf45-a837-4521-81c4-4c685762ef62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:22.726883 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ebf45-a837-4521-81c4-4c685762ef62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:22.727168 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ebf45-a837-4521-81c4-4c685762ef62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:22.727440 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ebf45-a837-4521-81c4-4c685762ef62 admin admin] PATH_INFO: `/v3/users/a8330780c04d4ab9a43b5f49a1e7e4f5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:22.728781 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ebf45-a837-4521-81c4-4c685762ef62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8330780c04d4ab9a43b5f49a1e7e4f5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:22.731651 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ebf45-a837-4521-81c4-4c685762ef62 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:22.787977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5b5ebf45-a837-4521-81c4-4c685762ef62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8330780c04d4ab9a43b5f49a1e7e4f5'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:22.800400 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5b5ebf45-a837-4521-81c4-4c685762ef62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8330780c04d4ab9a43b5f49a1e7e4f5'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:22.804233 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:22.808878 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5b5ebf45-a837-4521-81c4-4c685762ef62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8330780c04d4ab9a43b5f49a1e7e4f5'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:22.817586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5b5ebf45-a837-4521-81c4-4c685762ef62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8330780c04d4ab9a43b5f49a1e7e4f5'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:22.818332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5b5ebf45-a837-4521-81c4-4c685762ef62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8330780c04d4ab9a43b5f49a1e7e4f5'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:22.825243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1197/2393] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:58:22 2022] DELETE /identity/v3/users/a8330780c04d4ab9a43b5f49a1e7e4f5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:58:23.017151 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8167b7d-f905-4a68-8a46-cac999f12cb5 service swift] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:23.032478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8167b7d-f905-4a68-8a46-cac999f12cb5 service swift] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:23.080957 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:23.091052 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354ebbe-3641-4332-85ea-adfc04c653d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:23.091704 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354ebbe-3641-4332-85ea-adfc04c653d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:23.091985 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354ebbe-3641-4332-85ea-adfc04c653d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:23.092291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354ebbe-3641-4332-85ea-adfc04c653d3 admin admin] PATH_INFO: `/v3/projects/23ef380012ab4ab38586ef4c1107f476` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:23.093433 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354ebbe-3641-4332-85ea-adfc04c653d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23ef380012ab4ab38586ef4c1107f476)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:23.095338 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354ebbe-3641-4332-85ea-adfc04c653d3 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:23.146718 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7354ebbe-3641-4332-85ea-adfc04c653d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23ef380012ab4ab38586ef4c1107f476', 'request_id': 'req-7354ebbe-3641-4332-85ea-adfc04c653d3'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:23.153149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7354ebbe-3641-4332-85ea-adfc04c653d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23ef380012ab4ab38586ef4c1107f476', 'request_id': 'req-7354ebbe-3641-4332-85ea-adfc04c653d3'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:23.162355 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7354ebbe-3641-4332-85ea-adfc04c653d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23ef380012ab4ab38586ef4c1107f476', 'request_id': 'req-7354ebbe-3641-4332-85ea-adfc04c653d3'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:23.173323 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7354ebbe-3641-4332-85ea-adfc04c653d3 admin admin] The token cache is being invalidate because project 23ef380012ab4ab38586ef4c1107f476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:58:23.173538 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7354ebbe-3641-4332-85ea-adfc04c653d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:23.174177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7354ebbe-3641-4332-85ea-adfc04c653d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:23.175691 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1197/2394] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:58:23 2022] DELETE /identity/v3/projects/23ef380012ab4ab38586ef4c1107f476 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:58:23.183118 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e482b-80a5-476f-881b-e2f17155a43a None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:23.183446 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e482b-80a5-476f-881b-e2f17155a43a None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:23.183993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e482b-80a5-476f-881b-e2f17155a43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:23.209356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-a35e482b-80a5-476f-881b-e2f17155a43a None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:23.210578 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-a35e482b-80a5-476f-881b-e2f17155a43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:23.275526 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1198/2395] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:23.283545 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8f366-42c4-4f32-9eb9-a11f33b0a77e None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:23.283829 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8f366-42c4-4f32-9eb9-a11f33b0a77e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:23.284101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8f366-42c4-4f32-9eb9-a11f33b0a77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:23.306041 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-04a8f366-42c4-4f32-9eb9-a11f33b0a77e None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:23.307273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-04a8f366-42c4-4f32-9eb9-a11f33b0a77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:23.316746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1198/2396] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:23.321299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e482b-80a5-476f-881b-e2f17155a43a None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:23.331396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e482b-80a5-476f-881b-e2f17155a43a None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:23.337108 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577a47a-4ecf-4e97-ac67-cf6f5a8de768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:23.337706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577a47a-4ecf-4e97-ac67-cf6f5a8de768 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:23.338013 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577a47a-4ecf-4e97-ac67-cf6f5a8de768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:23.338292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577a47a-4ecf-4e97-ac67-cf6f5a8de768 admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:23.338993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577a47a-4ecf-4e97-ac67-cf6f5a8de768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:58:23.339301 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577a47a-4ecf-4e97-ac67-cf6f5a8de768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:23.340981 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577a47a-4ecf-4e97-ac67-cf6f5a8de768 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:23.353273 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1199/2397] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 17:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:58:23.357352 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8f366-42c4-4f32-9eb9-a11f33b0a77e None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:23.367691 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8f366-42c4-4f32-9eb9-a11f33b0a77e None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:23.373977 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed853b24-733a-4db9-b09f-52f91a886fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:23.374656 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed853b24-733a-4db9-b09f-52f91a886fea admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:23.374927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed853b24-733a-4db9-b09f-52f91a886fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:23.375198 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed853b24-733a-4db9-b09f-52f91a886fea admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:23.375857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed853b24-733a-4db9-b09f-52f91a886fea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:23.377817 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed853b24-733a-4db9-b09f-52f91a886fea admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:23.408954 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1199/2398] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 17:58:23 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:58:23.413264 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577a47a-4ecf-4e97-ac67-cf6f5a8de768 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:23.423938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577a47a-4ecf-4e97-ac67-cf6f5a8de768 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:23.489499 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb83d7-b337-482d-ae28-ec7e51fe54f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:23.490116 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb83d7-b337-482d-ae28-ec7e51fe54f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:23.490397 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb83d7-b337-482d-ae28-ec7e51fe54f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:23.490674 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb83d7-b337-482d-ae28-ec7e51fe54f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:23.491343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb83d7-b337-482d-ae28-ec7e51fe54f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:23.493349 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb83d7-b337-482d-ae28-ec7e51fe54f8 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:23.516340 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1200/2399] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 17:58:23 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:58:23.520510 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed853b24-733a-4db9-b09f-52f91a886fea admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:23.531072 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed853b24-733a-4db9-b09f-52f91a886fea admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:23.535694 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe965365-c1f2-48b6-bb9d-e92284bf6a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:23.536311 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe965365-c1f2-48b6-bb9d-e92284bf6a07 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:23.536771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe965365-c1f2-48b6-bb9d-e92284bf6a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:23.537243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe965365-c1f2-48b6-bb9d-e92284bf6a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:23.538103 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe965365-c1f2-48b6-bb9d-e92284bf6a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:23.539878 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe965365-c1f2-48b6-bb9d-e92284bf6a07 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:23.550665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1200/2400] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:58:23.554794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb83d7-b337-482d-ae28-ec7e51fe54f8 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:23.565701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb83d7-b337-482d-ae28-ec7e51fe54f8 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:23.571866 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aca23f-8d83-490b-8f6e-b78f2b5e82c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:23.571866 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aca23f-8d83-490b-8f6e-b78f2b5e82c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:23.571866 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aca23f-8d83-490b-8f6e-b78f2b5e82c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:23.572180 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aca23f-8d83-490b-8f6e-b78f2b5e82c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:23.573682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aca23f-8d83-490b-8f6e-b78f2b5e82c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:23.575643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aca23f-8d83-490b-8f6e-b78f2b5e82c0 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:23.591218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1201/2401] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 17:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:58:23.592664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe965365-c1f2-48b6-bb9d-e92284bf6a07 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:23.603054 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe965365-c1f2-48b6-bb9d-e92284bf6a07 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:23.608041 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e649d24-9653-49ea-b7b1-4c0370fee517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:23.608760 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e649d24-9653-49ea-b7b1-4c0370fee517 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:23.609013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e649d24-9653-49ea-b7b1-4c0370fee517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:23.609299 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e649d24-9653-49ea-b7b1-4c0370fee517 admin admin] PATH_INFO: `/v3/projects/f3e9e3df05a54e2a97d2666486b9eebe/users/71fc6354a17f4e6dbd1b861cb230b0e2/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:23.625329 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e649d24-9653-49ea-b7b1-4c0370fee517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e9e3df05a54e2a97d2666486b9eebe, user_id=71fc6354a17f4e6dbd1b861cb230b0e2, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:23.628272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e649d24-9653-49ea-b7b1-4c0370fee517 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:23.644147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1201/2402] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 17:58:23 2022] PUT /identity/v3/projects/f3e9e3df05a54e2a97d2666486b9eebe/users/71fc6354a17f4e6dbd1b861cb230b0e2/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:58:23.654713 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb58ff-ce1a-44ba-8cbd-e0b8abce803c None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:23.655215 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb58ff-ce1a-44ba-8cbd-e0b8abce803c None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:23.655490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb58ff-ce1a-44ba-8cbd-e0b8abce803c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:23.686484 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-46eb58ff-ce1a-44ba-8cbd-e0b8abce803c None None] MFA Rules not processed for user `71fc6354a17f4e6dbd1b861cb230b0e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:23.687628 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-46eb58ff-ce1a-44ba-8cbd-e0b8abce803c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:23.732187 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:23.758269 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1202/2403] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:58:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:23.770243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e649d24-9653-49ea-b7b1-4c0370fee517 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:23.771969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7e649d24-9653-49ea-b7b1-4c0370fee517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:23.840245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e649d24-9653-49ea-b7b1-4c0370fee517 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:23.844383 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142768ef-d0e9-4ced-bfee-5e2a7e420cdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:23.845090 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142768ef-d0e9-4ced-bfee-5e2a7e420cdb service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:23.845405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142768ef-d0e9-4ced-bfee-5e2a7e420cdb service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:23.845678 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142768ef-d0e9-4ced-bfee-5e2a7e420cdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:23.855710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142768ef-d0e9-4ced-bfee-5e2a7e420cdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:23.857814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142768ef-d0e9-4ced-bfee-5e2a7e420cdb service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:23.869676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1202/2404] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:23.910396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb58ff-ce1a-44ba-8cbd-e0b8abce803c None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:23.981546 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb58ff-ce1a-44ba-8cbd-e0b8abce803c None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:23.986849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a667dbb-8093-47e1-a67e-e4d0e8c8fac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:23.987517 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a667dbb-8093-47e1-a67e-e4d0e8c8fac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:23.987793 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a667dbb-8093-47e1-a67e-e4d0e8c8fac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:23.988026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a667dbb-8093-47e1-a67e-e4d0e8c8fac2 admin admin] PATH_INFO: `/v3/users/71fc6354a17f4e6dbd1b861cb230b0e2` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:23.989589 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a667dbb-8093-47e1-a67e-e4d0e8c8fac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71fc6354a17f4e6dbd1b861cb230b0e2)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:23.991610 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a667dbb-8093-47e1-a67e-e4d0e8c8fac2 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:24.050486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5a667dbb-8093-47e1-a67e-e4d0e8c8fac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71fc6354a17f4e6dbd1b861cb230b0e2'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:24.063171 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5a667dbb-8093-47e1-a67e-e4d0e8c8fac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71fc6354a17f4e6dbd1b861cb230b0e2'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:24.072040 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5a667dbb-8093-47e1-a67e-e4d0e8c8fac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71fc6354a17f4e6dbd1b861cb230b0e2'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:24.079668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5a667dbb-8093-47e1-a67e-e4d0e8c8fac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71fc6354a17f4e6dbd1b861cb230b0e2'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:24.080322 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5a667dbb-8093-47e1-a67e-e4d0e8c8fac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71fc6354a17f4e6dbd1b861cb230b0e2'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:24.086779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1203/2405] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:58:23 2022] DELETE /identity/v3/users/71fc6354a17f4e6dbd1b861cb230b0e2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:58:24.091888 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8de8c-aa0a-4690-83a2-a64aada2c787 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:24.092364 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8de8c-aa0a-4690-83a2-a64aada2c787 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:24.092464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8de8c-aa0a-4690-83a2-a64aada2c787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:24.113857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-76c8de8c-aa0a-4690-83a2-a64aada2c787 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:24.115067 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-76c8de8c-aa0a-4690-83a2-a64aada2c787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:24.128962 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:24.198042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1203/2406] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:58:24.208227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a667dbb-8093-47e1-a67e-e4d0e8c8fac2 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:24.209747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-5a667dbb-8093-47e1-a67e-e4d0e8c8fac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:24.267296 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a667dbb-8093-47e1-a67e-e4d0e8c8fac2 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:24.270900 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84071529-a3a1-4e3d-b79e-59d5be6405f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:24.271520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84071529-a3a1-4e3d-b79e-59d5be6405f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:24.271792 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84071529-a3a1-4e3d-b79e-59d5be6405f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:24.272062 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84071529-a3a1-4e3d-b79e-59d5be6405f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:24.282548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84071529-a3a1-4e3d-b79e-59d5be6405f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:24.284369 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84071529-a3a1-4e3d-b79e-59d5be6405f7 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:24.296476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1204/2407] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:24.710797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8de8c-aa0a-4690-83a2-a64aada2c787 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:24.712379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-76c8de8c-aa0a-4690-83a2-a64aada2c787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:24.724558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8de8c-aa0a-4690-83a2-a64aada2c787 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:24.729666 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eebb73-ad4c-409e-ab97-683a46b6463e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:24.730536 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eebb73-ad4c-409e-ab97-683a46b6463e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:24.731200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eebb73-ad4c-409e-ab97-683a46b6463e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:24.731200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eebb73-ad4c-409e-ab97-683a46b6463e admin admin] PATH_INFO: `/v3/users/0087cd08b620451c84c86b433b8ea251` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:24.732484 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eebb73-ad4c-409e-ab97-683a46b6463e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0087cd08b620451c84c86b433b8ea251)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:24.734465 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eebb73-ad4c-409e-ab97-683a46b6463e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:24.785140 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-77eebb73-ad4c-409e-ab97-683a46b6463e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0087cd08b620451c84c86b433b8ea251'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:24.785791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-77eebb73-ad4c-409e-ab97-683a46b6463e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0087cd08b620451c84c86b433b8ea251'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:24.793100 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-77eebb73-ad4c-409e-ab97-683a46b6463e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0087cd08b620451c84c86b433b8ea251'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:24.795294 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84071529-a3a1-4e3d-b79e-59d5be6405f7 service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:24.796938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-84071529-a3a1-4e3d-b79e-59d5be6405f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:24.819297 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:24.819534 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-77eebb73-ad4c-409e-ab97-683a46b6463e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0087cd08b620451c84c86b433b8ea251'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:24.821268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-77eebb73-ad4c-409e-ab97-683a46b6463e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0087cd08b620451c84c86b433b8ea251'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:24.824545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84071529-a3a1-4e3d-b79e-59d5be6405f7 service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:24.841725 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af241f12-3f69-49bd-bc03-554f15b7d02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:24.842557 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af241f12-3f69-49bd-bc03-554f15b7d02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:24.842995 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af241f12-3f69-49bd-bc03-554f15b7d02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:24.843484 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af241f12-3f69-49bd-bc03-554f15b7d02d admin admin] PATH_INFO: `/v3/projects/f3e9e3df05a54e2a97d2666486b9eebe` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:24.844822 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af241f12-3f69-49bd-bc03-554f15b7d02d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e9e3df05a54e2a97d2666486b9eebe)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:24.847206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af241f12-3f69-49bd-bc03-554f15b7d02d admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:24.848171 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1204/2408] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:58:24 2022] DELETE /identity/v3/users/0087cd08b620451c84c86b433b8ea251 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:58:24.852912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae59480-f5f7-4c3d-a906-866ad0e5daf4 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:24.853368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae59480-f5f7-4c3d-a906-866ad0e5daf4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:24.853770 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae59480-f5f7-4c3d-a906-866ad0e5daf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:24.881397 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-8ae59480-f5f7-4c3d-a906-866ad0e5daf4 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:24.882674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8ae59480-f5f7-4c3d-a906-866ad0e5daf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:24.944968 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-af241f12-3f69-49bd-bc03-554f15b7d02d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e9e3df05a54e2a97d2666486b9eebe', 'request_id': 'req-af241f12-3f69-49bd-bc03-554f15b7d02d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:24.953981 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1205/2409] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:58:24.958449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-af241f12-3f69-49bd-bc03-554f15b7d02d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e9e3df05a54e2a97d2666486b9eebe', 'request_id': 'req-af241f12-3f69-49bd-bc03-554f15b7d02d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:24.965204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae59480-f5f7-4c3d-a906-866ad0e5daf4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:24.967077 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8ae59480-f5f7-4c3d-a906-866ad0e5daf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:24.971087 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-af241f12-3f69-49bd-bc03-554f15b7d02d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e9e3df05a54e2a97d2666486b9eebe', 'request_id': 'req-af241f12-3f69-49bd-bc03-554f15b7d02d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:24.985497 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-af241f12-3f69-49bd-bc03-554f15b7d02d admin admin] The token cache is being invalidate because project f3e9e3df05a54e2a97d2666486b9eebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:58:24.985809 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-af241f12-3f69-49bd-bc03-554f15b7d02d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:24.986445 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-af241f12-3f69-49bd-bc03-554f15b7d02d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:24.988730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1205/2410] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:58:24 2022] DELETE /identity/v3/projects/f3e9e3df05a54e2a97d2666486b9eebe => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:58:25.023556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:25.056333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae59480-f5f7-4c3d-a906-866ad0e5daf4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:25.116139 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7dee6-3dc0-474b-8eba-8f042a82fd94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:25.116866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7dee6-3dc0-474b-8eba-8f042a82fd94 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:25.117787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7dee6-3dc0-474b-8eba-8f042a82fd94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:25.117787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7dee6-3dc0-474b-8eba-8f042a82fd94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:25.119975 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8ca7dee6-3dc0-474b-8eba-8f042a82fd94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:25.206881 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7dee6-3dc0-474b-8eba-8f042a82fd94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:25.208571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7dee6-3dc0-474b-8eba-8f042a82fd94 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:25.222300 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1206/2411] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:58:25.538011 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af241f12-3f69-49bd-bc03-554f15b7d02d admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:25.540470 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-af241f12-3f69-49bd-bc03-554f15b7d02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:25.556459 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af241f12-3f69-49bd-bc03-554f15b7d02d admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:25.562046 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4baa42-6a01-43ed-8e2e-c24260ebaa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:25.562977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4baa42-6a01-43ed-8e2e-c24260ebaa85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:25.563490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4baa42-6a01-43ed-8e2e-c24260ebaa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:25.563934 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4baa42-6a01-43ed-8e2e-c24260ebaa85 admin admin] PATH_INFO: `/v3/projects/b1e41eff47774386b2f2542cf6e6e0d8` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:25.565543 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4baa42-6a01-43ed-8e2e-c24260ebaa85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1e41eff47774386b2f2542cf6e6e0d8)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:25.567681 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4baa42-6a01-43ed-8e2e-c24260ebaa85 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:25.634529 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-da4baa42-6a01-43ed-8e2e-c24260ebaa85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1e41eff47774386b2f2542cf6e6e0d8', 'request_id': 'req-da4baa42-6a01-43ed-8e2e-c24260ebaa85'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:25.646181 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-da4baa42-6a01-43ed-8e2e-c24260ebaa85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1e41eff47774386b2f2542cf6e6e0d8', 'request_id': 'req-da4baa42-6a01-43ed-8e2e-c24260ebaa85'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:25.660030 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-da4baa42-6a01-43ed-8e2e-c24260ebaa85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1e41eff47774386b2f2542cf6e6e0d8', 'request_id': 'req-da4baa42-6a01-43ed-8e2e-c24260ebaa85'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:25.673490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-da4baa42-6a01-43ed-8e2e-c24260ebaa85 admin admin] The token cache is being invalidate because project b1e41eff47774386b2f2542cf6e6e0d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:58:25.673490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-da4baa42-6a01-43ed-8e2e-c24260ebaa85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:25.675425 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-da4baa42-6a01-43ed-8e2e-c24260ebaa85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:58:25.679156 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1206/2412] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:58:25 2022] DELETE /identity/v3/projects/b1e41eff47774386b2f2542cf6e6e0d8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:58:35.216695 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=55 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:35.669157 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=52,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:35.852424 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7dee6-3dc0-474b-8eba-8f042a82fd94 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:35.855250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8ca7dee6-3dc0-474b-8eba-8f042a82fd94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:35.937341 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7dee6-3dc0-474b-8eba-8f042a82fd94 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:36.010359 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd960e0e-965a-4a65-afb7-c617d32091c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38257735924d44488e1407fefb886324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:36.011149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd960e0e-965a-4a65-afb7-c617d32091c7 service placement] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:36.011532 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd960e0e-965a-4a65-afb7-c617d32091c7 service placement] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:36.012007 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd960e0e-965a-4a65-afb7-c617d32091c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:36.014523 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-bd960e0e-965a-4a65-afb7-c617d32091c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:36.034546 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd960e0e-965a-4a65-afb7-c617d32091c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:36.036170 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd960e0e-965a-4a65-afb7-c617d32091c7 service placement] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:36.048512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1207/2413] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:36.428305 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4baa42-6a01-43ed-8e2e-c24260ebaa85 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:36.429733 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-da4baa42-6a01-43ed-8e2e-c24260ebaa85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:36.489989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4baa42-6a01-43ed-8e2e-c24260ebaa85 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:36.494796 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddf711-b28e-466b-85a9-06fd76b56505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:36.495357 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddf711-b28e-466b-85a9-06fd76b56505 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:36.495637 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddf711-b28e-466b-85a9-06fd76b56505 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:36.495908 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddf711-b28e-466b-85a9-06fd76b56505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:36.497976 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-cfddf711-b28e-466b-85a9-06fd76b56505 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:36.570044 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddf711-b28e-466b-85a9-06fd76b56505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:36.571473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddf711-b28e-466b-85a9-06fd76b56505 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:36.582141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1207/2414] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:36 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:40.857423 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a86f5-83e1-413d-a9af-ceff57c4b6fe None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:40.857976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a86f5-83e1-413d-a9af-ceff57c4b6fe None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:40.857976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a86f5-83e1-413d-a9af-ceff57c4b6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:40.879150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e69a86f5-83e1-413d-a9af-ceff57c4b6fe None None] MFA Rules not processed for user `0d7099453cf9439884ff8e77d65af242`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:40.880351 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e69a86f5-83e1-413d-a9af-ceff57c4b6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:40.951593 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1208/2415] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:58:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:46.576985 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=50 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:50.941189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=83 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:58:55.311488 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f523e8f-dcb8-4942-acbb-156f20840761 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:55.312068 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f523e8f-dcb8-4942-acbb-156f20840761 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:55.312068 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f523e8f-dcb8-4942-acbb-156f20840761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:55.334019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-1f523e8f-dcb8-4942-acbb-156f20840761 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:55.335161 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1f523e8f-dcb8-4942-acbb-156f20840761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:55.401491 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1208/2416] 10.222.0.81 () {58 vars in 1016 bytes} [Thu Jul 28 17:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:55.435015 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a86f5-83e1-413d-a9af-ceff57c4b6fe None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:55.436652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e69a86f5-83e1-413d-a9af-ceff57c4b6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:55.528656 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a86f5-83e1-413d-a9af-ceff57c4b6fe None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:55.536463 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9126ea0-0b82-4897-8bab-faa8c1fa4344 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:55.537125 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9126ea0-0b82-4897-8bab-faa8c1fa4344 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:55.537427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9126ea0-0b82-4897-8bab-faa8c1fa4344 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:55.537694 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9126ea0-0b82-4897-8bab-faa8c1fa4344 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:55.547250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9126ea0-0b82-4897-8bab-faa8c1fa4344 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:55.548886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9126ea0-0b82-4897-8bab-faa8c1fa4344 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:55.559975 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1209/2417] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:58:58.603214 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce69419-d9b3-48ba-8fb4-c07e4fbe725e None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:58.603832 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce69419-d9b3-48ba-8fb4-c07e4fbe725e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:58.603944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce69419-d9b3-48ba-8fb4-c07e4fbe725e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:58.626223 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-cce69419-d9b3-48ba-8fb4-c07e4fbe725e None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:58:58.627465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-cce69419-d9b3-48ba-8fb4-c07e4fbe725e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:58:58.635838 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1209/2418] 10.222.0.81 () {58 vars in 1016 bytes} [Thu Jul 28 17:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:58:58.660987 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9126ea0-0b82-4897-8bab-faa8c1fa4344 service nova] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:58:58.672135 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9126ea0-0b82-4897-8bab-faa8c1fa4344 service nova] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:58:58.677630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10281190-1272-4d30-adb6-c56f2f97c02a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:58:58.678308 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10281190-1272-4d30-adb6-c56f2f97c02a service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:58:58.678587 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10281190-1272-4d30-adb6-c56f2f97c02a service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:58:58.678848 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10281190-1272-4d30-adb6-c56f2f97c02a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:58:58.687460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10281190-1272-4d30-adb6-c56f2f97c02a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:58:58.689098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10281190-1272-4d30-adb6-c56f2f97c02a service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:58:58.703604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1210/2419] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:58:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:59:02.716579 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfb991-de80-43df-9957-f19ecf72c068 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:02.717267 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfb991-de80-43df-9957-f19ecf72c068 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:02.717267 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfb991-de80-43df-9957-f19ecf72c068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:02.742474 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-1ddfb991-de80-43df-9957-f19ecf72c068 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:59:02.744033 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1ddfb991-de80-43df-9957-f19ecf72c068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:02.753998 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1210/2420] 10.222.0.81 () {58 vars in 1016 bytes} [Thu Jul 28 17:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:59:02.780142 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10281190-1272-4d30-adb6-c56f2f97c02a service nova] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:59:02.781862 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-10281190-1272-4d30-adb6-c56f2f97c02a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:02.797729 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10281190-1272-4d30-adb6-c56f2f97c02a service nova] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:59:02.804656 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64d870-2619-41ac-92ba-894b70dcfd0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:59:02.805303 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64d870-2619-41ac-92ba-894b70dcfd0f service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:02.805577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64d870-2619-41ac-92ba-894b70dcfd0f service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:02.805846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64d870-2619-41ac-92ba-894b70dcfd0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:02.814565 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64d870-2619-41ac-92ba-894b70dcfd0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:59:02.816135 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64d870-2619-41ac-92ba-894b70dcfd0f service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:59:02.826266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1211/2421] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:59:05.907256 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339249b8-2faf-4315-aac6-3b2a84fcfaa3 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:05.907760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339249b8-2faf-4315-aac6-3b2a84fcfaa3 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:05.907886 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339249b8-2faf-4315-aac6-3b2a84fcfaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:05.931154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-339249b8-2faf-4315-aac6-3b2a84fcfaa3 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:59:05.932358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-339249b8-2faf-4315-aac6-3b2a84fcfaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:05.941391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1211/2422] 10.222.0.81 () {58 vars in 1016 bytes} [Thu Jul 28 17:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:59:05.970559 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64d870-2619-41ac-92ba-894b70dcfd0f service nova] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:59:05.982760 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64d870-2619-41ac-92ba-894b70dcfd0f service nova] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:59:05.989989 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89bd1f-5d4d-4d6a-b690-1db2b1b8294d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:59:05.990604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89bd1f-5d4d-4d6a-b690-1db2b1b8294d service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:05.990879 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89bd1f-5d4d-4d6a-b690-1db2b1b8294d service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:05.991153 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89bd1f-5d4d-4d6a-b690-1db2b1b8294d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:06.000974 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89bd1f-5d4d-4d6a-b690-1db2b1b8294d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:59:06.002614 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89bd1f-5d4d-4d6a-b690-1db2b1b8294d service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:59:06.012360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1212/2423] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:59:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:59:10.164993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01cced-6369-4323-ac19-c7f39f0f73b7 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:10.165587 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01cced-6369-4323-ac19-c7f39f0f73b7 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:10.165684 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01cced-6369-4323-ac19-c7f39f0f73b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:10.186959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-9b01cced-6369-4323-ac19-c7f39f0f73b7 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:59:10.188138 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9b01cced-6369-4323-ac19-c7f39f0f73b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:10.196815 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1212/2424] 10.222.0.81 () {58 vars in 1016 bytes} [Thu Jul 28 17:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:59:10.223619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89bd1f-5d4d-4d6a-b690-1db2b1b8294d service nova] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:59:10.235976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89bd1f-5d4d-4d6a-b690-1db2b1b8294d service nova] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:59:10.244635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf6f41-7160-4aea-b9ba-6b8f314d7d9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:59:10.245760 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf6f41-7160-4aea-b9ba-6b8f314d7d9e service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:10.246045 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf6f41-7160-4aea-b9ba-6b8f314d7d9e service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:10.246323 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf6f41-7160-4aea-b9ba-6b8f314d7d9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:10.256284 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf6f41-7160-4aea-b9ba-6b8f314d7d9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:59:10.257952 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf6f41-7160-4aea-b9ba-6b8f314d7d9e service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:59:10.268585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1213/2425] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 17:59:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:59:20.181396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=39 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:20.263517 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=58 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:25.261556 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204f99b-242a-42e0-af74-c1306564f357 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:25.262122 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204f99b-242a-42e0-af74-c1306564f357 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:25.262122 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204f99b-242a-42e0-af74-c1306564f357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:25.282734 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-9204f99b-242a-42e0-af74-c1306564f357 None None] MFA Rules not processed for user `6f0d7343fee749b89293973a422c22a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:59:25.284099 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9204f99b-242a-42e0-af74-c1306564f357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:25.342472 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1213/2426] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:59:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:59:34.666479 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cee59d-222c-4c2e-8df2-aa1284c80d26 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:34.666963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cee59d-222c-4c2e-8df2-aa1284c80d26 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:34.667109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cee59d-222c-4c2e-8df2-aa1284c80d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:34.821027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-66cee59d-222c-4c2e-8df2-aa1284c80d26 None None] MFA Rules not processed for user `a00b6b9e5f8b4cceb8a3197e0349fa65`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:59:34.822489 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-66cee59d-222c-4c2e-8df2-aa1284c80d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:34.887106 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1214/2427] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:59:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:59:35.335036 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=25 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:42.080144 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204f99b-242a-42e0-af74-c1306564f357 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:59:42.081822 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9204f99b-242a-42e0-af74-c1306564f357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:42.099097 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204f99b-242a-42e0-af74-c1306564f357 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:59:42.104221 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b5a7f-6c5d-433a-9883-4bebf6386728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:59:42.104877 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b5a7f-6c5d-433a-9883-4bebf6386728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:42.105194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b5a7f-6c5d-433a-9883-4bebf6386728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:42.105627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b5a7f-6c5d-433a-9883-4bebf6386728 admin admin] PATH_INFO: `/v3/users/0d7099453cf9439884ff8e77d65af242` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:42.106804 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b5a7f-6c5d-433a-9883-4bebf6386728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d7099453cf9439884ff8e77d65af242)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:59:42.109025 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b5a7f-6c5d-433a-9883-4bebf6386728 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:59:42.160746 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-717b5a7f-6c5d-433a-9883-4bebf6386728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d7099453cf9439884ff8e77d65af242'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:59:42.173787 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-717b5a7f-6c5d-433a-9883-4bebf6386728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d7099453cf9439884ff8e77d65af242'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:59:42.182750 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-717b5a7f-6c5d-433a-9883-4bebf6386728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d7099453cf9439884ff8e77d65af242'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:59:42.189766 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-717b5a7f-6c5d-433a-9883-4bebf6386728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d7099453cf9439884ff8e77d65af242'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:59:42.190414 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-717b5a7f-6c5d-433a-9883-4bebf6386728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d7099453cf9439884ff8e77d65af242'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:59:42.196575 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1214/2428] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 17:59:42 2022] DELETE /identity/v3/users/0d7099453cf9439884ff8e77d65af242 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:59:42.412872 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cee59d-222c-4c2e-8df2-aa1284c80d26 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:59:42.424351 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cee59d-222c-4c2e-8df2-aa1284c80d26 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:59:42.486146 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94a1c2-a46a-4e39-ba28-eb2829806c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:59:42.486787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94a1c2-a46a-4e39-ba28-eb2829806c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:42.487064 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94a1c2-a46a-4e39-ba28-eb2829806c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:42.487334 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94a1c2-a46a-4e39-ba28-eb2829806c8e admin admin] PATH_INFO: `/v3/projects/2cca5e0418c74b478474f23bae70dd8b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:42.488513 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94a1c2-a46a-4e39-ba28-eb2829806c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cca5e0418c74b478474f23bae70dd8b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:59:42.490561 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94a1c2-a46a-4e39-ba28-eb2829806c8e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:59:42.539765 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ba94a1c2-a46a-4e39-ba28-eb2829806c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cca5e0418c74b478474f23bae70dd8b', 'request_id': 'req-ba94a1c2-a46a-4e39-ba28-eb2829806c8e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:59:42.546186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ba94a1c2-a46a-4e39-ba28-eb2829806c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cca5e0418c74b478474f23bae70dd8b', 'request_id': 'req-ba94a1c2-a46a-4e39-ba28-eb2829806c8e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:59:42.556414 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ba94a1c2-a46a-4e39-ba28-eb2829806c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cca5e0418c74b478474f23bae70dd8b', 'request_id': 'req-ba94a1c2-a46a-4e39-ba28-eb2829806c8e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:59:42.571288 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ba94a1c2-a46a-4e39-ba28-eb2829806c8e admin admin] The token cache is being invalidate because project 2cca5e0418c74b478474f23bae70dd8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 17:59:42.571577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ba94a1c2-a46a-4e39-ba28-eb2829806c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:59:42.572332 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ba94a1c2-a46a-4e39-ba28-eb2829806c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 17:59:42.574220 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1215/2429] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 17:59:42 2022] DELETE /identity/v3/projects/2cca5e0418c74b478474f23bae70dd8b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:59:52.193302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:52.566358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:59.743198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc02dfb-5fb8-4dac-a95f-742e9435fc28 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:59.743716 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc02dfb-5fb8-4dac-a95f-742e9435fc28 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:59.743948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc02dfb-5fb8-4dac-a95f-742e9435fc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:59.771976 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-edc02dfb-5fb8-4dac-a95f-742e9435fc28 None None] MFA Rules not processed for user `d2a83fb7509446c3a342ea635eccf04d`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:59:59.773849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-edc02dfb-5fb8-4dac-a95f-742e9435fc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:59.845600 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1215/2430] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 17:59:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:09.837320 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=25 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:21.596687 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94a1c2-a46a-4e39-ba28-eb2829806c8e admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:21.598339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ba94a1c2-a46a-4e39-ba28-eb2829806c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:21.668551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94a1c2-a46a-4e39-ba28-eb2829806c8e admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:21.673014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2815a0a-627e-4a5d-a259-1cc0528fc5a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:21.673697 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2815a0a-627e-4a5d-a259-1cc0528fc5a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:21.673979 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2815a0a-627e-4a5d-a259-1cc0528fc5a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:21.674250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2815a0a-627e-4a5d-a259-1cc0528fc5a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:21.676293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f2815a0a-627e-4a5d-a259-1cc0528fc5a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:21.750058 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2815a0a-627e-4a5d-a259-1cc0528fc5a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:21.752215 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2815a0a-627e-4a5d-a259-1cc0528fc5a1 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:21.768774 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1216/2431] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:00:24.142990 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc02dfb-5fb8-4dac-a95f-742e9435fc28 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:24.145006 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-edc02dfb-5fb8-4dac-a95f-742e9435fc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:24.158711 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc02dfb-5fb8-4dac-a95f-742e9435fc28 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:24.184075 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3bda3-1540-4736-8475-4fc1d11f45b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:24.184907 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3bda3-1540-4736-8475-4fc1d11f45b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:24.185411 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3bda3-1540-4736-8475-4fc1d11f45b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:24.185883 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3bda3-1540-4736-8475-4fc1d11f45b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:24.188012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b6a3bda3-1540-4736-8475-4fc1d11f45b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:24.205687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3bda3-1540-4736-8475-4fc1d11f45b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:24.207093 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3bda3-1540-4736-8475-4fc1d11f45b4 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:24.233294 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1216/2432] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:00:25.343754 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2815a0a-627e-4a5d-a259-1cc0528fc5a1 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:25.352560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2815a0a-627e-4a5d-a259-1cc0528fc5a1 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:25.363878 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13553ec6-a72f-4e7c-a602-dc1b51c5a7e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:25.364642 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13553ec6-a72f-4e7c-a602-dc1b51c5a7e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:25.364785 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13553ec6-a72f-4e7c-a602-dc1b51c5a7e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:25.365087 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13553ec6-a72f-4e7c-a602-dc1b51c5a7e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:25.367434 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-13553ec6-a72f-4e7c-a602-dc1b51c5a7e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:25.438356 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13553ec6-a72f-4e7c-a602-dc1b51c5a7e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:25.439787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13553ec6-a72f-4e7c-a602-dc1b51c5a7e9 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:25.451168 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1217/2433] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:00:29.163856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3bda3-1540-4736-8475-4fc1d11f45b4 service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:29.165896 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b6a3bda3-1540-4736-8475-4fc1d11f45b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:29.184299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3bda3-1540-4736-8475-4fc1d11f45b4 service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:29.188809 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b47f2d-8b48-4d4b-af51-3d636881c1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:29.189986 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b47f2d-8b48-4d4b-af51-3d636881c1d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:29.190270 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b47f2d-8b48-4d4b-af51-3d636881c1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:29.190546 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b47f2d-8b48-4d4b-af51-3d636881c1d6 admin admin] PATH_INFO: `/v3/users/6f0d7343fee749b89293973a422c22a6` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:29.197041 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b47f2d-8b48-4d4b-af51-3d636881c1d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f0d7343fee749b89293973a422c22a6)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:29.199204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b47f2d-8b48-4d4b-af51-3d636881c1d6 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:29.248940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-39b47f2d-8b48-4d4b-af51-3d636881c1d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f0d7343fee749b89293973a422c22a6'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:00:29.260370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-39b47f2d-8b48-4d4b-af51-3d636881c1d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f0d7343fee749b89293973a422c22a6'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:00:29.269962 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-39b47f2d-8b48-4d4b-af51-3d636881c1d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f0d7343fee749b89293973a422c22a6'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:00:29.277568 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-39b47f2d-8b48-4d4b-af51-3d636881c1d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f0d7343fee749b89293973a422c22a6'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:00:29.278237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-39b47f2d-8b48-4d4b-af51-3d636881c1d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f0d7343fee749b89293973a422c22a6'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:00:29.284185 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1217/2434] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:00:29 2022] DELETE /identity/v3/users/6f0d7343fee749b89293973a422c22a6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:00:29.479637 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13553ec6-a72f-4e7c-a602-dc1b51c5a7e9 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:29.490215 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13553ec6-a72f-4e7c-a602-dc1b51c5a7e9 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:29.529329 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:29.555575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42793588-185f-489a-b50d-d3d98d901e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:29.556212 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42793588-185f-489a-b50d-d3d98d901e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:29.556491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42793588-185f-489a-b50d-d3d98d901e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:29.556760 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42793588-185f-489a-b50d-d3d98d901e77 admin admin] PATH_INFO: `/v3/projects/9f0a46d163314f88846586f1ea333019` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:29.558020 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42793588-185f-489a-b50d-d3d98d901e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f0a46d163314f88846586f1ea333019)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:29.560010 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42793588-185f-489a-b50d-d3d98d901e77 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:29.612362 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-42793588-185f-489a-b50d-d3d98d901e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f0a46d163314f88846586f1ea333019', 'request_id': 'req-42793588-185f-489a-b50d-d3d98d901e77'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:00:29.619282 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-42793588-185f-489a-b50d-d3d98d901e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f0a46d163314f88846586f1ea333019', 'request_id': 'req-42793588-185f-489a-b50d-d3d98d901e77'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:00:29.629577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-42793588-185f-489a-b50d-d3d98d901e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f0a46d163314f88846586f1ea333019', 'request_id': 'req-42793588-185f-489a-b50d-d3d98d901e77'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:00:29.641475 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-42793588-185f-489a-b50d-d3d98d901e77 admin admin] The token cache is being invalidate because project 9f0a46d163314f88846586f1ea333019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:00:29.641768 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-42793588-185f-489a-b50d-d3d98d901e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:00:29.642410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-42793588-185f-489a-b50d-d3d98d901e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:00:29.643916 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1218/2435] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:00:29 2022] DELETE /identity/v3/projects/9f0a46d163314f88846586f1ea333019 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:00:29.649173 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eef356-40cf-4c06-87f4-92b890adc161 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:29.649548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eef356-40cf-4c06-87f4-92b890adc161 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:29.650007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eef356-40cf-4c06-87f4-92b890adc161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:29.670139 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-e0eef356-40cf-4c06-87f4-92b890adc161 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:29.671360 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e0eef356-40cf-4c06-87f4-92b890adc161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:29.734778 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1218/2436] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:29.743291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a8e1f-514b-45a2-9956-cdb26d1262e6 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:29.743584 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a8e1f-514b-45a2-9956-cdb26d1262e6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:29.743864 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a8e1f-514b-45a2-9956-cdb26d1262e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:29.764852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-483a8e1f-514b-45a2-9956-cdb26d1262e6 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:29.766557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-483a8e1f-514b-45a2-9956-cdb26d1262e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:29.774887 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1219/2437] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:00:29.779310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eef356-40cf-4c06-87f4-92b890adc161 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:29.791990 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eef356-40cf-4c06-87f4-92b890adc161 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:29.800368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac425d9-4516-4224-a25e-4a0aca0835dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:29.801236 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac425d9-4516-4224-a25e-4a0aca0835dc admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:29.801608 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac425d9-4516-4224-a25e-4a0aca0835dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:29.802018 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac425d9-4516-4224-a25e-4a0aca0835dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:29.802850 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac425d9-4516-4224-a25e-4a0aca0835dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:00:29.803297 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac425d9-4516-4224-a25e-4a0aca0835dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:29.805820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac425d9-4516-4224-a25e-4a0aca0835dc admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:29.822295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1219/2438] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 18:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:00:29.829080 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a8e1f-514b-45a2-9956-cdb26d1262e6 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:29.843770 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a8e1f-514b-45a2-9956-cdb26d1262e6 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:29.851532 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8d423-dddd-4b2a-be69-df90676d0281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:29.852180 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8d423-dddd-4b2a-be69-df90676d0281 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:29.852464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8d423-dddd-4b2a-be69-df90676d0281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:29.852805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8d423-dddd-4b2a-be69-df90676d0281 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:29.853479 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8d423-dddd-4b2a-be69-df90676d0281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:29.855874 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8d423-dddd-4b2a-be69-df90676d0281 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:29.887979 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1220/2439] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:00:29 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:00:29.892287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac425d9-4516-4224-a25e-4a0aca0835dc admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:29.902484 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac425d9-4516-4224-a25e-4a0aca0835dc admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:29.953030 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:29.968448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73bf4c-64db-4017-bc1d-2146577ba1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:29.969105 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73bf4c-64db-4017-bc1d-2146577ba1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:29.969393 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73bf4c-64db-4017-bc1d-2146577ba1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:29.969666 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73bf4c-64db-4017-bc1d-2146577ba1a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:29.970357 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73bf4c-64db-4017-bc1d-2146577ba1a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:29.972270 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73bf4c-64db-4017-bc1d-2146577ba1a0 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:29.999055 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1220/2440] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:00:29 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:00:30.003085 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8d423-dddd-4b2a-be69-df90676d0281 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:30.014613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8d423-dddd-4b2a-be69-df90676d0281 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:30.021181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb03f92-2bbe-4bad-bbbd-da6cba8a08e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:30.021713 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb03f92-2bbe-4bad-bbbd-da6cba8a08e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:30.021995 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb03f92-2bbe-4bad-bbbd-da6cba8a08e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:30.022267 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb03f92-2bbe-4bad-bbbd-da6cba8a08e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:30.022966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb03f92-2bbe-4bad-bbbd-da6cba8a08e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:30.024580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb03f92-2bbe-4bad-bbbd-da6cba8a08e3 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:30.036108 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1221/2441] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:00:30.040666 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73bf4c-64db-4017-bc1d-2146577ba1a0 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:30.051971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73bf4c-64db-4017-bc1d-2146577ba1a0 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:30.058084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec27b0-7064-45d3-b5c8-a90031b6fac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:30.058741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec27b0-7064-45d3-b5c8-a90031b6fac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:30.058991 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec27b0-7064-45d3-b5c8-a90031b6fac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:30.059274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec27b0-7064-45d3-b5c8-a90031b6fac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:30.059996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec27b0-7064-45d3-b5c8-a90031b6fac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:30.061673 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec27b0-7064-45d3-b5c8-a90031b6fac9 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:30.072766 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1221/2442] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:00:30.077146 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb03f92-2bbe-4bad-bbbd-da6cba8a08e3 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:30.087904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb03f92-2bbe-4bad-bbbd-da6cba8a08e3 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:30.093534 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6acdf-1b98-4d5a-b123-ea11115ad50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:30.094197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6acdf-1b98-4d5a-b123-ea11115ad50b admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:30.094472 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6acdf-1b98-4d5a-b123-ea11115ad50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:30.094746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6acdf-1b98-4d5a-b123-ea11115ad50b admin admin] PATH_INFO: `/v3/projects/6933c67f8c634fb79269e646480bc887/users/2984a1ad28044641bff1d12fa7de7851/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:30.110615 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6acdf-1b98-4d5a-b123-ea11115ad50b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6933c67f8c634fb79269e646480bc887, user_id=2984a1ad28044641bff1d12fa7de7851, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:30.113461 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6acdf-1b98-4d5a-b123-ea11115ad50b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:30.132792 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1222/2443] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:00:30 2022] PUT /identity/v3/projects/6933c67f8c634fb79269e646480bc887/users/2984a1ad28044641bff1d12fa7de7851/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:00:30.140891 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30233b14-16ac-40f7-8b5b-999983abcea7 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:30.141244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30233b14-16ac-40f7-8b5b-999983abcea7 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:30.141541 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30233b14-16ac-40f7-8b5b-999983abcea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:30.166075 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-30233b14-16ac-40f7-8b5b-999983abcea7 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:30.167387 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-30233b14-16ac-40f7-8b5b-999983abcea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:30.228096 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1222/2444] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:30.238456 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6acdf-1b98-4d5a-b123-ea11115ad50b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:30.240297 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-07d6acdf-1b98-4d5a-b123-ea11115ad50b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:30.301420 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6acdf-1b98-4d5a-b123-ea11115ad50b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:30.306078 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28573a-6a47-4f97-8882-f1184c3549e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:30.306713 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28573a-6a47-4f97-8882-f1184c3549e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:30.306989 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28573a-6a47-4f97-8882-f1184c3549e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:30.307259 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28573a-6a47-4f97-8882-f1184c3549e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:30.317678 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28573a-6a47-4f97-8882-f1184c3549e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:30.319108 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28573a-6a47-4f97-8882-f1184c3549e5 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:30.329181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1223/2445] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:00:35.982017 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f2b4c-e2d2-483e-8038-86623a1153cb None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:35.982919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f2b4c-e2d2-483e-8038-86623a1153cb None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:35.983445 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f2b4c-e2d2-483e-8038-86623a1153cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:36.023521 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-e81f2b4c-e2d2-483e-8038-86623a1153cb None None] MFA Rules not processed for user `2984a1ad28044641bff1d12fa7de7851`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:36.025344 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e81f2b4c-e2d2-483e-8038-86623a1153cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:36.111750 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1223/2446] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:00:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:36.128819 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28573a-6a47-4f97-8882-f1184c3549e5 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:36.130329 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1d28573a-6a47-4f97-8882-f1184c3549e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:36.138397 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:36.222542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28573a-6a47-4f97-8882-f1184c3549e5 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:36.232454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b905a-bc4d-44fa-b194-51fe2c2078f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:36.233759 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b905a-bc4d-44fa-b194-51fe2c2078f1 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:36.234292 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b905a-bc4d-44fa-b194-51fe2c2078f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:36.234742 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b905a-bc4d-44fa-b194-51fe2c2078f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:36.249784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b905a-bc4d-44fa-b194-51fe2c2078f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:36.251742 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b905a-bc4d-44fa-b194-51fe2c2078f1 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:36.269480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1224/2447] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:00:36.484971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de30f5-d3cb-4a9b-9f2d-d45e067cc30e None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:36.484971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de30f5-d3cb-4a9b-9f2d-d45e067cc30e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:36.484971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de30f5-d3cb-4a9b-9f2d-d45e067cc30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:36.507879 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-65de30f5-d3cb-4a9b-9f2d-d45e067cc30e None None] MFA Rules not processed for user `a00b6b9e5f8b4cceb8a3197e0349fa65`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:36.509203 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-65de30f5-d3cb-4a9b-9f2d-d45e067cc30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:36.570673 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:36.581148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1224/2448] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:00:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:37.824173 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5a368-8a86-4e74-bb7b-0e3551697291 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:37.824644 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5a368-8a86-4e74-bb7b-0e3551697291 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:37.824872 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5a368-8a86-4e74-bb7b-0e3551697291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:37.856402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-abb5a368-8a86-4e74-bb7b-0e3551697291 None None] MFA Rules not processed for user `2984a1ad28044641bff1d12fa7de7851`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:37.858039 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-abb5a368-8a86-4e74-bb7b-0e3551697291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:37.884716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1225/2449] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:00:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:47.849641 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=35 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:51.152859 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de30f5-d3cb-4a9b-9f2d-d45e067cc30e None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:51.167849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de30f5-d3cb-4a9b-9f2d-d45e067cc30e None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:51.174815 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb185933-baf8-4d0b-bbca-c37f80217e8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:51.175580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb185933-baf8-4d0b-bbca-c37f80217e8a service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:51.175931 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb185933-baf8-4d0b-bbca-c37f80217e8a service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:51.176278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb185933-baf8-4d0b-bbca-c37f80217e8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:51.178237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-fb185933-baf8-4d0b-bbca-c37f80217e8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:51.256889 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb185933-baf8-4d0b-bbca-c37f80217e8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:51.258941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb185933-baf8-4d0b-bbca-c37f80217e8a service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:51.271328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1225/2450] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:00:53.008673 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5a368-8a86-4e74-bb7b-0e3551697291 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:53.020973 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5a368-8a86-4e74-bb7b-0e3551697291 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:53.031073 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afb73a-aedf-4c27-b8cf-7389efee4e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:53.032082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afb73a-aedf-4c27-b8cf-7389efee4e29 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:53.032602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afb73a-aedf-4c27-b8cf-7389efee4e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:53.034180 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afb73a-aedf-4c27-b8cf-7389efee4e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:53.036203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-29afb73a-aedf-4c27-b8cf-7389efee4e29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:53.047583 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afb73a-aedf-4c27-b8cf-7389efee4e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:53.049473 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afb73a-aedf-4c27-b8cf-7389efee4e29 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:53.059305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1226/2451] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:00:59.651395 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb185933-baf8-4d0b-bbca-c37f80217e8a service nova] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:59.652973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-fb185933-baf8-4d0b-bbca-c37f80217e8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:59.666113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb185933-baf8-4d0b-bbca-c37f80217e8a service nova] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:59.670458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f94f59-2ee9-44a4-83a2-b3e0ddde9e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:59.671067 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f94f59-2ee9-44a4-83a2-b3e0ddde9e79 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:59.671339 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f94f59-2ee9-44a4-83a2-b3e0ddde9e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:59.671607 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f94f59-2ee9-44a4-83a2-b3e0ddde9e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:59.673630 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b1f94f59-2ee9-44a4-83a2-b3e0ddde9e79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:59.682918 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f94f59-2ee9-44a4-83a2-b3e0ddde9e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:59.684362 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f94f59-2ee9-44a4-83a2-b3e0ddde9e79 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:59.692527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1226/2452] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:00:59.837162 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea03b53-2ed7-4141-81de-caddfd8ad1f2 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:59.837696 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea03b53-2ed7-4141-81de-caddfd8ad1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:59.837795 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea03b53-2ed7-4141-81de-caddfd8ad1f2 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:59.839085 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1227/2453] 10.222.0.96 () {54 vars in 921 bytes} [Thu Jul 28 18:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:59.845543 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1825db6-ceab-4377-8683-6823a92bac37 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:59.845926 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1825db6-ceab-4377-8683-6823a92bac37 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:59.846262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1825db6-ceab-4377-8683-6823a92bac37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:59.868197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-c1825db6-ceab-4377-8683-6823a92bac37 None None] MFA Rules not processed for user `76add49d4be940ad846d32fa16431988`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:59.869548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-c1825db6-ceab-4377-8683-6823a92bac37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:59.876359 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1227/2454] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Jul 28 18:00:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:59.891021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea03b53-2ed7-4141-81de-caddfd8ad1f2 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:59.903277 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea03b53-2ed7-4141-81de-caddfd8ad1f2 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:59.908400 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049aaf84-4ec0-4cf3-8703-67897240488c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:59.909046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049aaf84-4ec0-4cf3-8703-67897240488c service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:59.909350 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049aaf84-4ec0-4cf3-8703-67897240488c service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:59.909619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049aaf84-4ec0-4cf3-8703-67897240488c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:59.917430 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049aaf84-4ec0-4cf3-8703-67897240488c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:59.918903 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049aaf84-4ec0-4cf3-8703-67897240488c service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:59.927883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1228/2455] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:01:00.036785 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c208a03-97f3-4804-896e-a68f203d596a None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:00.037036 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c208a03-97f3-4804-896e-a68f203d596a None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:00.037773 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c208a03-97f3-4804-896e-a68f203d596a None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:00.038732 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1228/2456] 10.222.0.96 () {54 vars in 921 bytes} [Thu Jul 28 18:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:01:00.044832 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159b0b4-22d3-46ae-aa08-bdf78e37c357 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:00.045140 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159b0b4-22d3-46ae-aa08-bdf78e37c357 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:00.045416 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159b0b4-22d3-46ae-aa08-bdf78e37c357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:00.066555 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-0159b0b4-22d3-46ae-aa08-bdf78e37c357 None None] MFA Rules not processed for user `5ac367247aa54671ae5c33d251017470`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:00.067685 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0159b0b4-22d3-46ae-aa08-bdf78e37c357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:00.077517 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1229/2457] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Jul 28 18:01:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:00.090039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c208a03-97f3-4804-896e-a68f203d596a None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:00.103643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c208a03-97f3-4804-896e-a68f203d596a None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:00.107220 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187057a2-29da-41c6-ad19-d1aea419c50e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:00.107848 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187057a2-29da-41c6-ad19-d1aea419c50e service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:00.108229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187057a2-29da-41c6-ad19-d1aea419c50e service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:00.108521 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187057a2-29da-41c6-ad19-d1aea419c50e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:00.121389 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187057a2-29da-41c6-ad19-d1aea419c50e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:00.122895 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187057a2-29da-41c6-ad19-d1aea419c50e service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:00.135688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1229/2458] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:00.205902 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159b0b4-22d3-46ae-aa08-bdf78e37c357 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:00.208223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0159b0b4-22d3-46ae-aa08-bdf78e37c357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:00.289333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159b0b4-22d3-46ae-aa08-bdf78e37c357 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:00.295499 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958340c-3df2-463d-8b01-aff712d5e1a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38257735924d44488e1407fefb886324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:00.296141 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958340c-3df2-463d-8b01-aff712d5e1a5 service placement] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:00.296414 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958340c-3df2-463d-8b01-aff712d5e1a5 service placement] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:00.296682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958340c-3df2-463d-8b01-aff712d5e1a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:00.298813 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a958340c-3df2-463d-8b01-aff712d5e1a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:00.311652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958340c-3df2-463d-8b01-aff712d5e1a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:00.313712 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958340c-3df2-463d-8b01-aff712d5e1a5 service placement] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:00.325373 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1230/2459] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:07.294345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187057a2-29da-41c6-ad19-d1aea419c50e service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:07.296415 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-187057a2-29da-41c6-ad19-d1aea419c50e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:07.312156 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187057a2-29da-41c6-ad19-d1aea419c50e service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:07.318667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37a0ca-d517-408c-bc81-dbc5eefa2508 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:07.319467 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37a0ca-d517-408c-bc81-dbc5eefa2508 service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:07.319732 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37a0ca-d517-408c-bc81-dbc5eefa2508 service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:07.320026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37a0ca-d517-408c-bc81-dbc5eefa2508 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:07.321959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-0a37a0ca-d517-408c-bc81-dbc5eefa2508 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:07.335246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37a0ca-d517-408c-bc81-dbc5eefa2508 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:07.337203 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37a0ca-d517-408c-bc81-dbc5eefa2508 service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:07.351089 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1230/2460] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:10.320501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=47 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:12.810652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958340c-3df2-463d-8b01-aff712d5e1a5 service placement] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:12.820551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958340c-3df2-463d-8b01-aff712d5e1a5 service placement] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:12.824530 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20678b7c-015d-482c-8139-2239e08542f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:12.825187 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20678b7c-015d-482c-8139-2239e08542f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:12.825442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20678b7c-015d-482c-8139-2239e08542f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:12.825749 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20678b7c-015d-482c-8139-2239e08542f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:12.827831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-20678b7c-015d-482c-8139-2239e08542f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:12.841512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20678b7c-015d-482c-8139-2239e08542f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:12.842944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20678b7c-015d-482c-8139-2239e08542f5 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:12.853046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1231/2461] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:16.061273 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37a0ca-d517-408c-bc81-dbc5eefa2508 service nova] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:16.062845 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-0a37a0ca-d517-408c-bc81-dbc5eefa2508 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:16.080467 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37a0ca-d517-408c-bc81-dbc5eefa2508 service nova] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:16.085735 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e49a82-982e-47ab-964c-76e5d51bac8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:16.086400 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e49a82-982e-47ab-964c-76e5d51bac8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:16.086680 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e49a82-982e-47ab-964c-76e5d51bac8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:16.086955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e49a82-982e-47ab-964c-76e5d51bac8b admin admin] PATH_INFO: `/v3/users/d2a83fb7509446c3a342ea635eccf04d` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:16.088152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e49a82-982e-47ab-964c-76e5d51bac8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2a83fb7509446c3a342ea635eccf04d)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:16.090170 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e49a82-982e-47ab-964c-76e5d51bac8b admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:16.146068 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-18e49a82-982e-47ab-964c-76e5d51bac8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2a83fb7509446c3a342ea635eccf04d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:16.159605 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-18e49a82-982e-47ab-964c-76e5d51bac8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2a83fb7509446c3a342ea635eccf04d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:16.168375 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-18e49a82-982e-47ab-964c-76e5d51bac8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2a83fb7509446c3a342ea635eccf04d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:16.175303 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-18e49a82-982e-47ab-964c-76e5d51bac8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2a83fb7509446c3a342ea635eccf04d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:16.175984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-18e49a82-982e-47ab-964c-76e5d51bac8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2a83fb7509446c3a342ea635eccf04d'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:16.182011 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1231/2462] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:01:16 2022] DELETE /identity/v3/users/d2a83fb7509446c3a342ea635eccf04d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:16.635521 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20678b7c-015d-482c-8139-2239e08542f5 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:16.648103 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20678b7c-015d-482c-8139-2239e08542f5 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:16.709209 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a66c40-b806-40b0-b87a-2b31d63eca73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:16.709854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a66c40-b806-40b0-b87a-2b31d63eca73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:16.710135 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a66c40-b806-40b0-b87a-2b31d63eca73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:16.710403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a66c40-b806-40b0-b87a-2b31d63eca73 admin admin] PATH_INFO: `/v3/projects/e425fa77bd3143ddb6b6d10888c2ff51` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:16.711689 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a66c40-b806-40b0-b87a-2b31d63eca73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e425fa77bd3143ddb6b6d10888c2ff51)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:16.713652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a66c40-b806-40b0-b87a-2b31d63eca73 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:16.768645 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-27a66c40-b806-40b0-b87a-2b31d63eca73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e425fa77bd3143ddb6b6d10888c2ff51', 'request_id': 'req-27a66c40-b806-40b0-b87a-2b31d63eca73'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:16.775119 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-27a66c40-b806-40b0-b87a-2b31d63eca73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e425fa77bd3143ddb6b6d10888c2ff51', 'request_id': 'req-27a66c40-b806-40b0-b87a-2b31d63eca73'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:16.786048 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-27a66c40-b806-40b0-b87a-2b31d63eca73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e425fa77bd3143ddb6b6d10888c2ff51', 'request_id': 'req-27a66c40-b806-40b0-b87a-2b31d63eca73'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:16.798321 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-27a66c40-b806-40b0-b87a-2b31d63eca73 admin admin] The token cache is being invalidate because project e425fa77bd3143ddb6b6d10888c2ff51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:01:16.798605 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-27a66c40-b806-40b0-b87a-2b31d63eca73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:16.799301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-27a66c40-b806-40b0-b87a-2b31d63eca73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:16.801006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1232/2463] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:01:16 2022] DELETE /identity/v3/projects/e425fa77bd3143ddb6b6d10888c2ff51 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:16.807872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29272e19-8631-46c1-9736-a8b4565c4819 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:16.808101 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29272e19-8631-46c1-9736-a8b4565c4819 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:16.808372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29272e19-8631-46c1-9736-a8b4565c4819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:16.816302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:16.832232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-29272e19-8631-46c1-9736-a8b4565c4819 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:16.833437 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-29272e19-8631-46c1-9736-a8b4565c4819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:16.896134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1232/2464] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:16.904301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1192557-f8b7-419c-88bc-bc0a3d499886 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:16.904591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1192557-f8b7-419c-88bc-bc0a3d499886 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:16.904869 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1192557-f8b7-419c-88bc-bc0a3d499886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:16.925208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a1192557-f8b7-419c-88bc-bc0a3d499886 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:16.926620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a1192557-f8b7-419c-88bc-bc0a3d499886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:16.935410 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1233/2465] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:16.942331 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29272e19-8631-46c1-9736-a8b4565c4819 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:16.952435 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29272e19-8631-46c1-9736-a8b4565c4819 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:16.957995 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83839c-c776-4c43-b9a2-e2e6b1cf198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:16.958605 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83839c-c776-4c43-b9a2-e2e6b1cf198b admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:16.958883 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83839c-c776-4c43-b9a2-e2e6b1cf198b admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:16.959165 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83839c-c776-4c43-b9a2-e2e6b1cf198b admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:16.959851 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83839c-c776-4c43-b9a2-e2e6b1cf198b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:01:16.960149 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83839c-c776-4c43-b9a2-e2e6b1cf198b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:16.961832 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83839c-c776-4c43-b9a2-e2e6b1cf198b admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:16.973513 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1233/2466] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 18:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:01:16.978126 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1192557-f8b7-419c-88bc-bc0a3d499886 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:16.987649 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1192557-f8b7-419c-88bc-bc0a3d499886 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:16.994053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee2a13-d7b2-4dcb-a7ac-8c25158d63a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:16.994663 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee2a13-d7b2-4dcb-a7ac-8c25158d63a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:16.994942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee2a13-d7b2-4dcb-a7ac-8c25158d63a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:16.995213 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee2a13-d7b2-4dcb-a7ac-8c25158d63a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:16.995869 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee2a13-d7b2-4dcb-a7ac-8c25158d63a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:16.997814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee2a13-d7b2-4dcb-a7ac-8c25158d63a1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:17.029038 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1234/2467] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:01:16 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:01:17.033421 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83839c-c776-4c43-b9a2-e2e6b1cf198b admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:17.044106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83839c-c776-4c43-b9a2-e2e6b1cf198b admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:17.110140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530a622-97cf-464f-8aa9-586abbbd99e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:17.110772 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530a622-97cf-464f-8aa9-586abbbd99e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:17.111063 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530a622-97cf-464f-8aa9-586abbbd99e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:17.111322 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530a622-97cf-464f-8aa9-586abbbd99e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:17.111986 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530a622-97cf-464f-8aa9-586abbbd99e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:17.114010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530a622-97cf-464f-8aa9-586abbbd99e7 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:17.137036 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1234/2468] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:01:17 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:01:17.141313 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee2a13-d7b2-4dcb-a7ac-8c25158d63a1 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:17.152313 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee2a13-d7b2-4dcb-a7ac-8c25158d63a1 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:17.157537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7e255-94cb-4f5d-8b7b-4e7fbb3feb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:17.158172 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7e255-94cb-4f5d-8b7b-4e7fbb3feb9c admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:17.158591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7e255-94cb-4f5d-8b7b-4e7fbb3feb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:17.158861 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7e255-94cb-4f5d-8b7b-4e7fbb3feb9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:17.159723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7e255-94cb-4f5d-8b7b-4e7fbb3feb9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:17.161446 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7e255-94cb-4f5d-8b7b-4e7fbb3feb9c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:17.172658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1235/2469] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:01:17.177660 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530a622-97cf-464f-8aa9-586abbbd99e7 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:17.188711 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530a622-97cf-464f-8aa9-586abbbd99e7 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:17.193897 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5fb99-854c-4490-893c-065aa2acc6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:17.194515 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5fb99-854c-4490-893c-065aa2acc6ad admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:17.194796 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5fb99-854c-4490-893c-065aa2acc6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:17.195098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5fb99-854c-4490-893c-065aa2acc6ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:17.195802 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5fb99-854c-4490-893c-065aa2acc6ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:17.197482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5fb99-854c-4490-893c-065aa2acc6ad admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:17.209287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1235/2470] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:17.213582 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7e255-94cb-4f5d-8b7b-4e7fbb3feb9c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:17.223936 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7e255-94cb-4f5d-8b7b-4e7fbb3feb9c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:17.229597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16746e4b-4eef-40bb-890e-634908dc1bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:17.230250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16746e4b-4eef-40bb-890e-634908dc1bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:17.230534 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16746e4b-4eef-40bb-890e-634908dc1bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:17.230812 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16746e4b-4eef-40bb-890e-634908dc1bc0 admin admin] PATH_INFO: `/v3/projects/f05b57cbb9384623a5268512b4fcc87d/users/47cbb2a22ca0402f96e7776fcdbbea37/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:17.247125 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16746e4b-4eef-40bb-890e-634908dc1bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f05b57cbb9384623a5268512b4fcc87d, user_id=47cbb2a22ca0402f96e7776fcdbbea37, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:17.249818 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16746e4b-4eef-40bb-890e-634908dc1bc0 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:17.265273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1236/2471] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:01:17 2022] PUT /identity/v3/projects/f05b57cbb9384623a5268512b4fcc87d/users/47cbb2a22ca0402f96e7776fcdbbea37/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:17.275965 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0f7b3-5e31-4137-8ff8-9400cadd8718 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:17.276243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0f7b3-5e31-4137-8ff8-9400cadd8718 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:17.276523 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0f7b3-5e31-4137-8ff8-9400cadd8718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:17.305489 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-8ab0f7b3-5e31-4137-8ff8-9400cadd8718 None None] MFA Rules not processed for user `47cbb2a22ca0402f96e7776fcdbbea37`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:17.306748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-8ab0f7b3-5e31-4137-8ff8-9400cadd8718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:17.372745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:17.378781 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1236/2472] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:17.383550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16746e4b-4eef-40bb-890e-634908dc1bc0 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:17.397942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:17.455456 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16746e4b-4eef-40bb-890e-634908dc1bc0 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:17.460532 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395ed84-a7c0-4ff3-bbc9-69530684942b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:17.461186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395ed84-a7c0-4ff3-bbc9-69530684942b admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:17.461480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395ed84-a7c0-4ff3-bbc9-69530684942b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:17.461734 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395ed84-a7c0-4ff3-bbc9-69530684942b admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:17.462384 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395ed84-a7c0-4ff3-bbc9-69530684942b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:17.464286 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395ed84-a7c0-4ff3-bbc9-69530684942b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:17.494646 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1237/2473] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:01:17 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:01:17.500267 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0f7b3-5e31-4137-8ff8-9400cadd8718 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:17.511766 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0f7b3-5e31-4137-8ff8-9400cadd8718 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:17.568891 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971933da-8a71-4eb5-af09-deaa16495ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:17.569540 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971933da-8a71-4eb5-af09-deaa16495ccf admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:17.569815 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971933da-8a71-4eb5-af09-deaa16495ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:17.570085 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971933da-8a71-4eb5-af09-deaa16495ccf admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:17.570741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971933da-8a71-4eb5-af09-deaa16495ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:17.572670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971933da-8a71-4eb5-af09-deaa16495ccf admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:17.594547 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1237/2474] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:01:17 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:01:17.598871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395ed84-a7c0-4ff3-bbc9-69530684942b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:17.609711 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395ed84-a7c0-4ff3-bbc9-69530684942b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:17.615699 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c7f66-8eb4-4d6b-9d49-c0738d09fb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:17.616934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c7f66-8eb4-4d6b-9d49-c0738d09fb49 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:17.617258 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c7f66-8eb4-4d6b-9d49-c0738d09fb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:17.617534 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c7f66-8eb4-4d6b-9d49-c0738d09fb49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:17.618262 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c7f66-8eb4-4d6b-9d49-c0738d09fb49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:17.619884 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c7f66-8eb4-4d6b-9d49-c0738d09fb49 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:17.630847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1238/2475] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:17.635206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971933da-8a71-4eb5-af09-deaa16495ccf admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:17.648530 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971933da-8a71-4eb5-af09-deaa16495ccf admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:17.654662 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872945d-8767-475c-9f62-0aa5cf398434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:17.655328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872945d-8767-475c-9f62-0aa5cf398434 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:17.655608 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872945d-8767-475c-9f62-0aa5cf398434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:17.655882 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872945d-8767-475c-9f62-0aa5cf398434 admin admin] PATH_INFO: `/v3/projects/b0a52d6b362c465b8f7788d2c65fc30c/users/c25c8e23190444d8ae6125309ed7091a/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:17.671949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872945d-8767-475c-9f62-0aa5cf398434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a52d6b362c465b8f7788d2c65fc30c, user_id=c25c8e23190444d8ae6125309ed7091a, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:17.674634 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872945d-8767-475c-9f62-0aa5cf398434 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:17.689802 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1238/2476] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:01:17 2022] PUT /identity/v3/projects/b0a52d6b362c465b8f7788d2c65fc30c/users/c25c8e23190444d8ae6125309ed7091a/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:17.693961 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c7f66-8eb4-4d6b-9d49-c0738d09fb49 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:17.703963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c7f66-8eb4-4d6b-9d49-c0738d09fb49 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:17.770844 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb251341-8246-4043-830f-a6b8acf78213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:17.771455 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb251341-8246-4043-830f-a6b8acf78213 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:17.771736 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb251341-8246-4043-830f-a6b8acf78213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:17.772009 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb251341-8246-4043-830f-a6b8acf78213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:17.772710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb251341-8246-4043-830f-a6b8acf78213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:17.774333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb251341-8246-4043-830f-a6b8acf78213 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:17.784404 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1239/2477] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:17.789309 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872945d-8767-475c-9f62-0aa5cf398434 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:17.799887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872945d-8767-475c-9f62-0aa5cf398434 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:17.805118 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f0f0d-4e25-48de-ad54-78d84ca42e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:17.805772 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f0f0d-4e25-48de-ad54-78d84ca42e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:17.806051 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f0f0d-4e25-48de-ad54-78d84ca42e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:17.806321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f0f0d-4e25-48de-ad54-78d84ca42e4d admin admin] PATH_INFO: `/v3/projects/b0a52d6b362c465b8f7788d2c65fc30c/users/c25c8e23190444d8ae6125309ed7091a/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:17.808312 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f0f0d-4e25-48de-ad54-78d84ca42e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a52d6b362c465b8f7788d2c65fc30c, user_id=c25c8e23190444d8ae6125309ed7091a, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:17.810991 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f0f0d-4e25-48de-ad54-78d84ca42e4d admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:17.821582 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1239/2478] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:01:17 2022] PUT /identity/v3/projects/b0a52d6b362c465b8f7788d2c65fc30c/users/c25c8e23190444d8ae6125309ed7091a/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:17.834456 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5777a-d785-4298-adc6-d7db00811f8d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:17.834742 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5777a-d785-4298-adc6-d7db00811f8d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:17.835015 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5777a-d785-4298-adc6-d7db00811f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:17.871835 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e1e5777a-d785-4298-adc6-d7db00811f8d None None] MFA Rules not processed for user `c25c8e23190444d8ae6125309ed7091a`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:17.873041 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e1e5777a-d785-4298-adc6-d7db00811f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:17.948141 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1240/2479] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:17 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:17.961596 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f0f0d-4e25-48de-ad54-78d84ca42e4d admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:17.963938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e35f0f0d-4e25-48de-ad54-78d84ca42e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:18.034351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f0f0d-4e25-48de-ad54-78d84ca42e4d admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:18.038452 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97080212-2689-43c5-8bff-b1da3c60947d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:18.039069 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97080212-2689-43c5-8bff-b1da3c60947d service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:18.039352 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97080212-2689-43c5-8bff-b1da3c60947d service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:18.039621 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97080212-2689-43c5-8bff-b1da3c60947d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:18.049260 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97080212-2689-43c5-8bff-b1da3c60947d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:18.050688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97080212-2689-43c5-8bff-b1da3c60947d service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:18.060129 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1240/2480] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:17 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:18.499580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5777a-d785-4298-adc6-d7db00811f8d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:18.512064 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:18.568186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5777a-d785-4298-adc6-d7db00811f8d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:18.573269 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6f282-c504-407b-8753-d0c8f833fa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:18.573927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6f282-c504-407b-8753-d0c8f833fa3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:18.574212 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6f282-c504-407b-8753-d0c8f833fa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:18.574494 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6f282-c504-407b-8753-d0c8f833fa3b admin admin] PATH_INFO: `/v3/users/47cbb2a22ca0402f96e7776fcdbbea37` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:18.575727 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6f282-c504-407b-8753-d0c8f833fa3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=47cbb2a22ca0402f96e7776fcdbbea37)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:18.577679 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6f282-c504-407b-8753-d0c8f833fa3b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:18.629720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-37c6f282-c504-407b-8753-d0c8f833fa3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47cbb2a22ca0402f96e7776fcdbbea37'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:18.630375 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-37c6f282-c504-407b-8753-d0c8f833fa3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47cbb2a22ca0402f96e7776fcdbbea37'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:18.639107 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-37c6f282-c504-407b-8753-d0c8f833fa3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47cbb2a22ca0402f96e7776fcdbbea37'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:18.657974 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-37c6f282-c504-407b-8753-d0c8f833fa3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47cbb2a22ca0402f96e7776fcdbbea37'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:18.658706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-37c6f282-c504-407b-8753-d0c8f833fa3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47cbb2a22ca0402f96e7776fcdbbea37'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:18.674499 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1241/2481] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:01:18 2022] DELETE /identity/v3/users/47cbb2a22ca0402f96e7776fcdbbea37 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:18.680056 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a256cae-4936-4670-bec2-38ebe5130e4e None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:18.680547 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a256cae-4936-4670-bec2-38ebe5130e4e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:18.680643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a256cae-4936-4670-bec2-38ebe5130e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:18.701040 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-9a256cae-4936-4670-bec2-38ebe5130e4e None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:18.702287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9a256cae-4936-4670-bec2-38ebe5130e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:18.754959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:18.768178 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1241/2482] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:18.778196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6f282-c504-407b-8753-d0c8f833fa3b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:18.779672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-37c6f282-c504-407b-8753-d0c8f833fa3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:18.844439 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6f282-c504-407b-8753-d0c8f833fa3b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:18.848804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ba6a6-3939-42a1-9097-adf1b6533123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:18.849470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ba6a6-3939-42a1-9097-adf1b6533123 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:18.849751 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ba6a6-3939-42a1-9097-adf1b6533123 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:18.850024 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ba6a6-3939-42a1-9097-adf1b6533123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:18.861559 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ba6a6-3939-42a1-9097-adf1b6533123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:18.863391 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ba6a6-3939-42a1-9097-adf1b6533123 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:18.873464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1242/2483] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:19.215072 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a256cae-4936-4670-bec2-38ebe5130e4e None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:19.216635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9a256cae-4936-4670-bec2-38ebe5130e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:19.234485 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a256cae-4936-4670-bec2-38ebe5130e4e None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:19.241116 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38657377-cad9-46c0-9571-daf6d17fa6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:19.242605 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38657377-cad9-46c0-9571-daf6d17fa6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:19.243061 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38657377-cad9-46c0-9571-daf6d17fa6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:19.243351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38657377-cad9-46c0-9571-daf6d17fa6a0 admin admin] PATH_INFO: `/v3/projects/f05b57cbb9384623a5268512b4fcc87d` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:19.244605 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38657377-cad9-46c0-9571-daf6d17fa6a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f05b57cbb9384623a5268512b4fcc87d)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:19.246596 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38657377-cad9-46c0-9571-daf6d17fa6a0 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:19.313742 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-38657377-cad9-46c0-9571-daf6d17fa6a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f05b57cbb9384623a5268512b4fcc87d', 'request_id': 'req-38657377-cad9-46c0-9571-daf6d17fa6a0'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:19.324353 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-38657377-cad9-46c0-9571-daf6d17fa6a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f05b57cbb9384623a5268512b4fcc87d', 'request_id': 'req-38657377-cad9-46c0-9571-daf6d17fa6a0'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:19.333732 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-38657377-cad9-46c0-9571-daf6d17fa6a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f05b57cbb9384623a5268512b4fcc87d', 'request_id': 'req-38657377-cad9-46c0-9571-daf6d17fa6a0'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:19.351864 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-38657377-cad9-46c0-9571-daf6d17fa6a0 admin admin] The token cache is being invalidate because project f05b57cbb9384623a5268512b4fcc87d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:01:19.352267 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-38657377-cad9-46c0-9571-daf6d17fa6a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:19.353551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-38657377-cad9-46c0-9571-daf6d17fa6a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:19.356135 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1242/2484] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:01:19 2022] DELETE /identity/v3/projects/f05b57cbb9384623a5268512b4fcc87d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:19.362464 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ba6a6-3939-42a1-9097-adf1b6533123 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:19.373363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ba6a6-3939-42a1-9097-adf1b6533123 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:19.415821 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:19.449281 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7de72-23bd-4dcb-8f02-47361a1358ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:19.449957 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7de72-23bd-4dcb-8f02-47361a1358ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:19.450319 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7de72-23bd-4dcb-8f02-47361a1358ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:19.450501 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7de72-23bd-4dcb-8f02-47361a1358ed admin admin] PATH_INFO: `/v3/users/c25c8e23190444d8ae6125309ed7091a` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:19.451715 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7de72-23bd-4dcb-8f02-47361a1358ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=c25c8e23190444d8ae6125309ed7091a)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:19.453720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7de72-23bd-4dcb-8f02-47361a1358ed admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:19.521277 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8fc7de72-23bd-4dcb-8f02-47361a1358ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c25c8e23190444d8ae6125309ed7091a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:19.522017 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8fc7de72-23bd-4dcb-8f02-47361a1358ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c25c8e23190444d8ae6125309ed7091a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:19.540209 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8fc7de72-23bd-4dcb-8f02-47361a1358ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c25c8e23190444d8ae6125309ed7091a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:19.561169 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8fc7de72-23bd-4dcb-8f02-47361a1358ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c25c8e23190444d8ae6125309ed7091a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:19.561992 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8fc7de72-23bd-4dcb-8f02-47361a1358ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c25c8e23190444d8ae6125309ed7091a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:19.583488 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1243/2485] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:01:19 2022] DELETE /identity/v3/users/c25c8e23190444d8ae6125309ed7091a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:19.927718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38657377-cad9-46c0-9571-daf6d17fa6a0 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:19.929386 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-38657377-cad9-46c0-9571-daf6d17fa6a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:19.942975 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38657377-cad9-46c0-9571-daf6d17fa6a0 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:20.004119 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc8a8b-6819-4f36-bfff-1b76f0ecbee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:20.004686 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc8a8b-6819-4f36-bfff-1b76f0ecbee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:20.004959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc8a8b-6819-4f36-bfff-1b76f0ecbee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:20.005264 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc8a8b-6819-4f36-bfff-1b76f0ecbee0 admin admin] PATH_INFO: `/v3/projects/b0a52d6b362c465b8f7788d2c65fc30c` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:20.006496 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc8a8b-6819-4f36-bfff-1b76f0ecbee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0a52d6b362c465b8f7788d2c65fc30c)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:20.008469 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc8a8b-6819-4f36-bfff-1b76f0ecbee0 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:20.057053 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c8cc8a8b-6819-4f36-bfff-1b76f0ecbee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0a52d6b362c465b8f7788d2c65fc30c', 'request_id': 'req-c8cc8a8b-6819-4f36-bfff-1b76f0ecbee0'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:20.064866 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c8cc8a8b-6819-4f36-bfff-1b76f0ecbee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0a52d6b362c465b8f7788d2c65fc30c', 'request_id': 'req-c8cc8a8b-6819-4f36-bfff-1b76f0ecbee0'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:20.071268 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c8cc8a8b-6819-4f36-bfff-1b76f0ecbee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0a52d6b362c465b8f7788d2c65fc30c', 'request_id': 'req-c8cc8a8b-6819-4f36-bfff-1b76f0ecbee0'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:20.081840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c8cc8a8b-6819-4f36-bfff-1b76f0ecbee0 admin admin] The token cache is being invalidate because project b0a52d6b362c465b8f7788d2c65fc30c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:01:20.082248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c8cc8a8b-6819-4f36-bfff-1b76f0ecbee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:20.083107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c8cc8a8b-6819-4f36-bfff-1b76f0ecbee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:20.084753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1243/2486] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:01:19 2022] DELETE /identity/v3/projects/b0a52d6b362c465b8f7788d2c65fc30c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:20.090149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772b87f-68ab-45d7-a836-e02e14353e0d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:20.090648 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772b87f-68ab-45d7-a836-e02e14353e0d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:20.090771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772b87f-68ab-45d7-a836-e02e14353e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:20.110277 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f772b87f-68ab-45d7-a836-e02e14353e0d None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:20.111473 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f772b87f-68ab-45d7-a836-e02e14353e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:20.183603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1244/2487] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:20.191913 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b451006-67c1-4039-9590-25fc4745a12a None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:20.192240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b451006-67c1-4039-9590-25fc4745a12a None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:20.192531 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b451006-67c1-4039-9590-25fc4745a12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:20.208492 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:20.214508 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-4b451006-67c1-4039-9590-25fc4745a12a None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:20.216406 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-4b451006-67c1-4039-9590-25fc4745a12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:20.226035 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1244/2488] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:20.230572 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772b87f-68ab-45d7-a836-e02e14353e0d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:20.241824 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772b87f-68ab-45d7-a836-e02e14353e0d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:20.247022 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a3e43-de07-412a-98c7-00f9ed3034ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:20.247653 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a3e43-de07-412a-98c7-00f9ed3034ba admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:20.247934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a3e43-de07-412a-98c7-00f9ed3034ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:20.248202 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a3e43-de07-412a-98c7-00f9ed3034ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:20.248899 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a3e43-de07-412a-98c7-00f9ed3034ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:01:20.249249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a3e43-de07-412a-98c7-00f9ed3034ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:20.250890 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a3e43-de07-412a-98c7-00f9ed3034ba admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:20.264650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1245/2489] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 18:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:01:20.269302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b451006-67c1-4039-9590-25fc4745a12a None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:20.279013 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b451006-67c1-4039-9590-25fc4745a12a None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:20.284317 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77046755-ee52-4a61-bcb0-4f8bf3aa9077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:20.284930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77046755-ee52-4a61-bcb0-4f8bf3aa9077 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:20.285238 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77046755-ee52-4a61-bcb0-4f8bf3aa9077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:20.285525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77046755-ee52-4a61-bcb0-4f8bf3aa9077 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:20.286203 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77046755-ee52-4a61-bcb0-4f8bf3aa9077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:20.288113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77046755-ee52-4a61-bcb0-4f8bf3aa9077 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:20.317724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1245/2490] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:01:20 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:01:20.323446 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a3e43-de07-412a-98c7-00f9ed3034ba admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:20.334545 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a3e43-de07-412a-98c7-00f9ed3034ba admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:20.369021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:20.397742 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91372599-c8dc-46ea-8fb5-52c1ff75597f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:20.398359 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91372599-c8dc-46ea-8fb5-52c1ff75597f admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:20.398635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91372599-c8dc-46ea-8fb5-52c1ff75597f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:20.398929 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91372599-c8dc-46ea-8fb5-52c1ff75597f admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:20.399598 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91372599-c8dc-46ea-8fb5-52c1ff75597f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:20.401583 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91372599-c8dc-46ea-8fb5-52c1ff75597f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:20.428182 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1246/2491] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:01:20 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:01:20.434213 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77046755-ee52-4a61-bcb0-4f8bf3aa9077 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:20.445828 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77046755-ee52-4a61-bcb0-4f8bf3aa9077 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:20.452027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a89544-1887-47a2-b453-8f896e6c9bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:20.452909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a89544-1887-47a2-b453-8f896e6c9bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:20.453293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a89544-1887-47a2-b453-8f896e6c9bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:20.453640 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a89544-1887-47a2-b453-8f896e6c9bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:20.454762 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a89544-1887-47a2-b453-8f896e6c9bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:20.456744 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a89544-1887-47a2-b453-8f896e6c9bc7 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:20.467526 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1246/2492] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:20.471685 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91372599-c8dc-46ea-8fb5-52c1ff75597f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:20.482040 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91372599-c8dc-46ea-8fb5-52c1ff75597f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:20.486890 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5711f0-8656-443b-8663-94dbe148bba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:20.487490 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5711f0-8656-443b-8663-94dbe148bba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:20.487765 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5711f0-8656-443b-8663-94dbe148bba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:20.488035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5711f0-8656-443b-8663-94dbe148bba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:20.488792 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5711f0-8656-443b-8663-94dbe148bba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:20.490946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5711f0-8656-443b-8663-94dbe148bba5 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:20.501867 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1247/2493] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:20.506739 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a89544-1887-47a2-b453-8f896e6c9bc7 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:20.520548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a89544-1887-47a2-b453-8f896e6c9bc7 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:20.526443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909deab-3aa4-4d4e-b6cd-cad861b8c2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:20.527141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909deab-3aa4-4d4e-b6cd-cad861b8c2ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:20.527417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909deab-3aa4-4d4e-b6cd-cad861b8c2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:20.527692 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909deab-3aa4-4d4e-b6cd-cad861b8c2ab admin admin] PATH_INFO: `/v3/projects/b5f45b6153884eefb3a97ef2103ed649/users/14fb8ce35c1645e3b64698e2cb09cacd/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:20.543051 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909deab-3aa4-4d4e-b6cd-cad861b8c2ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f45b6153884eefb3a97ef2103ed649, user_id=14fb8ce35c1645e3b64698e2cb09cacd, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:20.545802 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909deab-3aa4-4d4e-b6cd-cad861b8c2ab admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:20.562768 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1247/2494] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:01:20 2022] PUT /identity/v3/projects/b5f45b6153884eefb3a97ef2103ed649/users/14fb8ce35c1645e3b64698e2cb09cacd/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:20.575244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96df19e-3a88-40ae-8381-9d85e40ceb4a None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:20.575244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96df19e-3a88-40ae-8381-9d85e40ceb4a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:20.575459 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96df19e-3a88-40ae-8381-9d85e40ceb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:20.608237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f96df19e-3a88-40ae-8381-9d85e40ceb4a None None] MFA Rules not processed for user `14fb8ce35c1645e3b64698e2cb09cacd`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:20.609479 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f96df19e-3a88-40ae-8381-9d85e40ceb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:20.677719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1248/2495] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:20 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:20.682676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909deab-3aa4-4d4e-b6cd-cad861b8c2ab admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:20.747883 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909deab-3aa4-4d4e-b6cd-cad861b8c2ab admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:20.752969 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c2b61-3092-4307-aa3e-d5783bc3428b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:20.753625 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c2b61-3092-4307-aa3e-d5783bc3428b admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:20.753903 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c2b61-3092-4307-aa3e-d5783bc3428b admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:20.754188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c2b61-3092-4307-aa3e-d5783bc3428b admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:20.755156 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c2b61-3092-4307-aa3e-d5783bc3428b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:20.757007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c2b61-3092-4307-aa3e-d5783bc3428b admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:20.788555 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1248/2496] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:01:20 2022] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:01:20.792810 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96df19e-3a88-40ae-8381-9d85e40ceb4a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:20.804325 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96df19e-3a88-40ae-8381-9d85e40ceb4a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:20.868771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6664e11-a019-4f23-9485-35e7264b6060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:20.869430 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6664e11-a019-4f23-9485-35e7264b6060 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:20.869718 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6664e11-a019-4f23-9485-35e7264b6060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:20.869993 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6664e11-a019-4f23-9485-35e7264b6060 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:20.870655 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6664e11-a019-4f23-9485-35e7264b6060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:20.872581 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6664e11-a019-4f23-9485-35e7264b6060 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:20.896192 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1249/2497] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:01:20 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:01:20.900587 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c2b61-3092-4307-aa3e-d5783bc3428b admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:20.911491 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c2b61-3092-4307-aa3e-d5783bc3428b admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:20.917152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61781f8a-a199-41b5-9a40-d03a39be1cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:20.917776 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61781f8a-a199-41b5-9a40-d03a39be1cdc admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:20.918055 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61781f8a-a199-41b5-9a40-d03a39be1cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:20.918332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61781f8a-a199-41b5-9a40-d03a39be1cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:20.919065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61781f8a-a199-41b5-9a40-d03a39be1cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:20.920693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61781f8a-a199-41b5-9a40-d03a39be1cdc admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:20.932299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1249/2498] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:20.938370 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6664e11-a019-4f23-9485-35e7264b6060 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:20.955706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6664e11-a019-4f23-9485-35e7264b6060 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:20.962858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca712b10-7b68-48ab-a1cd-9b0e9116f43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:20.963519 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca712b10-7b68-48ab-a1cd-9b0e9116f43a admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:20.963796 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca712b10-7b68-48ab-a1cd-9b0e9116f43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:20.964065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca712b10-7b68-48ab-a1cd-9b0e9116f43a admin admin] PATH_INFO: `/v3/projects/4d86b6e6331044b585d06c56fc88f1e9/users/82bd8305bd5e446494973c74a5483a32/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:20.980307 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca712b10-7b68-48ab-a1cd-9b0e9116f43a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d86b6e6331044b585d06c56fc88f1e9, user_id=82bd8305bd5e446494973c74a5483a32, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:20.983000 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca712b10-7b68-48ab-a1cd-9b0e9116f43a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:21.002458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1250/2499] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:01:20 2022] PUT /identity/v3/projects/4d86b6e6331044b585d06c56fc88f1e9/users/82bd8305bd5e446494973c74a5483a32/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:21.006012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61781f8a-a199-41b5-9a40-d03a39be1cdc admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:21.017173 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61781f8a-a199-41b5-9a40-d03a39be1cdc admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:21.078104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32aad3-d791-4fee-b5d6-e85021c3399f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:21.078731 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32aad3-d791-4fee-b5d6-e85021c3399f admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:21.079013 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32aad3-d791-4fee-b5d6-e85021c3399f admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:21.079290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32aad3-d791-4fee-b5d6-e85021c3399f admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:21.079989 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32aad3-d791-4fee-b5d6-e85021c3399f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:21.081649 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32aad3-d791-4fee-b5d6-e85021c3399f admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:21.092862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1250/2500] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:21.097480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca712b10-7b68-48ab-a1cd-9b0e9116f43a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:21.109266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca712b10-7b68-48ab-a1cd-9b0e9116f43a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:21.114573 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a9490-8b61-4944-8d42-db0359cf020e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:21.115948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a9490-8b61-4944-8d42-db0359cf020e admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:21.116236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a9490-8b61-4944-8d42-db0359cf020e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:21.116515 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a9490-8b61-4944-8d42-db0359cf020e admin admin] PATH_INFO: `/v3/projects/4d86b6e6331044b585d06c56fc88f1e9/users/82bd8305bd5e446494973c74a5483a32/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:21.118702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a9490-8b61-4944-8d42-db0359cf020e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d86b6e6331044b585d06c56fc88f1e9, user_id=82bd8305bd5e446494973c74a5483a32, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:21.121390 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a9490-8b61-4944-8d42-db0359cf020e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:21.127532 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:21.134352 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1251/2501] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:01:21 2022] PUT /identity/v3/projects/4d86b6e6331044b585d06c56fc88f1e9/users/82bd8305bd5e446494973c74a5483a32/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:01:21.145776 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c9f8b-de57-4476-88dd-b441c987c07e None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:21.146068 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c9f8b-de57-4476-88dd-b441c987c07e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:21.146367 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c9f8b-de57-4476-88dd-b441c987c07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:21.172775 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:21.176477 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-339c9f8b-de57-4476-88dd-b441c987c07e None None] MFA Rules not processed for user `82bd8305bd5e446494973c74a5483a32`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:21.178958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-339c9f8b-de57-4476-88dd-b441c987c07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:21.253738 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1251/2502] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:21 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:21.265431 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a9490-8b61-4944-8d42-db0359cf020e admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:21.267446 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e27a9490-8b61-4944-8d42-db0359cf020e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:21.329489 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a9490-8b61-4944-8d42-db0359cf020e admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:21.333981 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e40ee-62dd-436f-8b4c-a942e17cf8cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:21.334603 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e40ee-62dd-436f-8b4c-a942e17cf8cd service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:21.334886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e40ee-62dd-436f-8b4c-a942e17cf8cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:21.335155 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e40ee-62dd-436f-8b4c-a942e17cf8cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:21.344736 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e40ee-62dd-436f-8b4c-a942e17cf8cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:21.346217 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e40ee-62dd-436f-8b4c-a942e17cf8cd service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:21.356100 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1252/2503] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:21 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:21.453240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c9f8b-de57-4476-88dd-b441c987c07e None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:21.463951 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c9f8b-de57-4476-88dd-b441c987c07e None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:21.467941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177e317-bb98-4a9c-810a-14014de6cf29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:21.468574 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177e317-bb98-4a9c-810a-14014de6cf29 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:21.468854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177e317-bb98-4a9c-810a-14014de6cf29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:21.469166 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177e317-bb98-4a9c-810a-14014de6cf29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:21.534546 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177e317-bb98-4a9c-810a-14014de6cf29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:21.535915 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177e317-bb98-4a9c-810a-14014de6cf29 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:21.545545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1252/2504] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:21 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:29.025785 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e40ee-62dd-436f-8b4c-a942e17cf8cd service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:29.086895 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e40ee-62dd-436f-8b4c-a942e17cf8cd service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:29.092343 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2602ed-5b05-4146-a4dd-e27acdb65f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:29.093171 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2602ed-5b05-4146-a4dd-e27acdb65f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:29.093502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2602ed-5b05-4146-a4dd-e27acdb65f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:29.093853 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2602ed-5b05-4146-a4dd-e27acdb65f5a admin admin] PATH_INFO: `/v3/users/14fb8ce35c1645e3b64698e2cb09cacd` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:29.095447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2602ed-5b05-4146-a4dd-e27acdb65f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=14fb8ce35c1645e3b64698e2cb09cacd)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:29.099273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2602ed-5b05-4146-a4dd-e27acdb65f5a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:29.159585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-0b2602ed-5b05-4146-a4dd-e27acdb65f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14fb8ce35c1645e3b64698e2cb09cacd'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:29.160639 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-0b2602ed-5b05-4146-a4dd-e27acdb65f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14fb8ce35c1645e3b64698e2cb09cacd'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:29.170438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-0b2602ed-5b05-4146-a4dd-e27acdb65f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14fb8ce35c1645e3b64698e2cb09cacd'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:29.182870 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-0b2602ed-5b05-4146-a4dd-e27acdb65f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14fb8ce35c1645e3b64698e2cb09cacd'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:29.183317 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-0b2602ed-5b05-4146-a4dd-e27acdb65f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14fb8ce35c1645e3b64698e2cb09cacd'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:29.198731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1253/2505] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:01:29 2022] DELETE /identity/v3/users/14fb8ce35c1645e3b64698e2cb09cacd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:29.203128 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a848d-5200-4384-b63b-8363f577e467 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:29.203670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a848d-5200-4384-b63b-8363f577e467 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:29.203670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a848d-5200-4384-b63b-8363f577e467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:29.224066 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-376a848d-5200-4384-b63b-8363f577e467 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:29.225325 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-376a848d-5200-4384-b63b-8363f577e467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:29.295941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1253/2506] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:29.305767 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2602ed-5b05-4146-a4dd-e27acdb65f5a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:29.307218 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0b2602ed-5b05-4146-a4dd-e27acdb65f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:29.329900 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:29.372715 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2602ed-5b05-4146-a4dd-e27acdb65f5a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:29.376820 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eef0a4-7c32-44ab-b7eb-bdde51ecd104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:29.377468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eef0a4-7c32-44ab-b7eb-bdde51ecd104 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:29.377762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eef0a4-7c32-44ab-b7eb-bdde51ecd104 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:29.378036 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eef0a4-7c32-44ab-b7eb-bdde51ecd104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:29.387771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eef0a4-7c32-44ab-b7eb-bdde51ecd104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:29.389275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eef0a4-7c32-44ab-b7eb-bdde51ecd104 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:29.399284 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1254/2507] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:29.687774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a848d-5200-4384-b63b-8363f577e467 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:29.689496 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-376a848d-5200-4384-b63b-8363f577e467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:29.708984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a848d-5200-4384-b63b-8363f577e467 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:29.715045 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b164c-8bf4-45e8-acbd-052bcfce76f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:29.715679 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b164c-8bf4-45e8-acbd-052bcfce76f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:29.715954 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b164c-8bf4-45e8-acbd-052bcfce76f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:29.716219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b164c-8bf4-45e8-acbd-052bcfce76f8 admin admin] PATH_INFO: `/v3/projects/b5f45b6153884eefb3a97ef2103ed649` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:29.717431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b164c-8bf4-45e8-acbd-052bcfce76f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f45b6153884eefb3a97ef2103ed649)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:29.719388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b164c-8bf4-45e8-acbd-052bcfce76f8 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:29.758460 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:29.771726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-b00b164c-8bf4-45e8-acbd-052bcfce76f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f45b6153884eefb3a97ef2103ed649', 'request_id': 'req-b00b164c-8bf4-45e8-acbd-052bcfce76f8'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:29.778833 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-b00b164c-8bf4-45e8-acbd-052bcfce76f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f45b6153884eefb3a97ef2103ed649', 'request_id': 'req-b00b164c-8bf4-45e8-acbd-052bcfce76f8'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:29.785048 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-b00b164c-8bf4-45e8-acbd-052bcfce76f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f45b6153884eefb3a97ef2103ed649', 'request_id': 'req-b00b164c-8bf4-45e8-acbd-052bcfce76f8'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:29.795847 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-b00b164c-8bf4-45e8-acbd-052bcfce76f8 admin admin] The token cache is being invalidate because project b5f45b6153884eefb3a97ef2103ed649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:01:29.796250 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-b00b164c-8bf4-45e8-acbd-052bcfce76f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:29.796893 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-b00b164c-8bf4-45e8-acbd-052bcfce76f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:29.798458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1254/2508] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:01:29 2022] DELETE /identity/v3/projects/b5f45b6153884eefb3a97ef2103ed649 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:29.802556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eef0a4-7c32-44ab-b7eb-bdde51ecd104 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:29.812650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eef0a4-7c32-44ab-b7eb-bdde51ecd104 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:29.875347 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13279b22-087c-44f8-b926-34ac94b86464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:29.876005 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13279b22-087c-44f8-b926-34ac94b86464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:29.876383 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13279b22-087c-44f8-b926-34ac94b86464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:29.876558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13279b22-087c-44f8-b926-34ac94b86464 admin admin] PATH_INFO: `/v3/users/82bd8305bd5e446494973c74a5483a32` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:29.877886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13279b22-087c-44f8-b926-34ac94b86464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82bd8305bd5e446494973c74a5483a32)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:29.879836 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13279b22-087c-44f8-b926-34ac94b86464 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:29.930411 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-13279b22-087c-44f8-b926-34ac94b86464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82bd8305bd5e446494973c74a5483a32'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:29.931059 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-13279b22-087c-44f8-b926-34ac94b86464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82bd8305bd5e446494973c74a5483a32'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:29.938139 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-13279b22-087c-44f8-b926-34ac94b86464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82bd8305bd5e446494973c74a5483a32'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:29.952130 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-13279b22-087c-44f8-b926-34ac94b86464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82bd8305bd5e446494973c74a5483a32'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:29.952868 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-13279b22-087c-44f8-b926-34ac94b86464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82bd8305bd5e446494973c74a5483a32'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:29.970666 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1255/2509] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:01:29 2022] DELETE /identity/v3/users/82bd8305bd5e446494973c74a5483a32 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:30.282009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b164c-8bf4-45e8-acbd-052bcfce76f8 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:30.283646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b00b164c-8bf4-45e8-acbd-052bcfce76f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:30.297991 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b164c-8bf4-45e8-acbd-052bcfce76f8 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:30.360723 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69252518-57f3-4238-9e1d-80dbfdc3a7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:30.361791 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69252518-57f3-4238-9e1d-80dbfdc3a7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:30.362224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69252518-57f3-4238-9e1d-80dbfdc3a7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:30.362532 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69252518-57f3-4238-9e1d-80dbfdc3a7f4 admin admin] PATH_INFO: `/v3/projects/4d86b6e6331044b585d06c56fc88f1e9` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:30.363921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69252518-57f3-4238-9e1d-80dbfdc3a7f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d86b6e6331044b585d06c56fc88f1e9)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:30.367026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69252518-57f3-4238-9e1d-80dbfdc3a7f4 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:30.416925 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-69252518-57f3-4238-9e1d-80dbfdc3a7f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d86b6e6331044b585d06c56fc88f1e9', 'request_id': 'req-69252518-57f3-4238-9e1d-80dbfdc3a7f4'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:30.425900 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-69252518-57f3-4238-9e1d-80dbfdc3a7f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d86b6e6331044b585d06c56fc88f1e9', 'request_id': 'req-69252518-57f3-4238-9e1d-80dbfdc3a7f4'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:30.433134 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-69252518-57f3-4238-9e1d-80dbfdc3a7f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d86b6e6331044b585d06c56fc88f1e9', 'request_id': 'req-69252518-57f3-4238-9e1d-80dbfdc3a7f4'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:30.444670 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-69252518-57f3-4238-9e1d-80dbfdc3a7f4 admin admin] The token cache is being invalidate because project 4d86b6e6331044b585d06c56fc88f1e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:01:30.445209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-69252518-57f3-4238-9e1d-80dbfdc3a7f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:30.445893 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-69252518-57f3-4238-9e1d-80dbfdc3a7f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:30.447459 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1255/2510] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:01:30 2022] DELETE /identity/v3/projects/4d86b6e6331044b585d06c56fc88f1e9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:30.453378 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e013cf1-3c39-4a15-96f3-774c64b7e8b6 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:30.453896 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e013cf1-3c39-4a15-96f3-774c64b7e8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:30.454002 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e013cf1-3c39-4a15-96f3-774c64b7e8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:30.474683 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-2e013cf1-3c39-4a15-96f3-774c64b7e8b6 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:30.475835 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2e013cf1-3c39-4a15-96f3-774c64b7e8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:30.519438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:30.545509 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1256/2511] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:30.553350 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900625f8-efaa-4857-85ae-48527205e217 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:30.553630 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900625f8-efaa-4857-85ae-48527205e217 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:30.553899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900625f8-efaa-4857-85ae-48527205e217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:30.575072 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-900625f8-efaa-4857-85ae-48527205e217 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:30.576278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-900625f8-efaa-4857-85ae-48527205e217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:30.586069 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1256/2512] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:30.590351 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e013cf1-3c39-4a15-96f3-774c64b7e8b6 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:30.600875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e013cf1-3c39-4a15-96f3-774c64b7e8b6 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:30.605894 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699806a-dc35-49aa-b443-9b446a43eb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:30.606687 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699806a-dc35-49aa-b443-9b446a43eb92 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:30.607100 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699806a-dc35-49aa-b443-9b446a43eb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:30.607360 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699806a-dc35-49aa-b443-9b446a43eb92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:30.608128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699806a-dc35-49aa-b443-9b446a43eb92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:01:30.608473 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699806a-dc35-49aa-b443-9b446a43eb92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:30.610246 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699806a-dc35-49aa-b443-9b446a43eb92 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:30.623656 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1257/2513] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 18:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:01:30.628197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900625f8-efaa-4857-85ae-48527205e217 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:30.637758 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900625f8-efaa-4857-85ae-48527205e217 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:30.643343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214eeeb9-3c79-43f0-86db-c82bed5a13b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:30.643997 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214eeeb9-3c79-43f0-86db-c82bed5a13b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:30.644255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214eeeb9-3c79-43f0-86db-c82bed5a13b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:30.644551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214eeeb9-3c79-43f0-86db-c82bed5a13b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:30.645238 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214eeeb9-3c79-43f0-86db-c82bed5a13b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:30.647161 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214eeeb9-3c79-43f0-86db-c82bed5a13b3 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:30.677228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1257/2514] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:01:30 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:01:30.681552 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699806a-dc35-49aa-b443-9b446a43eb92 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:30.692328 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699806a-dc35-49aa-b443-9b446a43eb92 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:30.749451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb7aa9-ecc9-486e-b363-ce6abd10fd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:30.750085 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb7aa9-ecc9-486e-b363-ce6abd10fd58 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:30.750368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb7aa9-ecc9-486e-b363-ce6abd10fd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:30.750672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb7aa9-ecc9-486e-b363-ce6abd10fd58 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:30.751347 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb7aa9-ecc9-486e-b363-ce6abd10fd58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:30.753303 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb7aa9-ecc9-486e-b363-ce6abd10fd58 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:30.775883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1258/2515] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:01:30 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:01:30.780141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214eeeb9-3c79-43f0-86db-c82bed5a13b3 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:30.793949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214eeeb9-3c79-43f0-86db-c82bed5a13b3 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:30.798951 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d28aa-a0f6-4258-aaa0-c93e9b29aae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:30.799578 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d28aa-a0f6-4258-aaa0-c93e9b29aae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:30.799860 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d28aa-a0f6-4258-aaa0-c93e9b29aae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:30.800133 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d28aa-a0f6-4258-aaa0-c93e9b29aae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:30.800836 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d28aa-a0f6-4258-aaa0-c93e9b29aae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:30.802499 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d28aa-a0f6-4258-aaa0-c93e9b29aae1 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:30.814610 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1258/2516] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:01:30.818391 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb7aa9-ecc9-486e-b363-ce6abd10fd58 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:30.828850 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb7aa9-ecc9-486e-b363-ce6abd10fd58 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:30.833806 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9b778-fe0e-47c4-84f2-9c88792a060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:30.834427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9b778-fe0e-47c4-84f2-9c88792a060f admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:30.834702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9b778-fe0e-47c4-84f2-9c88792a060f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:30.834963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9b778-fe0e-47c4-84f2-9c88792a060f admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:30.835646 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9b778-fe0e-47c4-84f2-9c88792a060f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:30.837293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9b778-fe0e-47c4-84f2-9c88792a060f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:30.848958 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1259/2517] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:01:30.853421 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d28aa-a0f6-4258-aaa0-c93e9b29aae1 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:30.864118 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d28aa-a0f6-4258-aaa0-c93e9b29aae1 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:30.873813 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97422d1d-fd60-4916-9678-c714fa73c51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:30.874988 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97422d1d-fd60-4916-9678-c714fa73c51d admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:30.875458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97422d1d-fd60-4916-9678-c714fa73c51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:30.875937 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97422d1d-fd60-4916-9678-c714fa73c51d admin admin] PATH_INFO: `/v3/projects/ab670d653fba49868f06cae878740f69/users/c3cd1c4014f44c87b895690d50b4e9fc/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:30.888985 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:30.896908 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97422d1d-fd60-4916-9678-c714fa73c51d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab670d653fba49868f06cae878740f69, user_id=c3cd1c4014f44c87b895690d50b4e9fc, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:30.899882 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97422d1d-fd60-4916-9678-c714fa73c51d admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:30.926765 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1259/2518] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:01:30 2022] PUT /identity/v3/projects/ab670d653fba49868f06cae878740f69/users/c3cd1c4014f44c87b895690d50b4e9fc/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:30.932621 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c10936-a9ab-4475-9342-1a83fdade982 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:30.932958 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c10936-a9ab-4475-9342-1a83fdade982 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:30.933276 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c10936-a9ab-4475-9342-1a83fdade982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:30.967023 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b5c10936-a9ab-4475-9342-1a83fdade982 None None] MFA Rules not processed for user `c3cd1c4014f44c87b895690d50b4e9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:30.967325 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b5c10936-a9ab-4475-9342-1a83fdade982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:31.068427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1260/2519] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:31.072671 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97422d1d-fd60-4916-9678-c714fa73c51d admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:31.152198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97422d1d-fd60-4916-9678-c714fa73c51d admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:31.160702 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50aead-4d39-460a-9f86-dde68e9ba56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:31.161651 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50aead-4d39-460a-9f86-dde68e9ba56c admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:31.162136 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50aead-4d39-460a-9f86-dde68e9ba56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:31.162568 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50aead-4d39-460a-9f86-dde68e9ba56c admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:31.163395 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50aead-4d39-460a-9f86-dde68e9ba56c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:31.165663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50aead-4d39-460a-9f86-dde68e9ba56c admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:31.219646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1260/2520] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:01:31 2022] POST /identity/v3/projects => generated 369 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:01:31.223160 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c10936-a9ab-4475-9342-1a83fdade982 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:31.237429 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c10936-a9ab-4475-9342-1a83fdade982 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:31.285227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:31.318724 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26921129-353f-436e-b40b-ab5d11fe7a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:31.319460 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26921129-353f-436e-b40b-ab5d11fe7a45 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:31.319837 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26921129-353f-436e-b40b-ab5d11fe7a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:31.320209 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26921129-353f-436e-b40b-ab5d11fe7a45 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:31.321137 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26921129-353f-436e-b40b-ab5d11fe7a45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:31.323504 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26921129-353f-436e-b40b-ab5d11fe7a45 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:31.350272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1261/2521] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:01:31 2022] POST /identity/v3/users => generated 291 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:01:31.354416 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50aead-4d39-460a-9f86-dde68e9ba56c admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:31.371042 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50aead-4d39-460a-9f86-dde68e9ba56c admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:31.377929 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c8fc4-aab4-4656-bd3c-7b8cf23a522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:31.378739 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c8fc4-aab4-4656-bd3c-7b8cf23a522e admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:31.379009 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c8fc4-aab4-4656-bd3c-7b8cf23a522e admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:31.379355 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c8fc4-aab4-4656-bd3c-7b8cf23a522e admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:31.380110 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c8fc4-aab4-4656-bd3c-7b8cf23a522e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:31.381788 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c8fc4-aab4-4656-bd3c-7b8cf23a522e admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:31.396869 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1261/2522] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:31.401165 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26921129-353f-436e-b40b-ab5d11fe7a45 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:31.413616 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26921129-353f-436e-b40b-ab5d11fe7a45 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:31.421730 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88a54b-b0dc-4f68-a6a9-0eed2a2a4a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:31.422530 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88a54b-b0dc-4f68-a6a9-0eed2a2a4a7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:31.422884 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88a54b-b0dc-4f68-a6a9-0eed2a2a4a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:31.423226 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88a54b-b0dc-4f68-a6a9-0eed2a2a4a7c admin admin] PATH_INFO: `/v3/projects/2db80fa6268f44a483a78eb9cf9a5184/users/89a8f07f295649fda327f344a8a0e352/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:31.447345 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88a54b-b0dc-4f68-a6a9-0eed2a2a4a7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db80fa6268f44a483a78eb9cf9a5184, user_id=89a8f07f295649fda327f344a8a0e352, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:31.451590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88a54b-b0dc-4f68-a6a9-0eed2a2a4a7c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:31.471491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1262/2523] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:01:31 2022] PUT /identity/v3/projects/2db80fa6268f44a483a78eb9cf9a5184/users/89a8f07f295649fda327f344a8a0e352/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:01:31.475689 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c8fc4-aab4-4656-bd3c-7b8cf23a522e admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:31.487129 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c8fc4-aab4-4656-bd3c-7b8cf23a522e admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:31.545947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77673c87-5f66-4107-b126-de7d89c0333c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:31.546772 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77673c87-5f66-4107-b126-de7d89c0333c admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:31.547594 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77673c87-5f66-4107-b126-de7d89c0333c admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:31.547594 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77673c87-5f66-4107-b126-de7d89c0333c admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:31.548908 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77673c87-5f66-4107-b126-de7d89c0333c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:31.550354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77673c87-5f66-4107-b126-de7d89c0333c admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:31.563758 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1262/2524] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:31.567944 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88a54b-b0dc-4f68-a6a9-0eed2a2a4a7c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:31.578280 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88a54b-b0dc-4f68-a6a9-0eed2a2a4a7c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:31.582912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d79da-254d-4baa-bf2e-e500c309c9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:31.583587 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d79da-254d-4baa-bf2e-e500c309c9c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:31.583869 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d79da-254d-4baa-bf2e-e500c309c9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:31.584145 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d79da-254d-4baa-bf2e-e500c309c9c0 admin admin] PATH_INFO: `/v3/projects/2db80fa6268f44a483a78eb9cf9a5184/users/89a8f07f295649fda327f344a8a0e352/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:31.586171 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d79da-254d-4baa-bf2e-e500c309c9c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db80fa6268f44a483a78eb9cf9a5184, user_id=89a8f07f295649fda327f344a8a0e352, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:31.588822 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d79da-254d-4baa-bf2e-e500c309c9c0 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:31.599855 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1263/2525] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:01:31 2022] PUT /identity/v3/projects/2db80fa6268f44a483a78eb9cf9a5184/users/89a8f07f295649fda327f344a8a0e352/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:31.610594 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55af5ee-8b8c-429f-a6cd-bd1c81d97ec6 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:31.610879 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55af5ee-8b8c-429f-a6cd-bd1c81d97ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:31.611347 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55af5ee-8b8c-429f-a6cd-bd1c81d97ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:31.642563 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-a55af5ee-8b8c-429f-a6cd-bd1c81d97ec6 None None] MFA Rules not processed for user `89a8f07f295649fda327f344a8a0e352`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:31.643801 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-a55af5ee-8b8c-429f-a6cd-bd1c81d97ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:31.690489 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:31.715721 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1263/2526] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:31 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:31.726588 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d79da-254d-4baa-bf2e-e500c309c9c0 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:31.728399 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-dc3d79da-254d-4baa-bf2e-e500c309c9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:31.789856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d79da-254d-4baa-bf2e-e500c309c9c0 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:31.793949 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9003ba-302d-4b76-a9ba-92b445fa7a65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:31.794560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9003ba-302d-4b76-a9ba-92b445fa7a65 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:31.794839 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9003ba-302d-4b76-a9ba-92b445fa7a65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:31.795111 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9003ba-302d-4b76-a9ba-92b445fa7a65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:31.804682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9003ba-302d-4b76-a9ba-92b445fa7a65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:31.806203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9003ba-302d-4b76-a9ba-92b445fa7a65 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:31.815907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1264/2527] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:31 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:33.312304 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55af5ee-8b8c-429f-a6cd-bd1c81d97ec6 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:33.381290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55af5ee-8b8c-429f-a6cd-bd1c81d97ec6 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:33.386520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d285ee-ab63-40d9-a469-50524da4e0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:33.387202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d285ee-ab63-40d9-a469-50524da4e0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:33.387483 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d285ee-ab63-40d9-a469-50524da4e0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:33.387780 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d285ee-ab63-40d9-a469-50524da4e0e3 admin admin] PATH_INFO: `/v3/users/c3cd1c4014f44c87b895690d50b4e9fc` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:33.388985 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d285ee-ab63-40d9-a469-50524da4e0e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3cd1c4014f44c87b895690d50b4e9fc)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:33.390950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d285ee-ab63-40d9-a469-50524da4e0e3 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:33.443405 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f3d285ee-ab63-40d9-a469-50524da4e0e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3cd1c4014f44c87b895690d50b4e9fc'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:33.455867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f3d285ee-ab63-40d9-a469-50524da4e0e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3cd1c4014f44c87b895690d50b4e9fc'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:33.465621 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f3d285ee-ab63-40d9-a469-50524da4e0e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3cd1c4014f44c87b895690d50b4e9fc'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:33.473174 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f3d285ee-ab63-40d9-a469-50524da4e0e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3cd1c4014f44c87b895690d50b4e9fc'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:33.473966 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f3d285ee-ab63-40d9-a469-50524da4e0e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3cd1c4014f44c87b895690d50b4e9fc'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:33.480289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1264/2528] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:01:33 2022] DELETE /identity/v3/users/c3cd1c4014f44c87b895690d50b4e9fc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:33.486697 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33da987-cddf-414f-ad58-4e27091df0dd None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:33.487217 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33da987-cddf-414f-ad58-4e27091df0dd None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:33.487314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33da987-cddf-414f-ad58-4e27091df0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:33.507879 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e33da987-cddf-414f-ad58-4e27091df0dd None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:33.509110 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e33da987-cddf-414f-ad58-4e27091df0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:33.574491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1265/2529] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:33.588011 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d285ee-ab63-40d9-a469-50524da4e0e3 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:33.590450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f3d285ee-ab63-40d9-a469-50524da4e0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:33.654662 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d285ee-ab63-40d9-a469-50524da4e0e3 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:33.658975 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3802e-77a7-480c-a315-b5df0abf32c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:33.659594 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3802e-77a7-480c-a315-b5df0abf32c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:33.659875 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3802e-77a7-480c-a315-b5df0abf32c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:33.660129 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3802e-77a7-480c-a315-b5df0abf32c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:33.669660 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3802e-77a7-480c-a315-b5df0abf32c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:33.671088 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3802e-77a7-480c-a315-b5df0abf32c5 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:33.680493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1265/2530] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:34.054997 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33da987-cddf-414f-ad58-4e27091df0dd None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:34.061172 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e33da987-cddf-414f-ad58-4e27091df0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:34.075652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33da987-cddf-414f-ad58-4e27091df0dd None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:34.080767 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bd070-faf2-454e-b8ea-c11869ea1f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:34.081496 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bd070-faf2-454e-b8ea-c11869ea1f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:34.081775 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bd070-faf2-454e-b8ea-c11869ea1f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:34.082047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bd070-faf2-454e-b8ea-c11869ea1f47 admin admin] PATH_INFO: `/v3/projects/ab670d653fba49868f06cae878740f69` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:34.083216 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bd070-faf2-454e-b8ea-c11869ea1f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab670d653fba49868f06cae878740f69)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:34.085147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bd070-faf2-454e-b8ea-c11869ea1f47 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:34.122336 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:34.139600 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ff8bd070-faf2-454e-b8ea-c11869ea1f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab670d653fba49868f06cae878740f69', 'request_id': 'req-ff8bd070-faf2-454e-b8ea-c11869ea1f47'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:34.146177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ff8bd070-faf2-454e-b8ea-c11869ea1f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab670d653fba49868f06cae878740f69', 'request_id': 'req-ff8bd070-faf2-454e-b8ea-c11869ea1f47'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:34.156602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ff8bd070-faf2-454e-b8ea-c11869ea1f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab670d653fba49868f06cae878740f69', 'request_id': 'req-ff8bd070-faf2-454e-b8ea-c11869ea1f47'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:34.169696 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ff8bd070-faf2-454e-b8ea-c11869ea1f47 admin admin] The token cache is being invalidate because project ab670d653fba49868f06cae878740f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:01:34.169939 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ff8bd070-faf2-454e-b8ea-c11869ea1f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:34.170567 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ff8bd070-faf2-454e-b8ea-c11869ea1f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:34.172104 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1266/2531] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:01:34 2022] DELETE /identity/v3/projects/ab670d653fba49868f06cae878740f69 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:34.176491 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3802e-77a7-480c-a315-b5df0abf32c5 service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:34.183093 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:34.187575 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3802e-77a7-480c-a315-b5df0abf32c5 service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:34.259826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed3cf6-2b68-4f1a-8af6-d4af392124d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:34.260545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed3cf6-2b68-4f1a-8af6-d4af392124d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:34.260859 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed3cf6-2b68-4f1a-8af6-d4af392124d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:34.261353 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed3cf6-2b68-4f1a-8af6-d4af392124d8 admin admin] PATH_INFO: `/v3/users/89a8f07f295649fda327f344a8a0e352` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:34.262701 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed3cf6-2b68-4f1a-8af6-d4af392124d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89a8f07f295649fda327f344a8a0e352)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:34.264824 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed3cf6-2b68-4f1a-8af6-d4af392124d8 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:34.312492 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-b1ed3cf6-2b68-4f1a-8af6-d4af392124d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89a8f07f295649fda327f344a8a0e352'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:34.324527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-b1ed3cf6-2b68-4f1a-8af6-d4af392124d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89a8f07f295649fda327f344a8a0e352'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:34.333577 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-b1ed3cf6-2b68-4f1a-8af6-d4af392124d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89a8f07f295649fda327f344a8a0e352'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:34.341644 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-b1ed3cf6-2b68-4f1a-8af6-d4af392124d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89a8f07f295649fda327f344a8a0e352'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:34.342404 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-b1ed3cf6-2b68-4f1a-8af6-d4af392124d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89a8f07f295649fda327f344a8a0e352'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:34.350121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1266/2532] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:01:34 2022] DELETE /identity/v3/users/89a8f07f295649fda327f344a8a0e352 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:34.656243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bd070-faf2-454e-b8ea-c11869ea1f47 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:34.657937 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ff8bd070-faf2-454e-b8ea-c11869ea1f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:34.671498 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bd070-faf2-454e-b8ea-c11869ea1f47 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:34.732773 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785193de-c246-4617-a543-90460ac15ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:34.733455 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785193de-c246-4617-a543-90460ac15ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:34.733742 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785193de-c246-4617-a543-90460ac15ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:34.734013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785193de-c246-4617-a543-90460ac15ffc admin admin] PATH_INFO: `/v3/projects/2db80fa6268f44a483a78eb9cf9a5184` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:34.735197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785193de-c246-4617-a543-90460ac15ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2db80fa6268f44a483a78eb9cf9a5184)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:34.737256 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785193de-c246-4617-a543-90460ac15ffc admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:34.793427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-785193de-c246-4617-a543-90460ac15ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2db80fa6268f44a483a78eb9cf9a5184', 'request_id': 'req-785193de-c246-4617-a543-90460ac15ffc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:34.799908 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-785193de-c246-4617-a543-90460ac15ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2db80fa6268f44a483a78eb9cf9a5184', 'request_id': 'req-785193de-c246-4617-a543-90460ac15ffc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:34.808731 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-785193de-c246-4617-a543-90460ac15ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2db80fa6268f44a483a78eb9cf9a5184', 'request_id': 'req-785193de-c246-4617-a543-90460ac15ffc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:34.823744 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-785193de-c246-4617-a543-90460ac15ffc admin admin] The token cache is being invalidate because project 2db80fa6268f44a483a78eb9cf9a5184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:01:34.824039 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-785193de-c246-4617-a543-90460ac15ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:34.825143 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-785193de-c246-4617-a543-90460ac15ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:34.826699 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1267/2533] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:01:34 2022] DELETE /identity/v3/projects/2db80fa6268f44a483a78eb9cf9a5184 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:34.831728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc0cce-af6f-48af-a531-714ae3d7899e None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:34.832010 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc0cce-af6f-48af-a531-714ae3d7899e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:34.832310 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc0cce-af6f-48af-a531-714ae3d7899e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:34.852518 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-29fc0cce-af6f-48af-a531-714ae3d7899e None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:34.853876 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-29fc0cce-af6f-48af-a531-714ae3d7899e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:34.916502 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1267/2534] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:34.926453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ec66d-4d73-4644-a67f-531c8d103d0b None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:34.926708 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ec66d-4d73-4644-a67f-531c8d103d0b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:34.926983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ec66d-4d73-4644-a67f-531c8d103d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:34.946652 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-df0ec66d-4d73-4644-a67f-531c8d103d0b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:34.947865 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-df0ec66d-4d73-4644-a67f-531c8d103d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:34.956308 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1268/2535] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:01:34.960564 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc0cce-af6f-48af-a531-714ae3d7899e None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:34.971404 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc0cce-af6f-48af-a531-714ae3d7899e None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:34.976381 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa3190-97e2-4dce-8c61-b9175129c027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:34.977007 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa3190-97e2-4dce-8c61-b9175129c027 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:34.977322 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa3190-97e2-4dce-8c61-b9175129c027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:34.977600 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa3190-97e2-4dce-8c61-b9175129c027 admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:34.978321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa3190-97e2-4dce-8c61-b9175129c027 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:01:34.978631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa3190-97e2-4dce-8c61-b9175129c027 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:34.980512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa3190-97e2-4dce-8c61-b9175129c027 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:34.992693 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1268/2536] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 18:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:01:34.997193 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ec66d-4d73-4644-a67f-531c8d103d0b None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:35.006856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ec66d-4d73-4644-a67f-531c8d103d0b None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:35.012313 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51481bf6-fd9d-419c-9e13-0d4ffed06d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:35.012942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51481bf6-fd9d-419c-9e13-0d4ffed06d04 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:35.013260 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51481bf6-fd9d-419c-9e13-0d4ffed06d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:35.013529 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51481bf6-fd9d-419c-9e13-0d4ffed06d04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:35.014187 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51481bf6-fd9d-419c-9e13-0d4ffed06d04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:35.016139 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51481bf6-fd9d-419c-9e13-0d4ffed06d04 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:35.048423 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1269/2537] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:01:34 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:01:35.052623 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa3190-97e2-4dce-8c61-b9175129c027 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:35.063476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa3190-97e2-4dce-8c61-b9175129c027 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:35.071841 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:35.134195 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de649a5-1d34-4076-93d5-cd1b0cf66011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:35.134987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de649a5-1d34-4076-93d5-cd1b0cf66011 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:35.135318 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de649a5-1d34-4076-93d5-cd1b0cf66011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:35.135729 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de649a5-1d34-4076-93d5-cd1b0cf66011 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:35.136815 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de649a5-1d34-4076-93d5-cd1b0cf66011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:35.139327 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de649a5-1d34-4076-93d5-cd1b0cf66011 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:35.168747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1269/2538] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:01:35 2022] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:01:35.173402 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51481bf6-fd9d-419c-9e13-0d4ffed06d04 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:35.185178 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51481bf6-fd9d-419c-9e13-0d4ffed06d04 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:35.191001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de0340-e076-4707-92b9-7902a3d3da96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:35.191871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de0340-e076-4707-92b9-7902a3d3da96 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:35.192242 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de0340-e076-4707-92b9-7902a3d3da96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:35.192608 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de0340-e076-4707-92b9-7902a3d3da96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:35.193529 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de0340-e076-4707-92b9-7902a3d3da96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:35.195601 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de0340-e076-4707-92b9-7902a3d3da96 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:35.209381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1270/2539] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:35.213199 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de649a5-1d34-4076-93d5-cd1b0cf66011 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:35.224359 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de649a5-1d34-4076-93d5-cd1b0cf66011 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:35.229490 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec747fd6-22b6-4300-8b08-68fbfbd905f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:35.230355 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec747fd6-22b6-4300-8b08-68fbfbd905f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:35.231286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec747fd6-22b6-4300-8b08-68fbfbd905f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:35.231286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec747fd6-22b6-4300-8b08-68fbfbd905f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:35.231890 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec747fd6-22b6-4300-8b08-68fbfbd905f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:35.233638 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec747fd6-22b6-4300-8b08-68fbfbd905f6 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:35.246677 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1270/2540] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:35.250780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de0340-e076-4707-92b9-7902a3d3da96 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:35.262923 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de0340-e076-4707-92b9-7902a3d3da96 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:35.268224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32cf78-cfd8-4987-98ed-119a622808a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:35.269571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32cf78-cfd8-4987-98ed-119a622808a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:35.269571 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32cf78-cfd8-4987-98ed-119a622808a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:35.269867 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32cf78-cfd8-4987-98ed-119a622808a2 admin admin] PATH_INFO: `/v3/projects/c5488a1815314a4ab9478f809bd826a9/users/296a60420f394f21b49033a27482a47c/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:35.272691 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:35.290553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32cf78-cfd8-4987-98ed-119a622808a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5488a1815314a4ab9478f809bd826a9, user_id=296a60420f394f21b49033a27482a47c, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:35.295833 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32cf78-cfd8-4987-98ed-119a622808a2 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:35.313879 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1271/2541] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:01:35 2022] PUT /identity/v3/projects/c5488a1815314a4ab9478f809bd826a9/users/296a60420f394f21b49033a27482a47c/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:01:35.324401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289b031-8c58-4e4d-bb78-c7a57f1f08c3 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:35.324897 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289b031-8c58-4e4d-bb78-c7a57f1f08c3 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:35.325168 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289b031-8c58-4e4d-bb78-c7a57f1f08c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:35.353957 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-6289b031-8c58-4e4d-bb78-c7a57f1f08c3 None None] MFA Rules not processed for user `296a60420f394f21b49033a27482a47c`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:35.355497 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6289b031-8c58-4e4d-bb78-c7a57f1f08c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:35.420823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1271/2542] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:35.425536 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32cf78-cfd8-4987-98ed-119a622808a2 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:35.491732 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32cf78-cfd8-4987-98ed-119a622808a2 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:35.497081 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cce09-c6fa-40ae-9238-dacfaf49c760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:35.497738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cce09-c6fa-40ae-9238-dacfaf49c760 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:35.498022 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cce09-c6fa-40ae-9238-dacfaf49c760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:35.498299 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cce09-c6fa-40ae-9238-dacfaf49c760 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:35.498967 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0cce09-c6fa-40ae-9238-dacfaf49c760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:35.500892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0cce09-c6fa-40ae-9238-dacfaf49c760 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:35.530097 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1272/2543] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:01:35 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:01:35.534374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289b031-8c58-4e4d-bb78-c7a57f1f08c3 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:35.550316 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289b031-8c58-4e4d-bb78-c7a57f1f08c3 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:35.634391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb512cd-b382-4b37-85b9-0110f4985ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:35.635384 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb512cd-b382-4b37-85b9-0110f4985ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:35.636679 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb512cd-b382-4b37-85b9-0110f4985ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:35.637200 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb512cd-b382-4b37-85b9-0110f4985ea7 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:35.638234 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb512cd-b382-4b37-85b9-0110f4985ea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:35.646702 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb512cd-b382-4b37-85b9-0110f4985ea7 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:35.696711 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1272/2544] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:01:35 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:01:35.701790 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cce09-c6fa-40ae-9238-dacfaf49c760 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:35.715902 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cce09-c6fa-40ae-9238-dacfaf49c760 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:35.723555 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4db94-b770-4f4a-a8f2-6cb6c757f4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:35.724686 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4db94-b770-4f4a-a8f2-6cb6c757f4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:35.725243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4db94-b770-4f4a-a8f2-6cb6c757f4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:35.725630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4db94-b770-4f4a-a8f2-6cb6c757f4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:35.726741 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4db94-b770-4f4a-a8f2-6cb6c757f4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:35.728507 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4db94-b770-4f4a-a8f2-6cb6c757f4f0 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:35.743852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1273/2545] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:35.748076 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb512cd-b382-4b37-85b9-0110f4985ea7 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:35.760862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb512cd-b382-4b37-85b9-0110f4985ea7 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:35.767498 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614709d-1d42-44a9-99f1-fe7d86b18a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:35.768368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614709d-1d42-44a9-99f1-fe7d86b18a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:35.768748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614709d-1d42-44a9-99f1-fe7d86b18a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:35.769178 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614709d-1d42-44a9-99f1-fe7d86b18a4a admin admin] PATH_INFO: `/v3/projects/c265e372c6ee42629352f75f0bdf404a/users/9ce0a2d8d2874facb70c64884fd08ba1/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:35.773911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:35.794858 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614709d-1d42-44a9-99f1-fe7d86b18a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c265e372c6ee42629352f75f0bdf404a, user_id=9ce0a2d8d2874facb70c64884fd08ba1, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:35.798281 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614709d-1d42-44a9-99f1-fe7d86b18a4a admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:35.816870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1273/2546] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:01:35 2022] PUT /identity/v3/projects/c265e372c6ee42629352f75f0bdf404a/users/9ce0a2d8d2874facb70c64884fd08ba1/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:35.820922 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4db94-b770-4f4a-a8f2-6cb6c757f4f0 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:35.833979 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4db94-b770-4f4a-a8f2-6cb6c757f4f0 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:35.894058 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4254071-cec1-40f5-8a5e-753001480125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:35.894829 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4254071-cec1-40f5-8a5e-753001480125 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:35.895204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4254071-cec1-40f5-8a5e-753001480125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:35.895537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4254071-cec1-40f5-8a5e-753001480125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:35.896224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4254071-cec1-40f5-8a5e-753001480125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:35.897860 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4254071-cec1-40f5-8a5e-753001480125 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:35.908033 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1274/2547] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:35.912365 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614709d-1d42-44a9-99f1-fe7d86b18a4a admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:35.922997 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614709d-1d42-44a9-99f1-fe7d86b18a4a admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:35.927512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9957a1-0e53-4f04-8360-25f2b4c73242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:35.928179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9957a1-0e53-4f04-8360-25f2b4c73242 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:35.928456 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9957a1-0e53-4f04-8360-25f2b4c73242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:35.928728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9957a1-0e53-4f04-8360-25f2b4c73242 admin admin] PATH_INFO: `/v3/projects/c265e372c6ee42629352f75f0bdf404a/users/9ce0a2d8d2874facb70c64884fd08ba1/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:35.930760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9957a1-0e53-4f04-8360-25f2b4c73242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c265e372c6ee42629352f75f0bdf404a, user_id=9ce0a2d8d2874facb70c64884fd08ba1, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:35.933458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9957a1-0e53-4f04-8360-25f2b4c73242 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:35.943637 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1274/2548] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:01:35 2022] PUT /identity/v3/projects/c265e372c6ee42629352f75f0bdf404a/users/9ce0a2d8d2874facb70c64884fd08ba1/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:01:35.954477 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f7b72-a088-464a-a804-63d3935ec521 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:35.954764 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f7b72-a088-464a-a804-63d3935ec521 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:35.955038 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f7b72-a088-464a-a804-63d3935ec521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:35.983621 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d89f7b72-a088-464a-a804-63d3935ec521 None None] MFA Rules not processed for user `9ce0a2d8d2874facb70c64884fd08ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:35.984865 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d89f7b72-a088-464a-a804-63d3935ec521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:36.036120 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:36.064486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1275/2549] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:36.076235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9957a1-0e53-4f04-8360-25f2b4c73242 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:36.078283 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ee9957a1-0e53-4f04-8360-25f2b4c73242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:36.143316 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9957a1-0e53-4f04-8360-25f2b4c73242 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:36.147026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13940324-2ad3-4b10-b240-16c11960cfb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:36.147653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13940324-2ad3-4b10-b240-16c11960cfb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:36.147926 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13940324-2ad3-4b10-b240-16c11960cfb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:36.148558 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13940324-2ad3-4b10-b240-16c11960cfb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:36.159579 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13940324-2ad3-4b10-b240-16c11960cfb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:36.161472 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13940324-2ad3-4b10-b240-16c11960cfb3 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:36.172809 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1275/2550] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:36 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:36.228820 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f7b72-a088-464a-a804-63d3935ec521 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:36.231015 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d89f7b72-a088-464a-a804-63d3935ec521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:36.245262 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f7b72-a088-464a-a804-63d3935ec521 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:36.249611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d362568-07b1-4c0b-b9aa-f0848bcb3c91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:36.250233 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d362568-07b1-4c0b-b9aa-f0848bcb3c91 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:36.250524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d362568-07b1-4c0b-b9aa-f0848bcb3c91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:36.250799 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d362568-07b1-4c0b-b9aa-f0848bcb3c91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:36.339454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d362568-07b1-4c0b-b9aa-f0848bcb3c91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:36.341146 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d362568-07b1-4c0b-b9aa-f0848bcb3c91 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:36.363576 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1276/2551] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:39.964675 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13940324-2ad3-4b10-b240-16c11960cfb3 service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:40.032682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13940324-2ad3-4b10-b240-16c11960cfb3 service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:40.048225 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6c511-8393-496c-91a3-7e58deccc2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:40.048922 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6c511-8393-496c-91a3-7e58deccc2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:40.049222 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6c511-8393-496c-91a3-7e58deccc2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:40.049503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6c511-8393-496c-91a3-7e58deccc2da admin admin] PATH_INFO: `/v3/users/296a60420f394f21b49033a27482a47c` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:40.050932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6c511-8393-496c-91a3-7e58deccc2da admin admin] RBAC: Authorizing `identity:delete_user(user_id=296a60420f394f21b49033a27482a47c)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:40.052874 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6c511-8393-496c-91a3-7e58deccc2da admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:40.103172 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e4f6c511-8393-496c-91a3-7e58deccc2da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '296a60420f394f21b49033a27482a47c'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:40.115495 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e4f6c511-8393-496c-91a3-7e58deccc2da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '296a60420f394f21b49033a27482a47c'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:40.123991 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e4f6c511-8393-496c-91a3-7e58deccc2da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '296a60420f394f21b49033a27482a47c'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:40.129625 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:40.133188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e4f6c511-8393-496c-91a3-7e58deccc2da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '296a60420f394f21b49033a27482a47c'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:40.133864 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e4f6c511-8393-496c-91a3-7e58deccc2da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '296a60420f394f21b49033a27482a47c'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:40.140829 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1276/2552] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:01:39 2022] DELETE /identity/v3/users/296a60420f394f21b49033a27482a47c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:40.146973 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e28e5-f9f9-4ac6-9c1c-c325142419cb None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:40.147439 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e28e5-f9f9-4ac6-9c1c-c325142419cb None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:40.147552 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e28e5-f9f9-4ac6-9c1c-c325142419cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:40.167681 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-0b1e28e5-f9f9-4ac6-9c1c-c325142419cb None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:40.168852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0b1e28e5-f9f9-4ac6-9c1c-c325142419cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:40.245863 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1277/2553] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:40.259861 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6c511-8393-496c-91a3-7e58deccc2da admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:40.261749 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e4f6c511-8393-496c-91a3-7e58deccc2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:40.328279 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6c511-8393-496c-91a3-7e58deccc2da admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:40.333309 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06678f3f-3e16-4f37-9889-1cdc836a0a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:40.333970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06678f3f-3e16-4f37-9889-1cdc836a0a58 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:40.334259 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06678f3f-3e16-4f37-9889-1cdc836a0a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:40.334525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06678f3f-3e16-4f37-9889-1cdc836a0a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:40.345529 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06678f3f-3e16-4f37-9889-1cdc836a0a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:40.346959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06678f3f-3e16-4f37-9889-1cdc836a0a58 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:40.356808 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1277/2554] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:40.657353 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e28e5-f9f9-4ac6-9c1c-c325142419cb None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:40.658942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0b1e28e5-f9f9-4ac6-9c1c-c325142419cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:40.671942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e28e5-f9f9-4ac6-9c1c-c325142419cb None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:40.677273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7909a1-452e-4ac2-a2b4-c608e3cfc1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:40.677951 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7909a1-452e-4ac2-a2b4-c608e3cfc1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:40.678233 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7909a1-452e-4ac2-a2b4-c608e3cfc1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:40.678508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7909a1-452e-4ac2-a2b4-c608e3cfc1b2 admin admin] PATH_INFO: `/v3/projects/c5488a1815314a4ab9478f809bd826a9` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:40.679791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7909a1-452e-4ac2-a2b4-c608e3cfc1b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5488a1815314a4ab9478f809bd826a9)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:40.682795 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7909a1-452e-4ac2-a2b4-c608e3cfc1b2 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:40.732337 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-da7909a1-452e-4ac2-a2b4-c608e3cfc1b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5488a1815314a4ab9478f809bd826a9', 'request_id': 'req-da7909a1-452e-4ac2-a2b4-c608e3cfc1b2'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:40.738534 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-da7909a1-452e-4ac2-a2b4-c608e3cfc1b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5488a1815314a4ab9478f809bd826a9', 'request_id': 'req-da7909a1-452e-4ac2-a2b4-c608e3cfc1b2'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:40.747956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-da7909a1-452e-4ac2-a2b4-c608e3cfc1b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5488a1815314a4ab9478f809bd826a9', 'request_id': 'req-da7909a1-452e-4ac2-a2b4-c608e3cfc1b2'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:40.755216 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:40.759099 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-da7909a1-452e-4ac2-a2b4-c608e3cfc1b2 admin admin] The token cache is being invalidate because project c5488a1815314a4ab9478f809bd826a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:01:40.759588 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-da7909a1-452e-4ac2-a2b4-c608e3cfc1b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:40.760633 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-da7909a1-452e-4ac2-a2b4-c608e3cfc1b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:40.762653 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1278/2555] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:01:40 2022] DELETE /identity/v3/projects/c5488a1815314a4ab9478f809bd826a9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:40.766850 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06678f3f-3e16-4f37-9889-1cdc836a0a58 service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:40.776562 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06678f3f-3e16-4f37-9889-1cdc836a0a58 service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:40.842265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8e7c9-526a-4304-b833-316f154b90fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:40.843116 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8e7c9-526a-4304-b833-316f154b90fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:40.843443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8e7c9-526a-4304-b833-316f154b90fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:40.843684 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8e7c9-526a-4304-b833-316f154b90fe admin admin] PATH_INFO: `/v3/users/9ce0a2d8d2874facb70c64884fd08ba1` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:40.845190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8e7c9-526a-4304-b833-316f154b90fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce0a2d8d2874facb70c64884fd08ba1)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:40.847471 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8e7c9-526a-4304-b833-316f154b90fe admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:40.902820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f8f8e7c9-526a-4304-b833-316f154b90fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce0a2d8d2874facb70c64884fd08ba1'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:40.910317 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7909a1-452e-4ac2-a2b4-c608e3cfc1b2 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:40.911909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-da7909a1-452e-4ac2-a2b4-c608e3cfc1b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:40.920370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f8f8e7c9-526a-4304-b833-316f154b90fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce0a2d8d2874facb70c64884fd08ba1'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:40.929502 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f8f8e7c9-526a-4304-b833-316f154b90fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce0a2d8d2874facb70c64884fd08ba1'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:40.936712 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f8f8e7c9-526a-4304-b833-316f154b90fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce0a2d8d2874facb70c64884fd08ba1'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:40.937389 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f8f8e7c9-526a-4304-b833-316f154b90fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce0a2d8d2874facb70c64884fd08ba1'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:40.943318 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1278/2556] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:01:40 2022] DELETE /identity/v3/users/9ce0a2d8d2874facb70c64884fd08ba1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:01:40.971541 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7909a1-452e-4ac2-a2b4-c608e3cfc1b2 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:41.029015 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45c3cd-2cad-49b8-b42a-1a170da2de2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:41.029973 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45c3cd-2cad-49b8-b42a-1a170da2de2c service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:41.030381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45c3cd-2cad-49b8-b42a-1a170da2de2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:41.030748 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45c3cd-2cad-49b8-b42a-1a170da2de2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:41.032719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ba45c3cd-2cad-49b8-b42a-1a170da2de2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:41.100626 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45c3cd-2cad-49b8-b42a-1a170da2de2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:41.102232 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45c3cd-2cad-49b8-b42a-1a170da2de2c service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:41.113195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1279/2557] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:41.407556 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8e7c9-526a-4304-b833-316f154b90fe admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:41.410013 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f8f8e7c9-526a-4304-b833-316f154b90fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:41.424491 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8e7c9-526a-4304-b833-316f154b90fe admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:41.434513 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ef5f2-ef3e-4fa9-a46f-8f0e0ffffa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:41.435553 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ef5f2-ef3e-4fa9-a46f-8f0e0ffffa36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:41.435860 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ef5f2-ef3e-4fa9-a46f-8f0e0ffffa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:41.436116 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ef5f2-ef3e-4fa9-a46f-8f0e0ffffa36 admin admin] PATH_INFO: `/v3/projects/c265e372c6ee42629352f75f0bdf404a` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:41.437527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ef5f2-ef3e-4fa9-a46f-8f0e0ffffa36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c265e372c6ee42629352f75f0bdf404a)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:41.439476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ef5f2-ef3e-4fa9-a46f-8f0e0ffffa36 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:41.451827 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:41.497124 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-9f4ef5f2-ef3e-4fa9-a46f-8f0e0ffffa36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c265e372c6ee42629352f75f0bdf404a', 'request_id': 'req-9f4ef5f2-ef3e-4fa9-a46f-8f0e0ffffa36'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:41.507105 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-9f4ef5f2-ef3e-4fa9-a46f-8f0e0ffffa36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c265e372c6ee42629352f75f0bdf404a', 'request_id': 'req-9f4ef5f2-ef3e-4fa9-a46f-8f0e0ffffa36'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:41.514724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-9f4ef5f2-ef3e-4fa9-a46f-8f0e0ffffa36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c265e372c6ee42629352f75f0bdf404a', 'request_id': 'req-9f4ef5f2-ef3e-4fa9-a46f-8f0e0ffffa36'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:41.525399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-9f4ef5f2-ef3e-4fa9-a46f-8f0e0ffffa36 admin admin] The token cache is being invalidate because project c265e372c6ee42629352f75f0bdf404a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:01:41.525682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-9f4ef5f2-ef3e-4fa9-a46f-8f0e0ffffa36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:41.526384 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-9f4ef5f2-ef3e-4fa9-a46f-8f0e0ffffa36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:41.527931 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1279/2558] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:01:41 2022] DELETE /identity/v3/projects/c265e372c6ee42629352f75f0bdf404a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:01:41.533267 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8022ee-bf64-4ab2-954d-2a9f2b50eeca None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:41.533747 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8022ee-bf64-4ab2-954d-2a9f2b50eeca None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:41.533987 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8022ee-bf64-4ab2-954d-2a9f2b50eeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:41.554176 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-4d8022ee-bf64-4ab2-954d-2a9f2b50eeca None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:41.555378 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4d8022ee-bf64-4ab2-954d-2a9f2b50eeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:41.617691 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1280/2559] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:41.626746 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0849e5-28f7-45e9-bafb-84a0cd91533f None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:41.627032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0849e5-28f7-45e9-bafb-84a0cd91533f None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:41.627311 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0849e5-28f7-45e9-bafb-84a0cd91533f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:41.647979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-3f0849e5-28f7-45e9-bafb-84a0cd91533f None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:41.649544 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-3f0849e5-28f7-45e9-bafb-84a0cd91533f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:41.658777 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1280/2560] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:01:41.663103 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8022ee-bf64-4ab2-954d-2a9f2b50eeca None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:41.673455 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8022ee-bf64-4ab2-954d-2a9f2b50eeca None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:41.678132 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffadb6c-c843-4b23-81da-9b5f7746d3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:41.678751 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffadb6c-c843-4b23-81da-9b5f7746d3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:41.679121 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffadb6c-c843-4b23-81da-9b5f7746d3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:41.679413 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffadb6c-c843-4b23-81da-9b5f7746d3a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:41.680107 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffadb6c-c843-4b23-81da-9b5f7746d3a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:01:41.680418 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffadb6c-c843-4b23-81da-9b5f7746d3a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:41.682165 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffadb6c-c843-4b23-81da-9b5f7746d3a4 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:41.683777 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:41.695930 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1281/2561] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 18:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:01:41.700530 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0849e5-28f7-45e9-bafb-84a0cd91533f None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:41.710176 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0849e5-28f7-45e9-bafb-84a0cd91533f None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:41.715393 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d6707-4d49-4011-a76a-a1c54a0debaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:41.716024 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d6707-4d49-4011-a76a-a1c54a0debaa admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:41.716355 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d6707-4d49-4011-a76a-a1c54a0debaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:41.716775 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d6707-4d49-4011-a76a-a1c54a0debaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:41.717559 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d6707-4d49-4011-a76a-a1c54a0debaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:41.719446 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d6707-4d49-4011-a76a-a1c54a0debaa admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:41.748193 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1281/2562] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:01:41 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:01:41.752617 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffadb6c-c843-4b23-81da-9b5f7746d3a4 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:41.762829 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffadb6c-c843-4b23-81da-9b5f7746d3a4 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:41.827306 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c49fa-377a-4410-a76b-7d23224edaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:41.827941 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c49fa-377a-4410-a76b-7d23224edaba admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:41.828223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c49fa-377a-4410-a76b-7d23224edaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:41.828497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c49fa-377a-4410-a76b-7d23224edaba admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:41.829194 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c49fa-377a-4410-a76b-7d23224edaba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:41.831132 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c49fa-377a-4410-a76b-7d23224edaba admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:41.859512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1282/2563] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:01:41 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:01:41.864115 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d6707-4d49-4011-a76a-a1c54a0debaa admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:41.875886 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d6707-4d49-4011-a76a-a1c54a0debaa admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:41.880851 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76345de-86d7-4677-b643-f8dcfb130399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:41.881734 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76345de-86d7-4677-b643-f8dcfb130399 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:41.882080 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76345de-86d7-4677-b643-f8dcfb130399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:41.883002 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76345de-86d7-4677-b643-f8dcfb130399 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:41.884211 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76345de-86d7-4677-b643-f8dcfb130399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:41.885998 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76345de-86d7-4677-b643-f8dcfb130399 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:41.900691 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1282/2564] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:41.902217 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c49fa-377a-4410-a76b-7d23224edaba admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:41.913015 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c49fa-377a-4410-a76b-7d23224edaba admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:41.917799 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c36c6-225f-4cbc-aa10-e374ee3d3312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:41.918419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c36c6-225f-4cbc-aa10-e374ee3d3312 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:41.918696 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c36c6-225f-4cbc-aa10-e374ee3d3312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:41.918965 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c36c6-225f-4cbc-aa10-e374ee3d3312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:41.919976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c36c6-225f-4cbc-aa10-e374ee3d3312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:41.921637 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c36c6-225f-4cbc-aa10-e374ee3d3312 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:41.932744 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1283/2565] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:41.938448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76345de-86d7-4677-b643-f8dcfb130399 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:41.947968 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76345de-86d7-4677-b643-f8dcfb130399 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:41.954303 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07799471-e7c3-4dd6-9663-60f9644945f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:41.955137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07799471-e7c3-4dd6-9663-60f9644945f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:41.955521 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07799471-e7c3-4dd6-9663-60f9644945f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:41.955902 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07799471-e7c3-4dd6-9663-60f9644945f8 admin admin] PATH_INFO: `/v3/projects/2b52d686f1d642988c6387584890d3a2/users/0af173ddc701437d92a3faa3f0a3f009/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:41.972540 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07799471-e7c3-4dd6-9663-60f9644945f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b52d686f1d642988c6387584890d3a2, user_id=0af173ddc701437d92a3faa3f0a3f009, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:41.975285 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07799471-e7c3-4dd6-9663-60f9644945f8 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:41.991356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1283/2566] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:01:41 2022] PUT /identity/v3/projects/2b52d686f1d642988c6387584890d3a2/users/0af173ddc701437d92a3faa3f0a3f009/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:42.002389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf16876-d35f-4a82-ba7a-c0d80b429d0a None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:42.002761 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf16876-d35f-4a82-ba7a-c0d80b429d0a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:42.003096 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf16876-d35f-4a82-ba7a-c0d80b429d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:42.038954 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-fcf16876-d35f-4a82-ba7a-c0d80b429d0a None None] MFA Rules not processed for user `0af173ddc701437d92a3faa3f0a3f009`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:42.040199 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fcf16876-d35f-4a82-ba7a-c0d80b429d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:42.117780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1284/2567] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:42.119210 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07799471-e7c3-4dd6-9663-60f9644945f8 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:42.193660 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07799471-e7c3-4dd6-9663-60f9644945f8 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:42.198554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30d127-92dc-4beb-9c53-bca260035c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:42.199518 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30d127-92dc-4beb-9c53-bca260035c93 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:42.199518 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30d127-92dc-4beb-9c53-bca260035c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:42.199725 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30d127-92dc-4beb-9c53-bca260035c93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:42.200503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30d127-92dc-4beb-9c53-bca260035c93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:42.202522 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30d127-92dc-4beb-9c53-bca260035c93 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:42.234940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1284/2568] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:01:42 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:01:42.238687 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf16876-d35f-4a82-ba7a-c0d80b429d0a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:42.256025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf16876-d35f-4a82-ba7a-c0d80b429d0a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:42.324893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a722427-4937-4bc2-87dc-29d9f7947f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:42.325749 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a722427-4937-4bc2-87dc-29d9f7947f01 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:42.326027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a722427-4937-4bc2-87dc-29d9f7947f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:42.326300 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a722427-4937-4bc2-87dc-29d9f7947f01 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:42.327084 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a722427-4937-4bc2-87dc-29d9f7947f01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:42.329042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a722427-4937-4bc2-87dc-29d9f7947f01 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:42.338128 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:42.350760 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1285/2569] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:01:42 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:01:42.354784 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30d127-92dc-4beb-9c53-bca260035c93 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:42.366457 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30d127-92dc-4beb-9c53-bca260035c93 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:42.373735 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29885cd-1278-402d-8ce5-7477609657c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:42.374372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29885cd-1278-402d-8ce5-7477609657c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:42.374654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29885cd-1278-402d-8ce5-7477609657c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:42.374932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29885cd-1278-402d-8ce5-7477609657c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:42.375786 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29885cd-1278-402d-8ce5-7477609657c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:42.377391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29885cd-1278-402d-8ce5-7477609657c4 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:42.388885 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1285/2570] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:42.393439 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a722427-4937-4bc2-87dc-29d9f7947f01 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:42.403439 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a722427-4937-4bc2-87dc-29d9f7947f01 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:42.408263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0008dfa-69b9-4a97-bdeb-5b53ebfca25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:42.408957 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0008dfa-69b9-4a97-bdeb-5b53ebfca25b admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:42.409272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0008dfa-69b9-4a97-bdeb-5b53ebfca25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:42.409539 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0008dfa-69b9-4a97-bdeb-5b53ebfca25b admin admin] PATH_INFO: `/v3/projects/a42fde2c5c694c96a5726c923598e586/users/95b82c88348e4c99bdcbea58112bd172/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:42.428311 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0008dfa-69b9-4a97-bdeb-5b53ebfca25b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42fde2c5c694c96a5726c923598e586, user_id=95b82c88348e4c99bdcbea58112bd172, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:42.431138 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0008dfa-69b9-4a97-bdeb-5b53ebfca25b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:42.450846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1286/2571] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:01:42 2022] PUT /identity/v3/projects/a42fde2c5c694c96a5726c923598e586/users/95b82c88348e4c99bdcbea58112bd172/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:42.455040 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29885cd-1278-402d-8ce5-7477609657c4 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:42.467270 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29885cd-1278-402d-8ce5-7477609657c4 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:42.473243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:42.530535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e2b6b-47bd-4b1b-b5c6-8ae7e8dea839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:42.531194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e2b6b-47bd-4b1b-b5c6-8ae7e8dea839 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:42.531499 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e2b6b-47bd-4b1b-b5c6-8ae7e8dea839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:42.531777 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e2b6b-47bd-4b1b-b5c6-8ae7e8dea839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:42.532463 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e2b6b-47bd-4b1b-b5c6-8ae7e8dea839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:42.534110 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e2b6b-47bd-4b1b-b5c6-8ae7e8dea839 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:42.545204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1286/2572] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:42.549584 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0008dfa-69b9-4a97-bdeb-5b53ebfca25b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:42.560589 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0008dfa-69b9-4a97-bdeb-5b53ebfca25b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:42.565960 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80887876-467f-45e0-a975-87ec2da0ec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:42.566719 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80887876-467f-45e0-a975-87ec2da0ec67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:42.567001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80887876-467f-45e0-a975-87ec2da0ec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:42.567271 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80887876-467f-45e0-a975-87ec2da0ec67 admin admin] PATH_INFO: `/v3/projects/a42fde2c5c694c96a5726c923598e586/users/95b82c88348e4c99bdcbea58112bd172/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:42.569290 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80887876-467f-45e0-a975-87ec2da0ec67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42fde2c5c694c96a5726c923598e586, user_id=95b82c88348e4c99bdcbea58112bd172, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:42.571916 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80887876-467f-45e0-a975-87ec2da0ec67 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:42.583006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1287/2573] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:01:42 2022] PUT /identity/v3/projects/a42fde2c5c694c96a5726c923598e586/users/95b82c88348e4c99bdcbea58112bd172/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:01:42.595022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd483280-d8bb-4184-a7d7-0fa7a43196d1 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:42.595489 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd483280-d8bb-4184-a7d7-0fa7a43196d1 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:42.595776 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd483280-d8bb-4184-a7d7-0fa7a43196d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:42.628188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-dd483280-d8bb-4184-a7d7-0fa7a43196d1 None None] MFA Rules not processed for user `95b82c88348e4c99bdcbea58112bd172`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:42.629505 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-dd483280-d8bb-4184-a7d7-0fa7a43196d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:42.702644 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1287/2574] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:42.714040 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80887876-467f-45e0-a975-87ec2da0ec67 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:42.716030 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-80887876-467f-45e0-a975-87ec2da0ec67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:42.781723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80887876-467f-45e0-a975-87ec2da0ec67 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:42.786229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd63b3a-efb8-4ab1-a547-c9749e0d3e2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:42.786896 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd63b3a-efb8-4ab1-a547-c9749e0d3e2f service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:42.787183 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd63b3a-efb8-4ab1-a547-c9749e0d3e2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:42.787454 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd63b3a-efb8-4ab1-a547-c9749e0d3e2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:42.848386 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd63b3a-efb8-4ab1-a547-c9749e0d3e2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:42.849884 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd63b3a-efb8-4ab1-a547-c9749e0d3e2f service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:42.861304 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1288/2575] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:44.674938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd483280-d8bb-4184-a7d7-0fa7a43196d1 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:44.679063 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-dd483280-d8bb-4184-a7d7-0fa7a43196d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:44.750673 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd483280-d8bb-4184-a7d7-0fa7a43196d1 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:44.755220 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c27a2e-0869-4d69-82a1-d8d88432fac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:44.755856 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c27a2e-0869-4d69-82a1-d8d88432fac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:44.756129 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c27a2e-0869-4d69-82a1-d8d88432fac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:44.756399 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c27a2e-0869-4d69-82a1-d8d88432fac2 admin admin] PATH_INFO: `/v3/users/a00b6b9e5f8b4cceb8a3197e0349fa65` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:44.757578 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c27a2e-0869-4d69-82a1-d8d88432fac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a00b6b9e5f8b4cceb8a3197e0349fa65)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:44.759482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c27a2e-0869-4d69-82a1-d8d88432fac2 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:44.797578 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:44.810895 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-80c27a2e-0869-4d69-82a1-d8d88432fac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a00b6b9e5f8b4cceb8a3197e0349fa65'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:44.826032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-80c27a2e-0869-4d69-82a1-d8d88432fac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a00b6b9e5f8b4cceb8a3197e0349fa65'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:44.835363 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-80c27a2e-0869-4d69-82a1-d8d88432fac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a00b6b9e5f8b4cceb8a3197e0349fa65'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:44.842905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-80c27a2e-0869-4d69-82a1-d8d88432fac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a00b6b9e5f8b4cceb8a3197e0349fa65'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:44.843700 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-80c27a2e-0869-4d69-82a1-d8d88432fac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a00b6b9e5f8b4cceb8a3197e0349fa65'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:44.849853 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1288/2576] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:01:44 2022] DELETE /identity/v3/users/a00b6b9e5f8b4cceb8a3197e0349fa65 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:45.032728 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd63b3a-efb8-4ab1-a547-c9749e0d3e2f service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:45.045775 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd63b3a-efb8-4ab1-a547-c9749e0d3e2f service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:45.110828 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5843e5-1be1-41ad-9f46-9742150e5fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:45.111635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5843e5-1be1-41ad-9f46-9742150e5fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:45.111916 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5843e5-1be1-41ad-9f46-9742150e5fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:45.112221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5843e5-1be1-41ad-9f46-9742150e5fae admin admin] PATH_INFO: `/v3/projects/62c839cc3de8444096cd196d9be403f4` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:45.113404 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5843e5-1be1-41ad-9f46-9742150e5fae admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c839cc3de8444096cd196d9be403f4)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:45.115699 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5843e5-1be1-41ad-9f46-9742150e5fae admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:45.128600 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:45.168087 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4f5843e5-1be1-41ad-9f46-9742150e5fae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c839cc3de8444096cd196d9be403f4', 'request_id': 'req-4f5843e5-1be1-41ad-9f46-9742150e5fae'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:45.175495 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4f5843e5-1be1-41ad-9f46-9742150e5fae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c839cc3de8444096cd196d9be403f4', 'request_id': 'req-4f5843e5-1be1-41ad-9f46-9742150e5fae'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:45.185344 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4f5843e5-1be1-41ad-9f46-9742150e5fae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c839cc3de8444096cd196d9be403f4', 'request_id': 'req-4f5843e5-1be1-41ad-9f46-9742150e5fae'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:45.203843 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4f5843e5-1be1-41ad-9f46-9742150e5fae admin admin] The token cache is being invalidate because project 62c839cc3de8444096cd196d9be403f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:01:45.203843 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4f5843e5-1be1-41ad-9f46-9742150e5fae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:45.204401 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4f5843e5-1be1-41ad-9f46-9742150e5fae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:45.209103 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1289/2577] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:01:45 2022] DELETE /identity/v3/projects/62c839cc3de8444096cd196d9be403f4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:45.212086 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596208d-dab5-44a0-9e99-c1ba14b72a24 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:45.212373 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596208d-dab5-44a0-9e99-c1ba14b72a24 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:45.212646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596208d-dab5-44a0-9e99-c1ba14b72a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:45.234242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-8596208d-dab5-44a0-9e99-c1ba14b72a24 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:45.235503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-8596208d-dab5-44a0-9e99-c1ba14b72a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:45.301420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1289/2578] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:45.309119 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d55668-07ad-498e-bff2-f43bc856a1c1 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:45.309413 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d55668-07ad-498e-bff2-f43bc856a1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:45.309747 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d55668-07ad-498e-bff2-f43bc856a1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:45.330655 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-75d55668-07ad-498e-bff2-f43bc856a1c1 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:45.331885 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-75d55668-07ad-498e-bff2-f43bc856a1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:45.341885 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1290/2579] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:45.346356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596208d-dab5-44a0-9e99-c1ba14b72a24 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:45.356667 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596208d-dab5-44a0-9e99-c1ba14b72a24 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:45.361973 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc9eac-d8d5-4535-8a1b-7abe6516a4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:45.362590 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc9eac-d8d5-4535-8a1b-7abe6516a4da admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:45.362872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc9eac-d8d5-4535-8a1b-7abe6516a4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:45.363176 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc9eac-d8d5-4535-8a1b-7abe6516a4da admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:45.363873 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc9eac-d8d5-4535-8a1b-7abe6516a4da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:01:45.364498 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc9eac-d8d5-4535-8a1b-7abe6516a4da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:45.366126 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc9eac-d8d5-4535-8a1b-7abe6516a4da admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:45.378886 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1290/2580] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 18:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:01:45.383537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d55668-07ad-498e-bff2-f43bc856a1c1 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:45.393756 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d55668-07ad-498e-bff2-f43bc856a1c1 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:45.400578 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deac9e2-6996-4020-bc09-530073365699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:45.401534 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deac9e2-6996-4020-bc09-530073365699 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:45.401894 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deac9e2-6996-4020-bc09-530073365699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:45.402253 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deac9e2-6996-4020-bc09-530073365699 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:45.403238 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deac9e2-6996-4020-bc09-530073365699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:45.405327 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deac9e2-6996-4020-bc09-530073365699 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:45.436848 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1291/2581] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:01:45 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:01:45.443200 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc9eac-d8d5-4535-8a1b-7abe6516a4da admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:45.456279 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc9eac-d8d5-4535-8a1b-7abe6516a4da admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:45.516064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe614188-e9d6-4f21-b1d0-e0f0871ccc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:45.516602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe614188-e9d6-4f21-b1d0-e0f0871ccc1f admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:45.516877 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe614188-e9d6-4f21-b1d0-e0f0871ccc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:45.517163 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe614188-e9d6-4f21-b1d0-e0f0871ccc1f admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:45.517832 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe614188-e9d6-4f21-b1d0-e0f0871ccc1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:45.519795 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe614188-e9d6-4f21-b1d0-e0f0871ccc1f admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:45.546293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1291/2582] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:01:45 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:01:45.550589 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deac9e2-6996-4020-bc09-530073365699 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:45.561736 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deac9e2-6996-4020-bc09-530073365699 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:45.568147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b5e62-39b9-4243-86d3-af256cf41c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:45.569330 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b5e62-39b9-4243-86d3-af256cf41c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:45.569765 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b5e62-39b9-4243-86d3-af256cf41c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:45.570048 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b5e62-39b9-4243-86d3-af256cf41c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:45.570747 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b5e62-39b9-4243-86d3-af256cf41c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:45.572366 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b5e62-39b9-4243-86d3-af256cf41c44 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:45.585787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1292/2583] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:45.589933 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe614188-e9d6-4f21-b1d0-e0f0871ccc1f admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:45.601190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe614188-e9d6-4f21-b1d0-e0f0871ccc1f admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:45.607534 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f86877-1244-47aa-82a8-ce9b3bc07597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:45.608184 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f86877-1244-47aa-82a8-ce9b3bc07597 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:45.608465 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f86877-1244-47aa-82a8-ce9b3bc07597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:45.608734 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f86877-1244-47aa-82a8-ce9b3bc07597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:45.609978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f86877-1244-47aa-82a8-ce9b3bc07597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:45.611190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f86877-1244-47aa-82a8-ce9b3bc07597 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:45.622735 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1292/2584] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:45.626967 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b5e62-39b9-4243-86d3-af256cf41c44 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:45.638251 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b5e62-39b9-4243-86d3-af256cf41c44 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:45.643539 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0e37b-42de-49bc-ac99-c3412227cb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:45.644209 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0e37b-42de-49bc-ac99-c3412227cb99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:45.644509 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0e37b-42de-49bc-ac99-c3412227cb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:45.644792 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0e37b-42de-49bc-ac99-c3412227cb99 admin admin] PATH_INFO: `/v3/projects/61e4eb3c590d4eee9df8a04ed0b1f6fd/users/873f9fb18289424d90f118acd40c4678/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:45.668133 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0e37b-42de-49bc-ac99-c3412227cb99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e4eb3c590d4eee9df8a04ed0b1f6fd, user_id=873f9fb18289424d90f118acd40c4678, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:45.670942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0e37b-42de-49bc-ac99-c3412227cb99 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:45.688235 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1293/2585] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:01:45 2022] PUT /identity/v3/projects/61e4eb3c590d4eee9df8a04ed0b1f6fd/users/873f9fb18289424d90f118acd40c4678/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:45.699303 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf782e-0344-4c95-90bd-b12f73efe6d8 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:45.699819 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf782e-0344-4c95-90bd-b12f73efe6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:45.699819 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf782e-0344-4c95-90bd-b12f73efe6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:45.729408 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-b5cf782e-0344-4c95-90bd-b12f73efe6d8 None None] MFA Rules not processed for user `873f9fb18289424d90f118acd40c4678`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:45.730724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b5cf782e-0344-4c95-90bd-b12f73efe6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:45.735398 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:45.747514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0e37b-42de-49bc-ac99-c3412227cb99 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:45.749710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9eb0e37b-42de-49bc-ac99-c3412227cb99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:45.805618 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1293/2586] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:45.814520 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0e37b-42de-49bc-ac99-c3412227cb99 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:45.817954 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf782e-0344-4c95-90bd-b12f73efe6d8 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:45.819930 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4e6e6-2880-4f0e-b9b9-efb60b904b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:45.820206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b5cf782e-0344-4c95-90bd-b12f73efe6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:45.820579 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4e6e6-2880-4f0e-b9b9-efb60b904b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:45.820892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4e6e6-2880-4f0e-b9b9-efb60b904b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:45.821232 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4e6e6-2880-4f0e-b9b9-efb60b904b9a admin admin] PATH_INFO: `/v3/users/0af173ddc701437d92a3faa3f0a3f009` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:45.822576 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4e6e6-2880-4f0e-b9b9-efb60b904b9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0af173ddc701437d92a3faa3f0a3f009)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:45.824385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4e6e6-2880-4f0e-b9b9-efb60b904b9a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:45.867451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:45.877946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1ef4e6e6-2880-4f0e-b9b9-efb60b904b9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0af173ddc701437d92a3faa3f0a3f009'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:45.879072 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1ef4e6e6-2880-4f0e-b9b9-efb60b904b9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0af173ddc701437d92a3faa3f0a3f009'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:45.886084 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1ef4e6e6-2880-4f0e-b9b9-efb60b904b9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0af173ddc701437d92a3faa3f0a3f009'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:45.899070 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf782e-0344-4c95-90bd-b12f73efe6d8 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:45.899576 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1ef4e6e6-2880-4f0e-b9b9-efb60b904b9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0af173ddc701437d92a3faa3f0a3f009'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:45.900284 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1ef4e6e6-2880-4f0e-b9b9-efb60b904b9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0af173ddc701437d92a3faa3f0a3f009'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:45.905581 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6309e-7d9c-4502-a1b1-83dc6b8556c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:45.906302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6309e-7d9c-4502-a1b1-83dc6b8556c5 service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:45.906551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6309e-7d9c-4502-a1b1-83dc6b8556c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:45.906822 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6309e-7d9c-4502-a1b1-83dc6b8556c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:45.909170 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9fd6309e-7d9c-4502-a1b1-83dc6b8556c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:45.914311 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1294/2587] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:01:45 2022] DELETE /identity/v3/users/0af173ddc701437d92a3faa3f0a3f009 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:45.918704 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ae14d-5797-48f3-8b3f-3373a5d2bea4 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:45.919016 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ae14d-5797-48f3-8b3f-3373a5d2bea4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:45.919331 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ae14d-5797-48f3-8b3f-3373a5d2bea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:45.921602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6309e-7d9c-4502-a1b1-83dc6b8556c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:45.923224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6309e-7d9c-4502-a1b1-83dc6b8556c5 service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:45.932574 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1294/2588] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:45.939444 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-ec2ae14d-5797-48f3-8b3f-3373a5d2bea4 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:45.940666 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ec2ae14d-5797-48f3-8b3f-3373a5d2bea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:46.015196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1295/2589] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:01:46.029176 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6309e-7d9c-4502-a1b1-83dc6b8556c5 service nova] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:46.030815 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9fd6309e-7d9c-4502-a1b1-83dc6b8556c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:46.093832 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6309e-7d9c-4502-a1b1-83dc6b8556c5 service nova] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:46.143418 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:46.149553 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bf9fd-cd6c-49a6-a3bf-4e531ca9164d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:46.150188 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bf9fd-cd6c-49a6-a3bf-4e531ca9164d service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:46.153342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bf9fd-cd6c-49a6-a3bf-4e531ca9164d service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:46.153342 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bf9fd-cd6c-49a6-a3bf-4e531ca9164d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:46.162577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ae14d-5797-48f3-8b3f-3373a5d2bea4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:46.164134 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ec2ae14d-5797-48f3-8b3f-3373a5d2bea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:46.169636 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bf9fd-cd6c-49a6-a3bf-4e531ca9164d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:46.171385 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bf9fd-cd6c-49a6-a3bf-4e531ca9164d service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:46.178243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ae14d-5797-48f3-8b3f-3373a5d2bea4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:46.181094 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1295/2590] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:46.183194 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e0141-d4d2-4afa-94d4-cb75e6f76c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:46.183912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e0141-d4d2-4afa-94d4-cb75e6f76c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:46.184259 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e0141-d4d2-4afa-94d4-cb75e6f76c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:46.184661 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e0141-d4d2-4afa-94d4-cb75e6f76c6a admin admin] PATH_INFO: `/v3/users/873f9fb18289424d90f118acd40c4678` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:46.186181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e0141-d4d2-4afa-94d4-cb75e6f76c6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=873f9fb18289424d90f118acd40c4678)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:46.188228 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e0141-d4d2-4afa-94d4-cb75e6f76c6a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:46.238930 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fe0e0141-d4d2-4afa-94d4-cb75e6f76c6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '873f9fb18289424d90f118acd40c4678'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:46.240005 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fe0e0141-d4d2-4afa-94d4-cb75e6f76c6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '873f9fb18289424d90f118acd40c4678'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:46.247659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fe0e0141-d4d2-4afa-94d4-cb75e6f76c6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '873f9fb18289424d90f118acd40c4678'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:46.261392 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fe0e0141-d4d2-4afa-94d4-cb75e6f76c6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '873f9fb18289424d90f118acd40c4678'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:46.262137 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fe0e0141-d4d2-4afa-94d4-cb75e6f76c6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '873f9fb18289424d90f118acd40c4678'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:46.275820 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1296/2591] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:01:46 2022] DELETE /identity/v3/users/873f9fb18289424d90f118acd40c4678 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:46.280871 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71699bf5-cae3-430d-8c5b-17a744a9f5d0 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:46.281211 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71699bf5-cae3-430d-8c5b-17a744a9f5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:46.281492 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71699bf5-cae3-430d-8c5b-17a744a9f5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:46.304582 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-71699bf5-cae3-430d-8c5b-17a744a9f5d0 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:46.305827 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-71699bf5-cae3-430d-8c5b-17a744a9f5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:46.386871 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1296/2592] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:46.399303 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e0141-d4d2-4afa-94d4-cb75e6f76c6a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:46.400805 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fe0e0141-d4d2-4afa-94d4-cb75e6f76c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:46.434931 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:46.469073 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e0141-d4d2-4afa-94d4-cb75e6f76c6a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:46.473839 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1d8c9-57a6-4bd3-87b9-f59a2752f223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:46.474136 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1d8c9-57a6-4bd3-87b9-f59a2752f223 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:46.474353 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1d8c9-57a6-4bd3-87b9-f59a2752f223 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:46.476481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1d8c9-57a6-4bd3-87b9-f59a2752f223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:46.485327 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1d8c9-57a6-4bd3-87b9-f59a2752f223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:46.486762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1d8c9-57a6-4bd3-87b9-f59a2752f223 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:46.505177 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71699bf5-cae3-430d-8c5b-17a744a9f5d0 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:46.506685 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-71699bf5-cae3-430d-8c5b-17a744a9f5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:46.510828 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1297/2593] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:46.520015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71699bf5-cae3-430d-8c5b-17a744a9f5d0 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:46.524770 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae8be5-82ff-4752-9ed9-8e7a49f32c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:46.525467 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae8be5-82ff-4752-9ed9-8e7a49f32c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:46.525750 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae8be5-82ff-4752-9ed9-8e7a49f32c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:46.526027 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae8be5-82ff-4752-9ed9-8e7a49f32c31 admin admin] PATH_INFO: `/v3/projects/2b52d686f1d642988c6387584890d3a2` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:46.527200 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae8be5-82ff-4752-9ed9-8e7a49f32c31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b52d686f1d642988c6387584890d3a2)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:46.529965 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae8be5-82ff-4752-9ed9-8e7a49f32c31 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:46.580357 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-66ae8be5-82ff-4752-9ed9-8e7a49f32c31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b52d686f1d642988c6387584890d3a2', 'request_id': 'req-66ae8be5-82ff-4752-9ed9-8e7a49f32c31'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:46.588110 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-66ae8be5-82ff-4752-9ed9-8e7a49f32c31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b52d686f1d642988c6387584890d3a2', 'request_id': 'req-66ae8be5-82ff-4752-9ed9-8e7a49f32c31'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:46.595812 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-66ae8be5-82ff-4752-9ed9-8e7a49f32c31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b52d686f1d642988c6387584890d3a2', 'request_id': 'req-66ae8be5-82ff-4752-9ed9-8e7a49f32c31'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:46.607774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-66ae8be5-82ff-4752-9ed9-8e7a49f32c31 admin admin] The token cache is being invalidate because project 2b52d686f1d642988c6387584890d3a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:01:46.608243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-66ae8be5-82ff-4752-9ed9-8e7a49f32c31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:46.609002 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-66ae8be5-82ff-4752-9ed9-8e7a49f32c31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:46.610684 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1297/2594] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:01:46 2022] DELETE /identity/v3/projects/2b52d686f1d642988c6387584890d3a2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:46.615247 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1d8c9-57a6-4bd3-87b9-f59a2752f223 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:46.626418 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1d8c9-57a6-4bd3-87b9-f59a2752f223 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:46.694597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635cab6-7b0d-4398-a4aa-9f5ead8a8f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:46.695403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635cab6-7b0d-4398-a4aa-9f5ead8a8f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:46.695748 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635cab6-7b0d-4398-a4aa-9f5ead8a8f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:46.696055 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635cab6-7b0d-4398-a4aa-9f5ead8a8f7e admin admin] PATH_INFO: `/v3/users/95b82c88348e4c99bdcbea58112bd172` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:46.697821 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635cab6-7b0d-4398-a4aa-9f5ead8a8f7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=95b82c88348e4c99bdcbea58112bd172)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:46.699629 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635cab6-7b0d-4398-a4aa-9f5ead8a8f7e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:46.750594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1635cab6-7b0d-4398-a4aa-9f5ead8a8f7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95b82c88348e4c99bdcbea58112bd172'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:46.751271 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1635cab6-7b0d-4398-a4aa-9f5ead8a8f7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95b82c88348e4c99bdcbea58112bd172'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:46.758545 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1635cab6-7b0d-4398-a4aa-9f5ead8a8f7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95b82c88348e4c99bdcbea58112bd172'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:46.773304 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1635cab6-7b0d-4398-a4aa-9f5ead8a8f7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95b82c88348e4c99bdcbea58112bd172'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:46.774166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1635cab6-7b0d-4398-a4aa-9f5ead8a8f7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95b82c88348e4c99bdcbea58112bd172'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:46.789120 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1298/2595] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:01:46 2022] DELETE /identity/v3/users/95b82c88348e4c99bdcbea58112bd172 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:46.792937 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae8be5-82ff-4752-9ed9-8e7a49f32c31 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:46.795024 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-66ae8be5-82ff-4752-9ed9-8e7a49f32c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:46.810719 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae8be5-82ff-4752-9ed9-8e7a49f32c31 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:46.875146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da78dc3-f07e-49d4-9b88-440f5ff281a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:46.875926 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da78dc3-f07e-49d4-9b88-440f5ff281a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:46.876898 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da78dc3-f07e-49d4-9b88-440f5ff281a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:46.877291 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da78dc3-f07e-49d4-9b88-440f5ff281a2 admin admin] PATH_INFO: `/v3/projects/61e4eb3c590d4eee9df8a04ed0b1f6fd` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:46.878681 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da78dc3-f07e-49d4-9b88-440f5ff281a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e4eb3c590d4eee9df8a04ed0b1f6fd)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:46.880930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da78dc3-f07e-49d4-9b88-440f5ff281a2 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:46.897482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:46.930130 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5da78dc3-f07e-49d4-9b88-440f5ff281a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e4eb3c590d4eee9df8a04ed0b1f6fd', 'request_id': 'req-5da78dc3-f07e-49d4-9b88-440f5ff281a2'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:46.938564 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5da78dc3-f07e-49d4-9b88-440f5ff281a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e4eb3c590d4eee9df8a04ed0b1f6fd', 'request_id': 'req-5da78dc3-f07e-49d4-9b88-440f5ff281a2'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:46.947997 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5da78dc3-f07e-49d4-9b88-440f5ff281a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e4eb3c590d4eee9df8a04ed0b1f6fd', 'request_id': 'req-5da78dc3-f07e-49d4-9b88-440f5ff281a2'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:46.962474 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5da78dc3-f07e-49d4-9b88-440f5ff281a2 admin admin] The token cache is being invalidate because project 61e4eb3c590d4eee9df8a04ed0b1f6fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:01:46.962769 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5da78dc3-f07e-49d4-9b88-440f5ff281a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:46.963475 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5da78dc3-f07e-49d4-9b88-440f5ff281a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:46.965079 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1298/2596] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:01:46 2022] DELETE /identity/v3/projects/61e4eb3c590d4eee9df8a04ed0b1f6fd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:46.970932 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9229de-90c9-4d03-b295-31d961f099d3 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:46.971246 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9229de-90c9-4d03-b295-31d961f099d3 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:46.971521 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9229de-90c9-4d03-b295-31d961f099d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:46.994508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7a9229de-90c9-4d03-b295-31d961f099d3 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:46.995729 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7a9229de-90c9-4d03-b295-31d961f099d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:47.044401 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:47.061126 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1299/2597] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:47.069239 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e641-47ca-4077-a921-b5419569cccb None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.069570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e641-47ca-4077-a921-b5419569cccb None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.069860 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e641-47ca-4077-a921-b5419569cccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.087891 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9229de-90c9-4d03-b295-31d961f099d3 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:47.089345 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7a9229de-90c9-4d03-b295-31d961f099d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:47.095904 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-ddc7e641-47ca-4077-a921-b5419569cccb None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:47.097237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ddc7e641-47ca-4077-a921-b5419569cccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:47.103986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9229de-90c9-4d03-b295-31d961f099d3 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:47.105679 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1299/2598] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:47.110018 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7e641-47ca-4077-a921-b5419569cccb None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:47.114488 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a953ef-b018-4a3c-a9cf-c4ca9bd81bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:47.115165 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a953ef-b018-4a3c-a9cf-c4ca9bd81bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.115436 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a953ef-b018-4a3c-a9cf-c4ca9bd81bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.115842 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a953ef-b018-4a3c-a9cf-c4ca9bd81bfe admin admin] PATH_INFO: `/v3/projects/a42fde2c5c694c96a5726c923598e586` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.117103 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a953ef-b018-4a3c-a9cf-c4ca9bd81bfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42fde2c5c694c96a5726c923598e586)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:47.119027 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a953ef-b018-4a3c-a9cf-c4ca9bd81bfe admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:47.120987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7e641-47ca-4077-a921-b5419569cccb None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:47.126728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152257b-3e69-4514-af47-7d718db7fee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:47.127383 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152257b-3e69-4514-af47-7d718db7fee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.127665 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152257b-3e69-4514-af47-7d718db7fee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.127944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152257b-3e69-4514-af47-7d718db7fee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.128657 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152257b-3e69-4514-af47-7d718db7fee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:01:47.128959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152257b-3e69-4514-af47-7d718db7fee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:47.130633 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152257b-3e69-4514-af47-7d718db7fee2 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:47.143994 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1300/2599] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 18:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:01:47.148673 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152257b-3e69-4514-af47-7d718db7fee2 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:47.159053 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152257b-3e69-4514-af47-7d718db7fee2 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:47.169110 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-85a953ef-b018-4a3c-a9cf-c4ca9bd81bfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42fde2c5c694c96a5726c923598e586', 'request_id': 'req-85a953ef-b018-4a3c-a9cf-c4ca9bd81bfe'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:47.175502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-85a953ef-b018-4a3c-a9cf-c4ca9bd81bfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42fde2c5c694c96a5726c923598e586', 'request_id': 'req-85a953ef-b018-4a3c-a9cf-c4ca9bd81bfe'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:47.184191 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-85a953ef-b018-4a3c-a9cf-c4ca9bd81bfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42fde2c5c694c96a5726c923598e586', 'request_id': 'req-85a953ef-b018-4a3c-a9cf-c4ca9bd81bfe'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:47.197456 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-85a953ef-b018-4a3c-a9cf-c4ca9bd81bfe admin admin] The token cache is being invalidate because project a42fde2c5c694c96a5726c923598e586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:01:47.197747 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-85a953ef-b018-4a3c-a9cf-c4ca9bd81bfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:47.198411 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-85a953ef-b018-4a3c-a9cf-c4ca9bd81bfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:47.200426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1300/2600] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:01:47 2022] DELETE /identity/v3/projects/a42fde2c5c694c96a5726c923598e586 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:01:47.205565 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cae2c2-f38d-4876-9c56-4b221be034a6 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.205861 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cae2c2-f38d-4876-9c56-4b221be034a6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.206299 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cae2c2-f38d-4876-9c56-4b221be034a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.218029 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b3660-53e0-4424-be3d-2238ff8e2a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:47.218691 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b3660-53e0-4424-be3d-2238ff8e2a84 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.218967 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b3660-53e0-4424-be3d-2238ff8e2a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.219242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b3660-53e0-4424-be3d-2238ff8e2a84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.219907 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b3660-53e0-4424-be3d-2238ff8e2a84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:47.221820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b3660-53e0-4424-be3d-2238ff8e2a84 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:47.226298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-25cae2c2-f38d-4876-9c56-4b221be034a6 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:47.227521 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-25cae2c2-f38d-4876-9c56-4b221be034a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:47.235873 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1301/2601] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:01:47.252709 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1301/2602] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:01:47 2022] POST /identity/v3/projects => generated 357 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:01:47.257147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cae2c2-f38d-4876-9c56-4b221be034a6 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:47.258862 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-25cae2c2-f38d-4876-9c56-4b221be034a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:47.272548 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cae2c2-f38d-4876-9c56-4b221be034a6 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:47.305832 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ae6e1-7184-4b8d-b51e-148501becd87 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.306118 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ae6e1-7184-4b8d-b51e-148501becd87 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.306416 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ae6e1-7184-4b8d-b51e-148501becd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.326842 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-7e7ae6e1-7184-4b8d-b51e-148501becd87 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:47.328154 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-7e7ae6e1-7184-4b8d-b51e-148501becd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:47.335834 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc23bd-a3c9-4069-b03a-56b896d0eb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:47.336465 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc23bd-a3c9-4069-b03a-56b896d0eb27 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.336744 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc23bd-a3c9-4069-b03a-56b896d0eb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.337020 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc23bd-a3c9-4069-b03a-56b896d0eb27 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.337710 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc23bd-a3c9-4069-b03a-56b896d0eb27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:47.339648 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc23bd-a3c9-4069-b03a-56b896d0eb27 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:47.362996 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1302/2603] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:01:47 2022] POST /identity/v3/users => generated 279 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:01:47.367461 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc23bd-a3c9-4069-b03a-56b896d0eb27 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:47.377897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc23bd-a3c9-4069-b03a-56b896d0eb27 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:47.383574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b3fd2-2aa9-4896-b66b-cb4b54a2a599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:47.384188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b3fd2-2aa9-4896-b66b-cb4b54a2a599 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.384474 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b3fd2-2aa9-4896-b66b-cb4b54a2a599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.384750 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b3fd2-2aa9-4896-b66b-cb4b54a2a599 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.385488 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b3fd2-2aa9-4896-b66b-cb4b54a2a599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:47.387104 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b3fd2-2aa9-4896-b66b-cb4b54a2a599 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:47.390960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1302/2604] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:01:47.395274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ae6e1-7184-4b8d-b51e-148501becd87 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:47.401298 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1303/2605] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:01:47.402314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b3fd2-2aa9-4896-b66b-cb4b54a2a599 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:47.405234 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ae6e1-7184-4b8d-b51e-148501becd87 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:47.410096 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54364f8b-607d-4238-bcba-effc0e470017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:47.410739 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54364f8b-607d-4238-bcba-effc0e470017 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.411190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54364f8b-607d-4238-bcba-effc0e470017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.411462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54364f8b-607d-4238-bcba-effc0e470017 admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.412163 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54364f8b-607d-4238-bcba-effc0e470017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:01:47.412463 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54364f8b-607d-4238-bcba-effc0e470017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:47.412794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b3fd2-2aa9-4896-b66b-cb4b54a2a599 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:47.414157 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54364f8b-607d-4238-bcba-effc0e470017 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:47.416941 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:47.417496 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a92c7-b443-4191-a2ca-559558928ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:47.418129 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a92c7-b443-4191-a2ca-559558928ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.418659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a92c7-b443-4191-a2ca-559558928ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.418968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a92c7-b443-4191-a2ca-559558928ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.419635 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a92c7-b443-4191-a2ca-559558928ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:47.421395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a92c7-b443-4191-a2ca-559558928ee6 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:47.428955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1303/2606] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 18:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:01:47.433316 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54364f8b-607d-4238-bcba-effc0e470017 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:47.434443 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1304/2607] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:47.438273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a92c7-b443-4191-a2ca-559558928ee6 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:47.444436 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54364f8b-607d-4238-bcba-effc0e470017 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:47.447672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a92c7-b443-4191-a2ca-559558928ee6 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:47.449051 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98041990-a68e-4610-a7ec-220844d8b258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:47.449719 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98041990-a68e-4610-a7ec-220844d8b258 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.450000 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98041990-a68e-4610-a7ec-220844d8b258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.450307 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98041990-a68e-4610-a7ec-220844d8b258 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.450975 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98041990-a68e-4610-a7ec-220844d8b258 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:47.452384 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8191880-3d0a-4065-9fcc-8f92d6b5e229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:47.452871 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98041990-a68e-4610-a7ec-220844d8b258 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:47.453035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8191880-3d0a-4065-9fcc-8f92d6b5e229 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.453341 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8191880-3d0a-4065-9fcc-8f92d6b5e229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.453609 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8191880-3d0a-4065-9fcc-8f92d6b5e229 admin admin] PATH_INFO: `/v3/projects/bad86e79570748c58aa837b5541ad0c1/users/acf5d8d2960c4b7d87107e1b82377866/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.468473 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8191880-3d0a-4065-9fcc-8f92d6b5e229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bad86e79570748c58aa837b5541ad0c1, user_id=acf5d8d2960c4b7d87107e1b82377866, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:47.471184 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8191880-3d0a-4065-9fcc-8f92d6b5e229 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:47.485378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1304/2608] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:01:47 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:01:47.486301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1305/2609] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:01:47 2022] PUT /identity/v3/projects/bad86e79570748c58aa837b5541ad0c1/users/acf5d8d2960c4b7d87107e1b82377866/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:01:47.486426 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98041990-a68e-4610-a7ec-220844d8b258 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:47.496957 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124c97c-cd9c-48a7-89bb-6e610cd98b6c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.497365 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124c97c-cd9c-48a7-89bb-6e610cd98b6c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.497640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124c97c-cd9c-48a7-89bb-6e610cd98b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.517759 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:47.529975 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d124c97c-cd9c-48a7-89bb-6e610cd98b6c None None] MFA Rules not processed for user `acf5d8d2960c4b7d87107e1b82377866`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:47.531715 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d124c97c-cd9c-48a7-89bb-6e610cd98b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:47.557726 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98041990-a68e-4610-a7ec-220844d8b258 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:47.564431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e1fa6-669c-4046-b24d-dffde8bd7e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:47.565197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e1fa6-669c-4046-b24d-dffde8bd7e65 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.565481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e1fa6-669c-4046-b24d-dffde8bd7e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.565758 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e1fa6-669c-4046-b24d-dffde8bd7e65 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.566448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e1fa6-669c-4046-b24d-dffde8bd7e65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:47.568376 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e1fa6-669c-4046-b24d-dffde8bd7e65 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:47.596820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1305/2610] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:01:47 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:01:47.598082 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e1fa6-669c-4046-b24d-dffde8bd7e65 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:47.608357 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e1fa6-669c-4046-b24d-dffde8bd7e65 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:47.611195 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1306/2611] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:47 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:01:47.616120 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124c97c-cd9c-48a7-89bb-6e610cd98b6c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:47.618418 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c1557-826e-42ee-b012-7613c8baf771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:47.619054 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c1557-826e-42ee-b012-7613c8baf771 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.619334 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c1557-826e-42ee-b012-7613c8baf771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.619611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c1557-826e-42ee-b012-7613c8baf771 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.620348 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c1557-826e-42ee-b012-7613c8baf771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:47.622360 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c1557-826e-42ee-b012-7613c8baf771 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:47.627694 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124c97c-cd9c-48a7-89bb-6e610cd98b6c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:47.632756 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b0241-d316-4b87-b807-11a60b62793a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:47.633607 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b0241-d316-4b87-b807-11a60b62793a admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.634242 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b0241-d316-4b87-b807-11a60b62793a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.634723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b0241-d316-4b87-b807-11a60b62793a admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.635563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b0241-d316-4b87-b807-11a60b62793a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:47.636753 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1306/2612] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:47.638264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b0241-d316-4b87-b807-11a60b62793a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:47.641331 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c1557-826e-42ee-b012-7613c8baf771 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:47.652431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c1557-826e-42ee-b012-7613c8baf771 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:47.659403 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a777d-be5e-4018-97af-450f991d1fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:47.660122 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a777d-be5e-4018-97af-450f991d1fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.660463 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a777d-be5e-4018-97af-450f991d1fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.660741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a777d-be5e-4018-97af-450f991d1fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.661546 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a777d-be5e-4018-97af-450f991d1fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:47.663137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a777d-be5e-4018-97af-450f991d1fa6 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:47.671871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1307/2613] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:01:47 2022] POST /identity/v3/projects => generated 357 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:01:47.676112 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b0241-d316-4b87-b807-11a60b62793a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:47.681105 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1307/2614] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:01:47.683871 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a777d-be5e-4018-97af-450f991d1fa6 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:47.708272 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a777d-be5e-4018-97af-450f991d1fa6 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:47.745333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b0241-d316-4b87-b807-11a60b62793a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:47.750473 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30864d71-9540-4459-b7ec-bd5a470749f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:47.751099 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30864d71-9540-4459-b7ec-bd5a470749f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.751384 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30864d71-9540-4459-b7ec-bd5a470749f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.751659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30864d71-9540-4459-b7ec-bd5a470749f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.752354 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30864d71-9540-4459-b7ec-bd5a470749f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:47.754319 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30864d71-9540-4459-b7ec-bd5a470749f7 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:47.772323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce7fed-608f-4649-98da-53b60269caae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:47.773043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce7fed-608f-4649-98da-53b60269caae admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.773438 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce7fed-608f-4649-98da-53b60269caae admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.773706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce7fed-608f-4649-98da-53b60269caae admin admin] PATH_INFO: `/v3/projects/ff9da5a6977d47d080efe988d39ee01b/users/1f74867cc9ca483e8f82a3c3c18c3de0/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.779510 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1308/2615] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:01:47 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:01:47.783530 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30864d71-9540-4459-b7ec-bd5a470749f7 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:47.791423 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce7fed-608f-4649-98da-53b60269caae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff9da5a6977d47d080efe988d39ee01b, user_id=1f74867cc9ca483e8f82a3c3c18c3de0, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:47.793753 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30864d71-9540-4459-b7ec-bd5a470749f7 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:47.794672 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce7fed-608f-4649-98da-53b60269caae admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:47.799996 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99212fa2-3045-4737-a641-7ac0370097f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:47.800693 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99212fa2-3045-4737-a641-7ac0370097f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.801007 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99212fa2-3045-4737-a641-7ac0370097f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.801294 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99212fa2-3045-4737-a641-7ac0370097f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.802044 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99212fa2-3045-4737-a641-7ac0370097f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:47.803662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99212fa2-3045-4737-a641-7ac0370097f0 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:47.809688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1308/2616] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:01:47 2022] PUT /identity/v3/projects/ff9da5a6977d47d080efe988d39ee01b/users/1f74867cc9ca483e8f82a3c3c18c3de0/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:47.820047 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebbebd-f11d-4338-91b4-f34ea99f3248 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.820331 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebbebd-f11d-4338-91b4-f34ea99f3248 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.820605 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebbebd-f11d-4338-91b4-f34ea99f3248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.822164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1309/2617] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:01:47.826390 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99212fa2-3045-4737-a641-7ac0370097f0 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:47.836237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99212fa2-3045-4737-a641-7ac0370097f0 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:47.850136 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-0cebbebd-f11d-4338-91b4-f34ea99f3248 None None] MFA Rules not processed for user `1f74867cc9ca483e8f82a3c3c18c3de0`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:47.851391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-0cebbebd-f11d-4338-91b4-f34ea99f3248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:47.864830 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:47.891629 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:47.900286 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e2702-be02-4bda-9f77-99f54877b101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:47.901037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e2702-be02-4bda-9f77-99f54877b101 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.901498 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e2702-be02-4bda-9f77-99f54877b101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.901777 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e2702-be02-4bda-9f77-99f54877b101 admin admin] PATH_INFO: `/v3/projects/83ff3faf592844cd8274281d13dd1a01/users/019688e15a3e498ca769666e6d3036e3/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.917434 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e2702-be02-4bda-9f77-99f54877b101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ff3faf592844cd8274281d13dd1a01, user_id=019688e15a3e498ca769666e6d3036e3, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:47.920249 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e2702-be02-4bda-9f77-99f54877b101 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:47.922464 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1309/2618] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:01:47.933316 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebbebd-f11d-4338-91b4-f34ea99f3248 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:47.934813 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-0cebbebd-f11d-4338-91b4-f34ea99f3248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:47.937981 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1310/2619] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:01:47 2022] PUT /identity/v3/projects/83ff3faf592844cd8274281d13dd1a01/users/019688e15a3e498ca769666e6d3036e3/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:01:47.942198 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e2702-be02-4bda-9f77-99f54877b101 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:47.993394 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebbebd-f11d-4338-91b4-f34ea99f3248 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:48.003224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e2702-be02-4bda-9f77-99f54877b101 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:48.007852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadee78-703f-4c2a-a824-d8dca42c0f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:48.008472 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadee78-703f-4c2a-a824-d8dca42c0f2f admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:48.008779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadee78-703f-4c2a-a824-d8dca42c0f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:48.009103 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadee78-703f-4c2a-a824-d8dca42c0f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:48.009826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadee78-703f-4c2a-a824-d8dca42c0f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:48.011407 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadee78-703f-4c2a-a824-d8dca42c0f2f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:48.024909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1311/2620] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:01:48.029293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadee78-703f-4c2a-a824-d8dca42c0f2f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:48.039550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadee78-703f-4c2a-a824-d8dca42c0f2f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:48.044200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0bbbe-2352-448f-9b57-e9f86cfa77f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:48.044581 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad5b41-b705-4428-afdf-57c0fc16f3fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:48.044856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0bbbe-2352-448f-9b57-e9f86cfa77f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:48.045168 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0bbbe-2352-448f-9b57-e9f86cfa77f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:48.045340 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad5b41-b705-4428-afdf-57c0fc16f3fb service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:48.045441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0bbbe-2352-448f-9b57-e9f86cfa77f7 admin admin] PATH_INFO: `/v3/projects/83ff3faf592844cd8274281d13dd1a01/users/019688e15a3e498ca769666e6d3036e3/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:48.045603 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad5b41-b705-4428-afdf-57c0fc16f3fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:48.045881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad5b41-b705-4428-afdf-57c0fc16f3fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:48.047396 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0bbbe-2352-448f-9b57-e9f86cfa77f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ff3faf592844cd8274281d13dd1a01, user_id=019688e15a3e498ca769666e6d3036e3, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:48.050221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0bbbe-2352-448f-9b57-e9f86cfa77f7 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:48.060685 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1312/2621] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:01:48 2022] PUT /identity/v3/projects/83ff3faf592844cd8274281d13dd1a01/users/019688e15a3e498ca769666e6d3036e3/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:01:48.071913 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d6b42-f343-4e79-aee6-77562688f800 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:48.072204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d6b42-f343-4e79-aee6-77562688f800 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:48.072480 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d6b42-f343-4e79-aee6-77562688f800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:48.099812 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c08d6b42-f343-4e79-aee6-77562688f800 None None] MFA Rules not processed for user `019688e15a3e498ca769666e6d3036e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:48.101079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c08d6b42-f343-4e79-aee6-77562688f800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:48.103081 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad5b41-b705-4428-afdf-57c0fc16f3fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:48.104569 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad5b41-b705-4428-afdf-57c0fc16f3fb service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:48.116648 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1310/2622] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:01:48.181218 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1313/2623] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:48 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:01:48.191547 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad5b41-b705-4428-afdf-57c0fc16f3fb service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:48.192991 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-52ad5b41-b705-4428-afdf-57c0fc16f3fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:48.203947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad5b41-b705-4428-afdf-57c0fc16f3fb service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:48.223883 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:48.259613 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f70b5-860c-45fb-97bf-3c0611f2a296 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:48.260375 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f70b5-860c-45fb-97bf-3c0611f2a296 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:48.260683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f70b5-860c-45fb-97bf-3c0611f2a296 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:48.260961 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f70b5-860c-45fb-97bf-3c0611f2a296 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:48.271114 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f70b5-860c-45fb-97bf-3c0611f2a296 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:48.272635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f70b5-860c-45fb-97bf-3c0611f2a296 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:48.283230 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1311/2624] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:48 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:48.377829 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d6b42-f343-4e79-aee6-77562688f800 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:48.383593 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d6b42-f343-4e79-aee6-77562688f800 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:48.388539 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0f758-029a-49fc-9b05-0347f4a87e1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:48.389221 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0f758-029a-49fc-9b05-0347f4a87e1d service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:48.389562 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0f758-029a-49fc-9b05-0347f4a87e1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:48.389829 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0f758-029a-49fc-9b05-0347f4a87e1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:48.443832 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:48.458222 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a0f758-029a-49fc-9b05-0347f4a87e1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:48.459773 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a0f758-029a-49fc-9b05-0347f4a87e1d service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:48.470736 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1314/2625] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:48 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:54.276039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a3e07-c7c1-4f2b-8925-5aef0f8ab08a None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:54.276595 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a3e07-c7c1-4f2b-8925-5aef0f8ab08a None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:54.276709 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a3e07-c7c1-4f2b-8925-5aef0f8ab08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:54.298909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-b14a3e07-c7c1-4f2b-8925-5aef0f8ab08a None None] MFA Rules not processed for user `a1936a2649c349d481f56304b3ee55b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:54.300430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b14a3e07-c7c1-4f2b-8925-5aef0f8ab08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:54.356937 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1312/2626] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Jul 28 18:01:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:54.414305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0f758-029a-49fc-9b05-0347f4a87e1d service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:54.416380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a6a0f758-029a-49fc-9b05-0347f4a87e1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:54.497956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0f758-029a-49fc-9b05-0347f4a87e1d service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:54.503422 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad255d33-0108-4db1-b0aa-392ddcb73cdd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ea1a9023eaf427f96f86af909a803fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:54.504041 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad255d33-0108-4db1-b0aa-392ddcb73cdd service swift] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:54.504614 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad255d33-0108-4db1-b0aa-392ddcb73cdd service swift] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:54.504614 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad255d33-0108-4db1-b0aa-392ddcb73cdd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:54.512889 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad255d33-0108-4db1-b0aa-392ddcb73cdd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:54.515243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad255d33-0108-4db1-b0aa-392ddcb73cdd service swift] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:54.524248 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1315/2627] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Jul 28 18:01:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:01:56.630152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a3e07-c7c1-4f2b-8925-5aef0f8ab08a None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:56.631781 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b14a3e07-c7c1-4f2b-8925-5aef0f8ab08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:56.778883 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a3e07-c7c1-4f2b-8925-5aef0f8ab08a None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:56.793249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa97fe-7ca6-47f3-a18e-51715dadab3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:56.794829 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa97fe-7ca6-47f3-a18e-51715dadab3e service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:56.795281 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa97fe-7ca6-47f3-a18e-51715dadab3e service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:56.795832 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa97fe-7ca6-47f3-a18e-51715dadab3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:56.799404 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f6fa97fe-7ca6-47f3-a18e-51715dadab3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:56.817561 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa97fe-7ca6-47f3-a18e-51715dadab3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:56.820521 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa97fe-7ca6-47f3-a18e-51715dadab3e service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:56.834130 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1313/2628] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:58.469634 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad255d33-0108-4db1-b0aa-392ddcb73cdd service swift] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:58.560205 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad255d33-0108-4db1-b0aa-392ddcb73cdd service swift] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:58.566259 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b34f61-aeb0-46c6-a09a-010a0fc730b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:58.570843 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b34f61-aeb0-46c6-a09a-010a0fc730b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:58.571135 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b34f61-aeb0-46c6-a09a-010a0fc730b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:58.571444 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b34f61-aeb0-46c6-a09a-010a0fc730b0 admin admin] PATH_INFO: `/v3/users/1f74867cc9ca483e8f82a3c3c18c3de0` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:58.572843 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b34f61-aeb0-46c6-a09a-010a0fc730b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f74867cc9ca483e8f82a3c3c18c3de0)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:58.575508 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b34f61-aeb0-46c6-a09a-010a0fc730b0 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:58.672653 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-65b34f61-aeb0-46c6-a09a-010a0fc730b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f74867cc9ca483e8f82a3c3c18c3de0'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:58.681904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-65b34f61-aeb0-46c6-a09a-010a0fc730b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f74867cc9ca483e8f82a3c3c18c3de0'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:58.698074 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-65b34f61-aeb0-46c6-a09a-010a0fc730b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f74867cc9ca483e8f82a3c3c18c3de0'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:58.731826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-65b34f61-aeb0-46c6-a09a-010a0fc730b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f74867cc9ca483e8f82a3c3c18c3de0'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:58.732672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-65b34f61-aeb0-46c6-a09a-010a0fc730b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f74867cc9ca483e8f82a3c3c18c3de0'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:58.735604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:58.753800 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1316/2629] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:01:58 2022] DELETE /identity/v3/users/1f74867cc9ca483e8f82a3c3c18c3de0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:01:58.758168 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a174c-a279-4786-a5eb-e523c327a371 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:58.758985 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a174c-a279-4786-a5eb-e523c327a371 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:58.759266 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a174c-a279-4786-a5eb-e523c327a371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:58.781412 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-cc3a174c-a279-4786-a5eb-e523c327a371 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:58.784067 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-cc3a174c-a279-4786-a5eb-e523c327a371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:58.844270 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:58.859475 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1314/2630] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:58.868049 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b34f61-aeb0-46c6-a09a-010a0fc730b0 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:58.870032 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-65b34f61-aeb0-46c6-a09a-010a0fc730b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:58.943188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b34f61-aeb0-46c6-a09a-010a0fc730b0 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:58.946886 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8078f4-5fdf-4068-884a-f5dd502385d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:58.947522 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8078f4-5fdf-4068-884a-f5dd502385d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:58.947799 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8078f4-5fdf-4068-884a-f5dd502385d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:58.948065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8078f4-5fdf-4068-884a-f5dd502385d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:58.962064 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8078f4-5fdf-4068-884a-f5dd502385d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:58.963524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8078f4-5fdf-4068-884a-f5dd502385d3 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:58.974189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1317/2631] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:59.342785 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a174c-a279-4786-a5eb-e523c327a371 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:59.345031 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-cc3a174c-a279-4786-a5eb-e523c327a371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:59.361504 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a174c-a279-4786-a5eb-e523c327a371 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:59.370776 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349118e-f9a3-4dd3-a772-9d3a24aa85fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:59.372119 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349118e-f9a3-4dd3-a772-9d3a24aa85fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:59.372119 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349118e-f9a3-4dd3-a772-9d3a24aa85fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:59.372500 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349118e-f9a3-4dd3-a772-9d3a24aa85fc admin admin] PATH_INFO: `/v3/projects/ff9da5a6977d47d080efe988d39ee01b` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:59.373897 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349118e-f9a3-4dd3-a772-9d3a24aa85fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff9da5a6977d47d080efe988d39ee01b)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:59.376001 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349118e-f9a3-4dd3-a772-9d3a24aa85fc admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:59.439224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a349118e-f9a3-4dd3-a772-9d3a24aa85fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff9da5a6977d47d080efe988d39ee01b', 'request_id': 'req-a349118e-f9a3-4dd3-a772-9d3a24aa85fc'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:59.452783 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a349118e-f9a3-4dd3-a772-9d3a24aa85fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff9da5a6977d47d080efe988d39ee01b', 'request_id': 'req-a349118e-f9a3-4dd3-a772-9d3a24aa85fc'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:59.461212 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a349118e-f9a3-4dd3-a772-9d3a24aa85fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff9da5a6977d47d080efe988d39ee01b', 'request_id': 'req-a349118e-f9a3-4dd3-a772-9d3a24aa85fc'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:59.479594 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a349118e-f9a3-4dd3-a772-9d3a24aa85fc admin admin] The token cache is being invalidate because project ff9da5a6977d47d080efe988d39ee01b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:01:59.480033 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a349118e-f9a3-4dd3-a772-9d3a24aa85fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:59.480820 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a349118e-f9a3-4dd3-a772-9d3a24aa85fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:01:59.483081 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1315/2632] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:01:59 2022] DELETE /identity/v3/projects/ff9da5a6977d47d080efe988d39ee01b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:04.177418 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8078f4-5fdf-4068-884a-f5dd502385d3 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:04.178953 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fe8078f4-5fdf-4068-884a-f5dd502385d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:04.192331 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8078f4-5fdf-4068-884a-f5dd502385d3 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:04.251134 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5ee13-7725-40ae-8ae4-287cbd4636a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:04.251983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5ee13-7725-40ae-8ae4-287cbd4636a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:04.252521 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5ee13-7725-40ae-8ae4-287cbd4636a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:04.252981 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5ee13-7725-40ae-8ae4-287cbd4636a1 admin admin] PATH_INFO: `/v3/users/acf5d8d2960c4b7d87107e1b82377866` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:04.254357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5ee13-7725-40ae-8ae4-287cbd4636a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf5d8d2960c4b7d87107e1b82377866)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:04.256286 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5ee13-7725-40ae-8ae4-287cbd4636a1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:04.309485 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1ae5ee13-7725-40ae-8ae4-287cbd4636a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf5d8d2960c4b7d87107e1b82377866'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:04.310526 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1ae5ee13-7725-40ae-8ae4-287cbd4636a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf5d8d2960c4b7d87107e1b82377866'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:04.320585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1ae5ee13-7725-40ae-8ae4-287cbd4636a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf5d8d2960c4b7d87107e1b82377866'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:04.336925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1ae5ee13-7725-40ae-8ae4-287cbd4636a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf5d8d2960c4b7d87107e1b82377866'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:04.337717 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1ae5ee13-7725-40ae-8ae4-287cbd4636a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf5d8d2960c4b7d87107e1b82377866'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:04.352982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1318/2633] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:02:04 2022] DELETE /identity/v3/users/acf5d8d2960c4b7d87107e1b82377866 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:04.357807 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac539c4-0d2e-466d-841a-4faa9a748581 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:04.358293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac539c4-0d2e-466d-841a-4faa9a748581 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:04.358499 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac539c4-0d2e-466d-841a-4faa9a748581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:04.379453 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-aac539c4-0d2e-466d-841a-4faa9a748581 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:04.380774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-aac539c4-0d2e-466d-841a-4faa9a748581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:04.451194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1316/2634] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:04.461254 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5ee13-7725-40ae-8ae4-287cbd4636a1 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:04.463403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1ae5ee13-7725-40ae-8ae4-287cbd4636a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:04.483745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:04.535064 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5ee13-7725-40ae-8ae4-287cbd4636a1 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:04.539723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e45e2-632c-4efb-b789-aeaab80c2e7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:04.540443 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e45e2-632c-4efb-b789-aeaab80c2e7a service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:04.540813 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e45e2-632c-4efb-b789-aeaab80c2e7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:04.541171 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e45e2-632c-4efb-b789-aeaab80c2e7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:04.551543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e45e2-632c-4efb-b789-aeaab80c2e7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:04.552997 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e45e2-632c-4efb-b789-aeaab80c2e7a service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:04.563722 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1319/2635] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:04.936299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac539c4-0d2e-466d-841a-4faa9a748581 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:04.937771 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-aac539c4-0d2e-466d-841a-4faa9a748581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:04.950905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac539c4-0d2e-466d-841a-4faa9a748581 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:04.955968 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7b040-1c0c-4e0e-a53d-ff6609e03be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:04.956643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7b040-1c0c-4e0e-a53d-ff6609e03be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:04.956921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7b040-1c0c-4e0e-a53d-ff6609e03be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:04.957224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7b040-1c0c-4e0e-a53d-ff6609e03be7 admin admin] PATH_INFO: `/v3/projects/bad86e79570748c58aa837b5541ad0c1` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:04.958483 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7b040-1c0c-4e0e-a53d-ff6609e03be7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bad86e79570748c58aa837b5541ad0c1)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:04.961311 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7b040-1c0c-4e0e-a53d-ff6609e03be7 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:05.015437 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-3ce7b040-1c0c-4e0e-a53d-ff6609e03be7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bad86e79570748c58aa837b5541ad0c1', 'request_id': 'req-3ce7b040-1c0c-4e0e-a53d-ff6609e03be7'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:05.029891 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-3ce7b040-1c0c-4e0e-a53d-ff6609e03be7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bad86e79570748c58aa837b5541ad0c1', 'request_id': 'req-3ce7b040-1c0c-4e0e-a53d-ff6609e03be7'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:05.040479 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-3ce7b040-1c0c-4e0e-a53d-ff6609e03be7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bad86e79570748c58aa837b5541ad0c1', 'request_id': 'req-3ce7b040-1c0c-4e0e-a53d-ff6609e03be7'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:05.057190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-3ce7b040-1c0c-4e0e-a53d-ff6609e03be7 admin admin] The token cache is being invalidate because project bad86e79570748c58aa837b5541ad0c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:02:05.057487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-3ce7b040-1c0c-4e0e-a53d-ff6609e03be7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:05.058252 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-3ce7b040-1c0c-4e0e-a53d-ff6609e03be7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:05.060118 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1317/2636] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:02:04 2022] DELETE /identity/v3/projects/bad86e79570748c58aa837b5541ad0c1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:05.064345 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e45e2-632c-4efb-b789-aeaab80c2e7a service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:05.075492 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e45e2-632c-4efb-b789-aeaab80c2e7a service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:05.141878 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a2608-6480-4586-bef1-8d35161788ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:05.142700 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a2608-6480-4586-bef1-8d35161788ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:05.143008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a2608-6480-4586-bef1-8d35161788ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:05.143435 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a2608-6480-4586-bef1-8d35161788ed admin admin] PATH_INFO: `/v3/users/019688e15a3e498ca769666e6d3036e3` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:05.144630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a2608-6480-4586-bef1-8d35161788ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=019688e15a3e498ca769666e6d3036e3)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:05.146619 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a2608-6480-4586-bef1-8d35161788ed admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:05.197763 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-cf5a2608-6480-4586-bef1-8d35161788ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '019688e15a3e498ca769666e6d3036e3'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:05.198453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-cf5a2608-6480-4586-bef1-8d35161788ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '019688e15a3e498ca769666e6d3036e3'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:05.205424 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-cf5a2608-6480-4586-bef1-8d35161788ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '019688e15a3e498ca769666e6d3036e3'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:05.217490 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-cf5a2608-6480-4586-bef1-8d35161788ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '019688e15a3e498ca769666e6d3036e3'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:05.218686 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-cf5a2608-6480-4586-bef1-8d35161788ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '019688e15a3e498ca769666e6d3036e3'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:05.233529 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1320/2637] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:02:05 2022] DELETE /identity/v3/users/019688e15a3e498ca769666e6d3036e3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:05.519393 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7b040-1c0c-4e0e-a53d-ff6609e03be7 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:05.520870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-3ce7b040-1c0c-4e0e-a53d-ff6609e03be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:05.531011 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:05.535359 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7b040-1c0c-4e0e-a53d-ff6609e03be7 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:05.599128 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45c969-c54a-40fe-8169-8cda0880a88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:05.599781 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45c969-c54a-40fe-8169-8cda0880a88b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:05.600068 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45c969-c54a-40fe-8169-8cda0880a88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:05.600344 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45c969-c54a-40fe-8169-8cda0880a88b admin admin] PATH_INFO: `/v3/projects/83ff3faf592844cd8274281d13dd1a01` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:05.601572 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45c969-c54a-40fe-8169-8cda0880a88b admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ff3faf592844cd8274281d13dd1a01)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:05.603478 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45c969-c54a-40fe-8169-8cda0880a88b admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:05.651689 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-7f45c969-c54a-40fe-8169-8cda0880a88b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ff3faf592844cd8274281d13dd1a01', 'request_id': 'req-7f45c969-c54a-40fe-8169-8cda0880a88b'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:05.660982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-7f45c969-c54a-40fe-8169-8cda0880a88b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ff3faf592844cd8274281d13dd1a01', 'request_id': 'req-7f45c969-c54a-40fe-8169-8cda0880a88b'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:05.668071 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-7f45c969-c54a-40fe-8169-8cda0880a88b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ff3faf592844cd8274281d13dd1a01', 'request_id': 'req-7f45c969-c54a-40fe-8169-8cda0880a88b'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:05.679948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-7f45c969-c54a-40fe-8169-8cda0880a88b admin admin] The token cache is being invalidate because project 83ff3faf592844cd8274281d13dd1a01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:02:05.680235 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-7f45c969-c54a-40fe-8169-8cda0880a88b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:05.680969 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-7f45c969-c54a-40fe-8169-8cda0880a88b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:05.682853 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1318/2638] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:02:05 2022] DELETE /identity/v3/projects/83ff3faf592844cd8274281d13dd1a01 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:05.687766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bf193-7e8d-43da-a0f4-04fb5d4eb78c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:05.688175 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bf193-7e8d-43da-a0f4-04fb5d4eb78c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:05.688342 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bf193-7e8d-43da-a0f4-04fb5d4eb78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:05.709176 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-119bf193-7e8d-43da-a0f4-04fb5d4eb78c None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:05.710315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-119bf193-7e8d-43da-a0f4-04fb5d4eb78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:05.744235 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:05.773336 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1321/2639] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:05.781609 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a3989-b3f8-4f3c-bd5b-5ba95d7feb73 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:05.781896 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a3989-b3f8-4f3c-bd5b-5ba95d7feb73 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:05.782202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a3989-b3f8-4f3c-bd5b-5ba95d7feb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:05.803473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-bd5a3989-b3f8-4f3c-bd5b-5ba95d7feb73 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:05.804692 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-bd5a3989-b3f8-4f3c-bd5b-5ba95d7feb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:05.812656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1319/2640] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:05.816954 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bf193-7e8d-43da-a0f4-04fb5d4eb78c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:05.826850 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bf193-7e8d-43da-a0f4-04fb5d4eb78c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:05.832247 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc7b35-2982-4988-8433-e677c1f680c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:05.832918 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc7b35-2982-4988-8433-e677c1f680c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:05.833203 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc7b35-2982-4988-8433-e677c1f680c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:05.833475 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc7b35-2982-4988-8433-e677c1f680c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:05.834170 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc7b35-2982-4988-8433-e677c1f680c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:02:05.834468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc7b35-2982-4988-8433-e677c1f680c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:05.836110 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc7b35-2982-4988-8433-e677c1f680c5 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:05.849166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1322/2641] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 18:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:02:05.853751 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a3989-b3f8-4f3c-bd5b-5ba95d7feb73 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:05.864495 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a3989-b3f8-4f3c-bd5b-5ba95d7feb73 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:05.869338 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739390db-7d1b-4ae8-863f-1c61329380ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:05.869950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739390db-7d1b-4ae8-863f-1c61329380ba admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:05.870231 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739390db-7d1b-4ae8-863f-1c61329380ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:05.870503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739390db-7d1b-4ae8-863f-1c61329380ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:05.871163 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739390db-7d1b-4ae8-863f-1c61329380ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:05.873080 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739390db-7d1b-4ae8-863f-1c61329380ba admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:05.903417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1320/2642] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:02:05 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:02:05.907872 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc7b35-2982-4988-8433-e677c1f680c5 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:05.918444 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc7b35-2982-4988-8433-e677c1f680c5 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:05.975697 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564085b-98da-4d7b-b33b-8241b5430369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:05.976244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564085b-98da-4d7b-b33b-8241b5430369 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:05.976528 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564085b-98da-4d7b-b33b-8241b5430369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:05.976802 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564085b-98da-4d7b-b33b-8241b5430369 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:05.977542 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564085b-98da-4d7b-b33b-8241b5430369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:05.979472 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564085b-98da-4d7b-b33b-8241b5430369 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:06.004379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1323/2643] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:02:05 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:02:06.008742 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739390db-7d1b-4ae8-863f-1c61329380ba admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:06.019481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739390db-7d1b-4ae8-863f-1c61329380ba admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:06.024611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8933980-360f-4df9-809d-beea53a60de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:06.025379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8933980-360f-4df9-809d-beea53a60de2 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:06.025709 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8933980-360f-4df9-809d-beea53a60de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:06.026033 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8933980-360f-4df9-809d-beea53a60de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:06.026770 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8933980-360f-4df9-809d-beea53a60de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:06.028449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8933980-360f-4df9-809d-beea53a60de2 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:06.039723 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1321/2644] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:02:06.043926 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564085b-98da-4d7b-b33b-8241b5430369 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:06.054149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564085b-98da-4d7b-b33b-8241b5430369 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:06.059107 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283475df-8c88-43bb-9681-d4b81339a101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:06.059721 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283475df-8c88-43bb-9681-d4b81339a101 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:06.060000 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283475df-8c88-43bb-9681-d4b81339a101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:06.060276 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283475df-8c88-43bb-9681-d4b81339a101 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:06.060964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283475df-8c88-43bb-9681-d4b81339a101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:06.062615 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283475df-8c88-43bb-9681-d4b81339a101 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:06.074513 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1324/2645] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:02:06.078734 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8933980-360f-4df9-809d-beea53a60de2 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:06.088874 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8933980-360f-4df9-809d-beea53a60de2 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:06.093822 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62704225-fc6d-4287-8419-7a6b152816fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:06.094515 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62704225-fc6d-4287-8419-7a6b152816fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:06.094794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62704225-fc6d-4287-8419-7a6b152816fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:06.095065 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62704225-fc6d-4287-8419-7a6b152816fc admin admin] PATH_INFO: `/v3/projects/8066b8c3ffd94af6a3190ae5919c7e4e/users/941db4c195214bc4a8e461896a2836f5/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:06.109756 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62704225-fc6d-4287-8419-7a6b152816fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8066b8c3ffd94af6a3190ae5919c7e4e, user_id=941db4c195214bc4a8e461896a2836f5, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:06.112412 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62704225-fc6d-4287-8419-7a6b152816fc admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:06.129723 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1322/2646] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:02:06 2022] PUT /identity/v3/projects/8066b8c3ffd94af6a3190ae5919c7e4e/users/941db4c195214bc4a8e461896a2836f5/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:06.140214 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aefcc8-7d34-4638-b1b5-fdbaa24bc856 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:06.140502 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aefcc8-7d34-4638-b1b5-fdbaa24bc856 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:06.140775 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aefcc8-7d34-4638-b1b5-fdbaa24bc856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:06.171075 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e5aefcc8-7d34-4638-b1b5-fdbaa24bc856 None None] MFA Rules not processed for user `941db4c195214bc4a8e461896a2836f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:06.172292 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e5aefcc8-7d34-4638-b1b5-fdbaa24bc856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:06.237905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1325/2647] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:02:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:06.243525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62704225-fc6d-4287-8419-7a6b152816fc admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:06.282639 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:06.321655 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62704225-fc6d-4287-8419-7a6b152816fc admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:06.327141 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5732b76-5ba9-4843-97d5-15f8d98782df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:06.327766 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5732b76-5ba9-4843-97d5-15f8d98782df admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:06.328055 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5732b76-5ba9-4843-97d5-15f8d98782df admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:06.328319 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5732b76-5ba9-4843-97d5-15f8d98782df admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:06.328981 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5732b76-5ba9-4843-97d5-15f8d98782df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:06.331292 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5732b76-5ba9-4843-97d5-15f8d98782df admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:06.364185 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1323/2648] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:02:06 2022] POST /identity/v3/projects => generated 389 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:02:06.368213 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aefcc8-7d34-4638-b1b5-fdbaa24bc856 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:06.380627 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aefcc8-7d34-4638-b1b5-fdbaa24bc856 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:06.412200 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:06.440300 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f91899-c213-4d2b-a660-0c76cf2739a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:06.440971 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f91899-c213-4d2b-a660-0c76cf2739a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:06.441575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f91899-c213-4d2b-a660-0c76cf2739a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:06.441677 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f91899-c213-4d2b-a660-0c76cf2739a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:06.442311 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f91899-c213-4d2b-a660-0c76cf2739a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:06.444270 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f91899-c213-4d2b-a660-0c76cf2739a1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:06.468780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1326/2649] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:02:06 2022] POST /identity/v3/users => generated 301 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:02:06.472155 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5732b76-5ba9-4843-97d5-15f8d98782df admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:06.482823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5732b76-5ba9-4843-97d5-15f8d98782df admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:06.488066 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c01dd-9e41-466d-ab1c-656c4b2bb6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:06.488927 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c01dd-9e41-466d-ab1c-656c4b2bb6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:06.489246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c01dd-9e41-466d-ab1c-656c4b2bb6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:06.489523 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c01dd-9e41-466d-ab1c-656c4b2bb6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:06.490206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c01dd-9e41-466d-ab1c-656c4b2bb6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:06.491819 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c01dd-9e41-466d-ab1c-656c4b2bb6d0 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:06.505113 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1324/2650] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:02:06.509411 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f91899-c213-4d2b-a660-0c76cf2739a1 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:06.520151 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f91899-c213-4d2b-a660-0c76cf2739a1 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:06.527385 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b8b59-1b43-4179-bfc0-1695bee364ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:06.528496 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b8b59-1b43-4179-bfc0-1695bee364ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:06.528963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b8b59-1b43-4179-bfc0-1695bee364ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:06.529419 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b8b59-1b43-4179-bfc0-1695bee364ad admin admin] PATH_INFO: `/v3/projects/e8ba3c5997c8493d8f7c44f64fb1cabc/users/d86c47c0af464a9f8400eb9cf41c3307/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:06.547278 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b8b59-1b43-4179-bfc0-1695bee364ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ba3c5997c8493d8f7c44f64fb1cabc, user_id=d86c47c0af464a9f8400eb9cf41c3307, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:06.550373 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b8b59-1b43-4179-bfc0-1695bee364ad admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:06.567267 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1327/2651] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:02:06 2022] PUT /identity/v3/projects/e8ba3c5997c8493d8f7c44f64fb1cabc/users/d86c47c0af464a9f8400eb9cf41c3307/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:06.571296 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c01dd-9e41-466d-ab1c-656c4b2bb6d0 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:06.584198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c01dd-9e41-466d-ab1c-656c4b2bb6d0 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:06.656845 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976c76c-6765-42d7-b20c-1f11734b344b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:06.657552 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976c76c-6765-42d7-b20c-1f11734b344b admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:06.657846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976c76c-6765-42d7-b20c-1f11734b344b admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:06.658128 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976c76c-6765-42d7-b20c-1f11734b344b admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:06.658816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976c76c-6765-42d7-b20c-1f11734b344b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:06.660435 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976c76c-6765-42d7-b20c-1f11734b344b admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:06.670612 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1325/2652] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:02:06.675095 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b8b59-1b43-4179-bfc0-1695bee364ad admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:06.685421 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b8b59-1b43-4179-bfc0-1695bee364ad admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:06.690441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4e439-8ddd-4200-beae-afd6f671455f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:06.691293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4e439-8ddd-4200-beae-afd6f671455f admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:06.691387 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4e439-8ddd-4200-beae-afd6f671455f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:06.691632 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4e439-8ddd-4200-beae-afd6f671455f admin admin] PATH_INFO: `/v3/projects/e8ba3c5997c8493d8f7c44f64fb1cabc/users/d86c47c0af464a9f8400eb9cf41c3307/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:06.693720 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4e439-8ddd-4200-beae-afd6f671455f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ba3c5997c8493d8f7c44f64fb1cabc, user_id=d86c47c0af464a9f8400eb9cf41c3307, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:06.696347 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4e439-8ddd-4200-beae-afd6f671455f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:06.707149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1328/2653] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:02:06 2022] PUT /identity/v3/projects/e8ba3c5997c8493d8f7c44f64fb1cabc/users/d86c47c0af464a9f8400eb9cf41c3307/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:06.718699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1b278-640b-4d57-ad2d-e94e8fbab415 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:06.718990 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1b278-640b-4d57-ad2d-e94e8fbab415 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:06.719269 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1b278-640b-4d57-ad2d-e94e8fbab415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:06.747932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-4de1b278-640b-4d57-ad2d-e94e8fbab415 None None] MFA Rules not processed for user `d86c47c0af464a9f8400eb9cf41c3307`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:06.749092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-4de1b278-640b-4d57-ad2d-e94e8fbab415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:06.825443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1326/2654] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:02:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:06.836633 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4e439-8ddd-4200-beae-afd6f671455f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:06.838554 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-38a4e439-8ddd-4200-beae-afd6f671455f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:06.910026 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4e439-8ddd-4200-beae-afd6f671455f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:06.914056 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0495f7-68d4-4526-9249-88ee6987431f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:06.914816 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0495f7-68d4-4526-9249-88ee6987431f service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:06.915085 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0495f7-68d4-4526-9249-88ee6987431f service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:06.915361 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0495f7-68d4-4526-9249-88ee6987431f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:06.926659 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0495f7-68d4-4526-9249-88ee6987431f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:06.928212 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0495f7-68d4-4526-9249-88ee6987431f service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:06.939098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1329/2655] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:07.084930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1b278-640b-4d57-ad2d-e94e8fbab415 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:07.115223 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:07.151307 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1b278-640b-4d57-ad2d-e94e8fbab415 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:07.156503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b6edb-3b7b-4974-b52a-ba814a407e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:07.157190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b6edb-3b7b-4974-b52a-ba814a407e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:07.157473 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b6edb-3b7b-4974-b52a-ba814a407e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:07.157979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b6edb-3b7b-4974-b52a-ba814a407e63 admin admin] PATH_INFO: `/v3/users/941db4c195214bc4a8e461896a2836f5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:07.159692 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b6edb-3b7b-4974-b52a-ba814a407e63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=941db4c195214bc4a8e461896a2836f5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:07.161785 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b6edb-3b7b-4974-b52a-ba814a407e63 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:07.211854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c30b6edb-3b7b-4974-b52a-ba814a407e63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '941db4c195214bc4a8e461896a2836f5'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:07.225322 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c30b6edb-3b7b-4974-b52a-ba814a407e63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '941db4c195214bc4a8e461896a2836f5'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:07.234305 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c30b6edb-3b7b-4974-b52a-ba814a407e63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '941db4c195214bc4a8e461896a2836f5'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:07.243042 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c30b6edb-3b7b-4974-b52a-ba814a407e63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '941db4c195214bc4a8e461896a2836f5'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:07.243770 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-c30b6edb-3b7b-4974-b52a-ba814a407e63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '941db4c195214bc4a8e461896a2836f5'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:07.250066 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1327/2656] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:02:07 2022] DELETE /identity/v3/users/941db4c195214bc4a8e461896a2836f5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:07.254969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27454cfd-7b02-4afe-bd48-1200b1da318a None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:07.255484 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27454cfd-7b02-4afe-bd48-1200b1da318a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:07.255594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27454cfd-7b02-4afe-bd48-1200b1da318a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:07.274810 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-27454cfd-7b02-4afe-bd48-1200b1da318a None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:07.276036 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-27454cfd-7b02-4afe-bd48-1200b1da318a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:07.339663 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1330/2657] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:07.350446 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b6edb-3b7b-4974-b52a-ba814a407e63 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:07.351922 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-c30b6edb-3b7b-4974-b52a-ba814a407e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:07.411204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b6edb-3b7b-4974-b52a-ba814a407e63 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:07.415251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7334962-377e-4043-b5ff-9356531e90dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:07.415903 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7334962-377e-4043-b5ff-9356531e90dd service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:07.416189 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7334962-377e-4043-b5ff-9356531e90dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:07.416459 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7334962-377e-4043-b5ff-9356531e90dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:07.428915 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7334962-377e-4043-b5ff-9356531e90dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:07.430390 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7334962-377e-4043-b5ff-9356531e90dd service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:07.440627 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1328/2658] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:07.481893 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27454cfd-7b02-4afe-bd48-1200b1da318a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:07.483335 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-27454cfd-7b02-4afe-bd48-1200b1da318a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:07.495948 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27454cfd-7b02-4afe-bd48-1200b1da318a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:07.499810 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d646fdc-5f5a-4d37-8c67-e5c3b61b1b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:07.500496 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d646fdc-5f5a-4d37-8c67-e5c3b61b1b20 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:07.500711 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d646fdc-5f5a-4d37-8c67-e5c3b61b1b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:07.500978 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d646fdc-5f5a-4d37-8c67-e5c3b61b1b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:07.503014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0d646fdc-5f5a-4d37-8c67-e5c3b61b1b20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:07.513123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d646fdc-5f5a-4d37-8c67-e5c3b61b1b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:07.514584 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d646fdc-5f5a-4d37-8c67-e5c3b61b1b20 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:07.523074 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1331/2659] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:07.660144 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde6555-2d1c-409f-abdd-15c0dadbf65e None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:07.660683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde6555-2d1c-409f-abdd-15c0dadbf65e None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:07.661017 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde6555-2d1c-409f-abdd-15c0dadbf65e None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:07.662708 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1329/2660] 10.222.0.96 () {54 vars in 921 bytes} [Thu Jul 28 18:02:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 18:02:07.669091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf16100-c319-494a-8488-75889777e999 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:07.669497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf16100-c319-494a-8488-75889777e999 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:07.669863 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf16100-c319-494a-8488-75889777e999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:07.689987 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-fdf16100-c319-494a-8488-75889777e999 None None] MFA Rules not processed for user `5ac367247aa54671ae5c33d251017470`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:07.691183 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fdf16100-c319-494a-8488-75889777e999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:07.701196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:07.760709 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1332/2661] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Jul 28 18:02:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:07.774529 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde6555-2d1c-409f-abdd-15c0dadbf65e None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:07.777111 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9fde6555-2d1c-409f-abdd-15c0dadbf65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:07.809130 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf16100-c319-494a-8488-75889777e999 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:07.810658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fdf16100-c319-494a-8488-75889777e999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:07.844503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:07.848319 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde6555-2d1c-409f-abdd-15c0dadbf65e None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:07.852995 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b36e6a-7ada-4149-84f5-a4800d8c5c09 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98465c2d73e540b5bf506f5a7423e035', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:07.853690 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b36e6a-7ada-4149-84f5-a4800d8c5c09 service glance] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:07.853990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf16100-c319-494a-8488-75889777e999 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:07.854401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b36e6a-7ada-4149-84f5-a4800d8c5c09 service glance] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:07.854688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b36e6a-7ada-4149-84f5-a4800d8c5c09 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:07.860106 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16922f1b-f295-4b10-9e32-b3b4e7227e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:07.862858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16922f1b-f295-4b10-9e32-b3b4e7227e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:07.863387 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16922f1b-f295-4b10-9e32-b3b4e7227e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:07.864090 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16922f1b-f295-4b10-9e32-b3b4e7227e30 admin admin] PATH_INFO: `/v3/projects/8066b8c3ffd94af6a3190ae5919c7e4e` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:07.865833 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16922f1b-f295-4b10-9e32-b3b4e7227e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8066b8c3ffd94af6a3190ae5919c7e4e)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:07.867941 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16922f1b-f295-4b10-9e32-b3b4e7227e30 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:07.868119 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b36e6a-7ada-4149-84f5-a4800d8c5c09 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:07.869664 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b36e6a-7ada-4149-84f5-a4800d8c5c09 service glance] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:07.880890 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1330/2662] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:07.921388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-16922f1b-f295-4b10-9e32-b3b4e7227e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8066b8c3ffd94af6a3190ae5919c7e4e', 'request_id': 'req-16922f1b-f295-4b10-9e32-b3b4e7227e30'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:07.928369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-16922f1b-f295-4b10-9e32-b3b4e7227e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8066b8c3ffd94af6a3190ae5919c7e4e', 'request_id': 'req-16922f1b-f295-4b10-9e32-b3b4e7227e30'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:07.938146 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-16922f1b-f295-4b10-9e32-b3b4e7227e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8066b8c3ffd94af6a3190ae5919c7e4e', 'request_id': 'req-16922f1b-f295-4b10-9e32-b3b4e7227e30'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:07.949738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-16922f1b-f295-4b10-9e32-b3b4e7227e30 admin admin] The token cache is being invalidate because project 8066b8c3ffd94af6a3190ae5919c7e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:02:07.950032 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-16922f1b-f295-4b10-9e32-b3b4e7227e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:07.950217 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808ebda-f75e-4587-b0e4-08c6d5864539 None None] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:07.950613 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808ebda-f75e-4587-b0e4-08c6d5864539 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:07.950736 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-16922f1b-f295-4b10-9e32-b3b4e7227e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:07.950933 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808ebda-f75e-4587-b0e4-08c6d5864539 None None] PATH_INFO: `/` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:07.952430 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1331/2663] 10.222.0.96 () {54 vars in 921 bytes} [Thu Jul 28 18:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 18:02:07.952613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1333/2664] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:02:07 2022] DELETE /identity/v3/projects/8066b8c3ffd94af6a3190ae5919c7e4e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:07.956787 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808ebda-f75e-4587-b0e4-08c6d5864539 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:07.957423 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660451cd-8ff7-4edc-b367-51cb853e6307 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:07.957714 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660451cd-8ff7-4edc-b367-51cb853e6307 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:07.957991 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660451cd-8ff7-4edc-b367-51cb853e6307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:07.958577 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-b808ebda-f75e-4587-b0e4-08c6d5864539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:07.979963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-660451cd-8ff7-4edc-b367-51cb853e6307 None None] MFA Rules not processed for user `76add49d4be940ad846d32fa16431988`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:07.981224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-660451cd-8ff7-4edc-b367-51cb853e6307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:08.028782 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808ebda-f75e-4587-b0e4-08c6d5864539 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:08.034302 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c273b-ec86-4fa5-b8aa-63c040174528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:08.034718 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1334/2665] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Jul 28 18:02:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:08.037436 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c273b-ec86-4fa5-b8aa-63c040174528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:08.037725 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c273b-ec86-4fa5-b8aa-63c040174528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:08.038006 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c273b-ec86-4fa5-b8aa-63c040174528 admin admin] PATH_INFO: `/v3/users/d86c47c0af464a9f8400eb9cf41c3307` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:08.039313 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c273b-ec86-4fa5-b8aa-63c040174528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d86c47c0af464a9f8400eb9cf41c3307)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:08.041367 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c273b-ec86-4fa5-b8aa-63c040174528 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:08.046660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660451cd-8ff7-4edc-b367-51cb853e6307 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:08.048093 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-660451cd-8ff7-4edc-b367-51cb853e6307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:08.059095 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660451cd-8ff7-4edc-b367-51cb853e6307 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:08.063001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9bfc6-49f2-4af1-b752-2ec5f4e9a399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:08.063665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9bfc6-49f2-4af1-b752-2ec5f4e9a399 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:08.064088 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9bfc6-49f2-4af1-b752-2ec5f4e9a399 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:08.064447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9bfc6-49f2-4af1-b752-2ec5f4e9a399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:08.072958 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9bfc6-49f2-4af1-b752-2ec5f4e9a399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:08.074497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9bfc6-49f2-4af1-b752-2ec5f4e9a399 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:08.084028 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1335/2666] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:02:08.170756 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06607fc-d507-4e8b-ba72-af3f09136c6e None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:08.171153 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06607fc-d507-4e8b-ba72-af3f09136c6e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:08.171427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06607fc-d507-4e8b-ba72-af3f09136c6e None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:08.172796 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1336/2667] 10.222.0.96 () {54 vars in 921 bytes} [Thu Jul 28 18:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 18:02:08.178872 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d8044-e011-4366-8eda-cde8428db3df None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:08.179187 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d8044-e011-4366-8eda-cde8428db3df None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:08.188278 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d8044-e011-4366-8eda-cde8428db3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:08.208957 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-683d8044-e011-4366-8eda-cde8428db3df None None] MFA Rules not processed for user `5ac367247aa54671ae5c33d251017470`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:08.210248 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-683d8044-e011-4366-8eda-cde8428db3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:08.225281 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f76c273b-ec86-4fa5-b8aa-63c040174528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd86c47c0af464a9f8400eb9cf41c3307'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:08.231766 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:08.241879 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f76c273b-ec86-4fa5-b8aa-63c040174528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd86c47c0af464a9f8400eb9cf41c3307'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:08.250091 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f76c273b-ec86-4fa5-b8aa-63c040174528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd86c47c0af464a9f8400eb9cf41c3307'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:08.258762 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f76c273b-ec86-4fa5-b8aa-63c040174528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd86c47c0af464a9f8400eb9cf41c3307'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:08.259434 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f76c273b-ec86-4fa5-b8aa-63c040174528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd86c47c0af464a9f8400eb9cf41c3307'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:08.265755 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1332/2668] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:02:07 2022] DELETE /identity/v3/users/d86c47c0af464a9f8400eb9cf41c3307 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:08.282952 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1337/2669] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Jul 28 18:02:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:08.293497 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c273b-ec86-4fa5-b8aa-63c040174528 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:08.294901 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f76c273b-ec86-4fa5-b8aa-63c040174528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:08.354600 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c273b-ec86-4fa5-b8aa-63c040174528 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:08.358281 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45477a0-4677-48d5-8055-e0ab2a8249b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:08.358899 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45477a0-4677-48d5-8055-e0ab2a8249b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:08.359191 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45477a0-4677-48d5-8055-e0ab2a8249b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:08.359446 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45477a0-4677-48d5-8055-e0ab2a8249b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:08.385133 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:08.444468 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45477a0-4677-48d5-8055-e0ab2a8249b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:08.445964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45477a0-4677-48d5-8055-e0ab2a8249b9 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:08.457210 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1333/2670] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:08.586019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d8044-e011-4366-8eda-cde8428db3df None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:08.587695 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-683d8044-e011-4366-8eda-cde8428db3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:08.604269 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d8044-e011-4366-8eda-cde8428db3df None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:08.675897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901427f-521c-4124-b249-a9590d81c4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:08.676546 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901427f-521c-4124-b249-a9590d81c4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:08.676882 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901427f-521c-4124-b249-a9590d81c4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:08.677134 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901427f-521c-4124-b249-a9590d81c4f5 admin admin] PATH_INFO: `/v3/projects/e8ba3c5997c8493d8f7c44f64fb1cabc` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:08.678333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1901427f-521c-4124-b249-a9590d81c4f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8ba3c5997c8493d8f7c44f64fb1cabc)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:08.680228 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1901427f-521c-4124-b249-a9590d81c4f5 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:08.731925 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1901427f-521c-4124-b249-a9590d81c4f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8ba3c5997c8493d8f7c44f64fb1cabc', 'request_id': 'req-1901427f-521c-4124-b249-a9590d81c4f5'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:08.739288 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1901427f-521c-4124-b249-a9590d81c4f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8ba3c5997c8493d8f7c44f64fb1cabc', 'request_id': 'req-1901427f-521c-4124-b249-a9590d81c4f5'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:08.748242 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1901427f-521c-4124-b249-a9590d81c4f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8ba3c5997c8493d8f7c44f64fb1cabc', 'request_id': 'req-1901427f-521c-4124-b249-a9590d81c4f5'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:08.764799 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1901427f-521c-4124-b249-a9590d81c4f5 admin admin] The token cache is being invalidate because project e8ba3c5997c8493d8f7c44f64fb1cabc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:02:08.765207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1901427f-521c-4124-b249-a9590d81c4f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:08.765884 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1901427f-521c-4124-b249-a9590d81c4f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:08.767606 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1338/2671] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:02:08 2022] DELETE /identity/v3/projects/e8ba3c5997c8493d8f7c44f64fb1cabc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:08.772543 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188866c-270e-4096-9680-f055a4e1142c None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:08.773022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188866c-270e-4096-9680-f055a4e1142c None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:08.773143 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188866c-270e-4096-9680-f055a4e1142c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:08.792535 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-8188866c-270e-4096-9680-f055a4e1142c None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:08.793666 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-8188866c-270e-4096-9680-f055a4e1142c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:08.863992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1334/2672] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:08.866019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b059dc-c45d-499c-8c63-defcc600df4c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:08.866514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b059dc-c45d-499c-8c63-defcc600df4c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:08.866990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b059dc-c45d-499c-8c63-defcc600df4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:08.889364 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-04b059dc-c45d-499c-8c63-defcc600df4c None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:08.890596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-04b059dc-c45d-499c-8c63-defcc600df4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:08.900120 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1339/2673] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:02:08.904195 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188866c-270e-4096-9680-f055a4e1142c None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:08.914274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188866c-270e-4096-9680-f055a4e1142c None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:08.919097 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1efb4-0f4f-4dd7-8036-763cac7017ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:08.919756 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1efb4-0f4f-4dd7-8036-763cac7017ae admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:08.919965 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1efb4-0f4f-4dd7-8036-763cac7017ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:08.920238 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1efb4-0f4f-4dd7-8036-763cac7017ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:08.920928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1efb4-0f4f-4dd7-8036-763cac7017ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:02:08.921256 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1efb4-0f4f-4dd7-8036-763cac7017ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:08.923039 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1efb4-0f4f-4dd7-8036-763cac7017ae admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:08.942168 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1335/2674] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 18:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:02:08.942964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b059dc-c45d-499c-8c63-defcc600df4c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:08.955781 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b059dc-c45d-499c-8c63-defcc600df4c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:08.960956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9b0d6-7df8-4ff1-a38a-f4ed0fec9204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:08.961658 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9b0d6-7df8-4ff1-a38a-f4ed0fec9204 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:08.961941 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9b0d6-7df8-4ff1-a38a-f4ed0fec9204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:08.962263 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9b0d6-7df8-4ff1-a38a-f4ed0fec9204 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:08.962946 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9b0d6-7df8-4ff1-a38a-f4ed0fec9204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:08.964918 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9b0d6-7df8-4ff1-a38a-f4ed0fec9204 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:08.996579 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1340/2675] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:02:08 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:02:09.000819 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1efb4-0f4f-4dd7-8036-763cac7017ae admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:09.011152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1efb4-0f4f-4dd7-8036-763cac7017ae admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:09.075391 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889224e-f9d7-4c54-96c0-750314fca963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:09.076092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889224e-f9d7-4c54-96c0-750314fca963 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:09.076374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889224e-f9d7-4c54-96c0-750314fca963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:09.076645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889224e-f9d7-4c54-96c0-750314fca963 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:09.077358 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889224e-f9d7-4c54-96c0-750314fca963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:09.079257 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889224e-f9d7-4c54-96c0-750314fca963 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:09.103794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1336/2676] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:02:08 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:02:09.107972 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9b0d6-7df8-4ff1-a38a-f4ed0fec9204 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:09.120065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9b0d6-7df8-4ff1-a38a-f4ed0fec9204 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:09.125115 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ba4cb-fa2b-4b14-b520-57099891ec1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:09.125858 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ba4cb-fa2b-4b14-b520-57099891ec1c admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:09.126207 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ba4cb-fa2b-4b14-b520-57099891ec1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:09.126594 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ba4cb-fa2b-4b14-b520-57099891ec1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:09.127388 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ba4cb-fa2b-4b14-b520-57099891ec1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:09.129650 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ba4cb-fa2b-4b14-b520-57099891ec1c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:09.141215 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1341/2677] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:02:09.145528 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889224e-f9d7-4c54-96c0-750314fca963 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:09.156278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889224e-f9d7-4c54-96c0-750314fca963 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:09.161697 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5f499-3cbc-4b3f-94c5-60448a361127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:09.162314 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5f499-3cbc-4b3f-94c5-60448a361127 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:09.162591 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5f499-3cbc-4b3f-94c5-60448a361127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:09.162849 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5f499-3cbc-4b3f-94c5-60448a361127 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:09.163546 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5f499-3cbc-4b3f-94c5-60448a361127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:09.165212 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5f499-3cbc-4b3f-94c5-60448a361127 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:09.175787 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1337/2678] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:02:09.180398 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ba4cb-fa2b-4b14-b520-57099891ec1c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:09.191524 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ba4cb-fa2b-4b14-b520-57099891ec1c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:09.196426 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81eeea8-b252-401d-9b24-6d8e6ba72fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:09.197103 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81eeea8-b252-401d-9b24-6d8e6ba72fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:09.197384 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81eeea8-b252-401d-9b24-6d8e6ba72fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:09.197655 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81eeea8-b252-401d-9b24-6d8e6ba72fd5 admin admin] PATH_INFO: `/v3/projects/794f1e555ae74a9fa6554e6cf108f902/users/f3775a500edc45fdbbde72cc7d77db0b/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:09.200802 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:09.213743 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81eeea8-b252-401d-9b24-6d8e6ba72fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=794f1e555ae74a9fa6554e6cf108f902, user_id=f3775a500edc45fdbbde72cc7d77db0b, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:09.216448 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81eeea8-b252-401d-9b24-6d8e6ba72fd5 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:09.231085 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1342/2679] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:02:09 2022] PUT /identity/v3/projects/794f1e555ae74a9fa6554e6cf108f902/users/f3775a500edc45fdbbde72cc7d77db0b/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:02:09.244336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5561e-e27f-414b-a7c6-841e65a1f7d8 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:09.244623 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5561e-e27f-414b-a7c6-841e65a1f7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:09.244905 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5561e-e27f-414b-a7c6-841e65a1f7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:09.272779 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-adc5561e-e27f-414b-a7c6-841e65a1f7d8 None None] MFA Rules not processed for user `f3775a500edc45fdbbde72cc7d77db0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:09.274035 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-adc5561e-e27f-414b-a7c6-841e65a1f7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:09.279810 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:09.341118 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1338/2680] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:02:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:09.352491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81eeea8-b252-401d-9b24-6d8e6ba72fd5 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:09.354623 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d81eeea8-b252-401d-9b24-6d8e6ba72fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:09.415493 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81eeea8-b252-401d-9b24-6d8e6ba72fd5 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:09.419102 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63f654-2dff-41cc-9316-7aaed543c919 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:09.419740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63f654-2dff-41cc-9316-7aaed543c919 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:09.419999 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63f654-2dff-41cc-9316-7aaed543c919 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:09.420280 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63f654-2dff-41cc-9316-7aaed543c919 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:09.429147 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63f654-2dff-41cc-9316-7aaed543c919 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:09.430561 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63f654-2dff-41cc-9316-7aaed543c919 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:09.439972 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1343/2681] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:09.464347 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5561e-e27f-414b-a7c6-841e65a1f7d8 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:09.527588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5561e-e27f-414b-a7c6-841e65a1f7d8 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:09.532321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9a37f-d51e-40b2-bbc7-e9089419945b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:09.532955 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9a37f-d51e-40b2-bbc7-e9089419945b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:09.533278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9a37f-d51e-40b2-bbc7-e9089419945b admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:09.533555 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9a37f-d51e-40b2-bbc7-e9089419945b admin admin] PATH_INFO: `/v3/users/f3775a500edc45fdbbde72cc7d77db0b` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:09.534734 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9a37f-d51e-40b2-bbc7-e9089419945b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3775a500edc45fdbbde72cc7d77db0b)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:09.536682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9a37f-d51e-40b2-bbc7-e9089419945b admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:09.593013 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-09a9a37f-d51e-40b2-bbc7-e9089419945b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3775a500edc45fdbbde72cc7d77db0b'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:09.608127 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-09a9a37f-d51e-40b2-bbc7-e9089419945b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3775a500edc45fdbbde72cc7d77db0b'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:09.618180 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-09a9a37f-d51e-40b2-bbc7-e9089419945b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3775a500edc45fdbbde72cc7d77db0b'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:09.625854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-09a9a37f-d51e-40b2-bbc7-e9089419945b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3775a500edc45fdbbde72cc7d77db0b'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:09.626585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-09a9a37f-d51e-40b2-bbc7-e9089419945b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3775a500edc45fdbbde72cc7d77db0b'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:09.633163 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1339/2682] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:02:09 2022] DELETE /identity/v3/users/f3775a500edc45fdbbde72cc7d77db0b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:09.637649 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548f0be-7e14-4185-ab0f-7d13fef62feb None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:09.638063 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548f0be-7e14-4185-ab0f-7d13fef62feb None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:09.638406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548f0be-7e14-4185-ab0f-7d13fef62feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:09.658297 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-5548f0be-7e14-4185-ab0f-7d13fef62feb None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:09.659523 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5548f0be-7e14-4185-ab0f-7d13fef62feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:09.725354 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1344/2683] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:09.737088 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9a37f-d51e-40b2-bbc7-e9089419945b admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:09.739048 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-09a9a37f-d51e-40b2-bbc7-e9089419945b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:09.777412 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:09.808346 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9a37f-d51e-40b2-bbc7-e9089419945b admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:09.812220 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea620b7-5985-44e5-a330-3e8ba021a6e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:09.812831 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea620b7-5985-44e5-a330-3e8ba021a6e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:09.813103 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea620b7-5985-44e5-a330-3e8ba021a6e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:09.813401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea620b7-5985-44e5-a330-3e8ba021a6e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:09.823200 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea620b7-5985-44e5-a330-3e8ba021a6e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:09.824615 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea620b7-5985-44e5-a330-3e8ba021a6e7 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:09.834369 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1340/2684] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:10.139112 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548f0be-7e14-4185-ab0f-7d13fef62feb None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:10.140697 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5548f0be-7e14-4185-ab0f-7d13fef62feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:10.154083 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548f0be-7e14-4185-ab0f-7d13fef62feb None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:10.159696 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6eb96-778d-40fe-83d9-fec9e1db7219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:10.160150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6eb96-778d-40fe-83d9-fec9e1db7219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:10.160436 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6eb96-778d-40fe-83d9-fec9e1db7219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:10.160881 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6eb96-778d-40fe-83d9-fec9e1db7219 admin admin] PATH_INFO: `/v3/projects/794f1e555ae74a9fa6554e6cf108f902` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:10.162987 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6eb96-778d-40fe-83d9-fec9e1db7219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=794f1e555ae74a9fa6554e6cf108f902)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:10.166611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6eb96-778d-40fe-83d9-fec9e1db7219 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:10.228606 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b1f6eb96-778d-40fe-83d9-fec9e1db7219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '794f1e555ae74a9fa6554e6cf108f902', 'request_id': 'req-b1f6eb96-778d-40fe-83d9-fec9e1db7219'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:10.243702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b1f6eb96-778d-40fe-83d9-fec9e1db7219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '794f1e555ae74a9fa6554e6cf108f902', 'request_id': 'req-b1f6eb96-778d-40fe-83d9-fec9e1db7219'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:10.253458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b1f6eb96-778d-40fe-83d9-fec9e1db7219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '794f1e555ae74a9fa6554e6cf108f902', 'request_id': 'req-b1f6eb96-778d-40fe-83d9-fec9e1db7219'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:10.264139 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b1f6eb96-778d-40fe-83d9-fec9e1db7219 admin admin] The token cache is being invalidate because project 794f1e555ae74a9fa6554e6cf108f902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:02:10.264499 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b1f6eb96-778d-40fe-83d9-fec9e1db7219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:10.265228 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b1f6eb96-778d-40fe-83d9-fec9e1db7219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:10.266756 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1345/2685] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:02:10 2022] DELETE /identity/v3/projects/794f1e555ae74a9fa6554e6cf108f902 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:10.272043 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e17df-b78d-413e-a2f6-3216a6dcac63 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:10.272323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e17df-b78d-413e-a2f6-3216a6dcac63 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:10.272596 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e17df-b78d-413e-a2f6-3216a6dcac63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:10.291597 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-9d1e17df-b78d-413e-a2f6-3216a6dcac63 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:10.292782 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9d1e17df-b78d-413e-a2f6-3216a6dcac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:10.355793 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1341/2686] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:10.421327 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2ab3a-af75-44d1-a179-e7b9ff5019d5 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:10.422194 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2ab3a-af75-44d1-a179-e7b9ff5019d5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:10.422470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2ab3a-af75-44d1-a179-e7b9ff5019d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:10.443994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-8cb2ab3a-af75-44d1-a179-e7b9ff5019d5 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:10.445246 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8cb2ab3a-af75-44d1-a179-e7b9ff5019d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:10.454256 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1346/2687] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:10.459016 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e17df-b78d-413e-a2f6-3216a6dcac63 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:10.468674 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e17df-b78d-413e-a2f6-3216a6dcac63 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:10.473902 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cf629-cd9c-4997-9604-29e4a600218a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:10.474519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cf629-cd9c-4997-9604-29e4a600218a admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:10.474792 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cf629-cd9c-4997-9604-29e4a600218a admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:10.475057 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cf629-cd9c-4997-9604-29e4a600218a admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:10.475750 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cf629-cd9c-4997-9604-29e4a600218a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:02:10.476049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cf629-cd9c-4997-9604-29e4a600218a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:10.477684 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cf629-cd9c-4997-9604-29e4a600218a admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:10.490602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1342/2688] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 18:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:02:10.495105 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2ab3a-af75-44d1-a179-e7b9ff5019d5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:10.500784 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:10.504974 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2ab3a-af75-44d1-a179-e7b9ff5019d5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:10.511213 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26178e0c-28af-4c4a-a432-379337d0cb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:10.511904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26178e0c-28af-4c4a-a432-379337d0cb71 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:10.512341 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26178e0c-28af-4c4a-a432-379337d0cb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:10.512667 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26178e0c-28af-4c4a-a432-379337d0cb71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:10.513549 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26178e0c-28af-4c4a-a432-379337d0cb71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:10.515483 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26178e0c-28af-4c4a-a432-379337d0cb71 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:10.547244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1347/2689] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:02:10 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:02:10.552026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cf629-cd9c-4997-9604-29e4a600218a admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:10.562570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cf629-cd9c-4997-9604-29e4a600218a admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:10.624019 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447e3e6-d014-448d-8fca-338bf5a12474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:10.624641 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447e3e6-d014-448d-8fca-338bf5a12474 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:10.624921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447e3e6-d014-448d-8fca-338bf5a12474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:10.625224 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447e3e6-d014-448d-8fca-338bf5a12474 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:10.625921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447e3e6-d014-448d-8fca-338bf5a12474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:10.627932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447e3e6-d014-448d-8fca-338bf5a12474 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:10.652636 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1343/2690] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:02:10 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:02:10.653947 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26178e0c-28af-4c4a-a432-379337d0cb71 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:10.664353 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26178e0c-28af-4c4a-a432-379337d0cb71 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:10.669450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb3386-6503-4594-9648-f1cc9d4f053e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:10.670149 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb3386-6503-4594-9648-f1cc9d4f053e admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:10.670427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb3386-6503-4594-9648-f1cc9d4f053e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:10.670696 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb3386-6503-4594-9648-f1cc9d4f053e admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:10.671440 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb3386-6503-4594-9648-f1cc9d4f053e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:10.673151 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb3386-6503-4594-9648-f1cc9d4f053e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:10.687674 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1348/2691] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:02:10.689741 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447e3e6-d014-448d-8fca-338bf5a12474 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:10.700279 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447e3e6-d014-448d-8fca-338bf5a12474 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:10.706080 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b4beb-dff3-46ad-8514-3f3f361eac2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:10.706699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b4beb-dff3-46ad-8514-3f3f361eac2a admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:10.706978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b4beb-dff3-46ad-8514-3f3f361eac2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:10.707247 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b4beb-dff3-46ad-8514-3f3f361eac2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:10.707937 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b4beb-dff3-46ad-8514-3f3f361eac2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:10.708169 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4d08f-5cca-493d-9bf5-ff38bc2d3fcb None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:10.708463 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4d08f-5cca-493d-9bf5-ff38bc2d3fcb None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:10.708746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4d08f-5cca-493d-9bf5-ff38bc2d3fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:10.709567 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b4beb-dff3-46ad-8514-3f3f361eac2a admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:10.724493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1344/2692] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:02:10.725536 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b4beb-dff3-46ad-8514-3f3f361eac2a admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:10.728066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e1c4d08f-5cca-493d-9bf5-ff38bc2d3fcb None None] MFA Rules not processed for user `a1936a2649c349d481f56304b3ee55b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:10.729306 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e1c4d08f-5cca-493d-9bf5-ff38bc2d3fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:10.736518 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b4beb-dff3-46ad-8514-3f3f361eac2a admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:10.741780 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf25903-0368-45dd-83b2-0ed1c4201501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:10.742476 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf25903-0368-45dd-83b2-0ed1c4201501 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:10.742982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf25903-0368-45dd-83b2-0ed1c4201501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:10.743098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf25903-0368-45dd-83b2-0ed1c4201501 admin admin] PATH_INFO: `/v3/projects/a4482ca961704439abeddb013e596b6e/users/c4de29da23da47b6a4eab89b89722d54/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:10.758196 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf25903-0368-45dd-83b2-0ed1c4201501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4482ca961704439abeddb013e596b6e, user_id=c4de29da23da47b6a4eab89b89722d54, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:10.760888 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf25903-0368-45dd-83b2-0ed1c4201501 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:10.775070 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1345/2693] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:02:10 2022] PUT /identity/v3/projects/a4482ca961704439abeddb013e596b6e/users/c4de29da23da47b6a4eab89b89722d54/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:10.784812 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1349/2694] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Jul 28 18:02:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:02:10.786149 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d83dc-a826-4344-977d-ff256695284a None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:10.786658 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d83dc-a826-4344-977d-ff256695284a None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:10.786755 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d83dc-a826-4344-977d-ff256695284a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:10.797409 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4d08f-5cca-493d-9bf5-ff38bc2d3fcb None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:10.798935 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e1c4d08f-5cca-493d-9bf5-ff38bc2d3fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:10.807679 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:10.817327 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-e85d83dc-a826-4344-977d-ff256695284a None None] MFA Rules not processed for user `c4de29da23da47b6a4eab89b89722d54`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:10.818714 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e85d83dc-a826-4344-977d-ff256695284a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:10.871046 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4d08f-5cca-493d-9bf5-ff38bc2d3fcb None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:10.882232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1346/2695] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:02:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:02:10.894184 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d83dc-a826-4344-977d-ff256695284a None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:10.895549 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e85d83dc-a826-4344-977d-ff256695284a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:10.936443 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11c8e6-74e1-4380-8fe1-b962c21c8e59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ea1a9023eaf427f96f86af909a803fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:10.936979 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11c8e6-74e1-4380-8fe1-b962c21c8e59 service swift] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:10.937273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11c8e6-74e1-4380-8fe1-b962c21c8e59 service swift] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:10.937566 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11c8e6-74e1-4380-8fe1-b962c21c8e59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:10.951267 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d83dc-a826-4344-977d-ff256695284a None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:10.955167 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672356f1-09c1-4f8d-b32e-3ba1da36697b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:10.955783 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672356f1-09c1-4f8d-b32e-3ba1da36697b service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:10.955940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:10.956084 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672356f1-09c1-4f8d-b32e-3ba1da36697b service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:10.956350 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672356f1-09c1-4f8d-b32e-3ba1da36697b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:10.965147 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672356f1-09c1-4f8d-b32e-3ba1da36697b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:10.966606 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672356f1-09c1-4f8d-b32e-3ba1da36697b service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:10.976086 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1347/2696] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:02:10.995352 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11c8e6-74e1-4380-8fe1-b962c21c8e59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:10.997001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11c8e6-74e1-4380-8fe1-b962c21c8e59 service swift] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:11.006125 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1350/2697] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Jul 28 18:02:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 18:02:20.971487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=53 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:21.002889 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=18 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:23.119120 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672356f1-09c1-4f8d-b32e-3ba1da36697b service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:23.193335 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672356f1-09c1-4f8d-b32e-3ba1da36697b service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:23.198516 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32342f14-29c1-40e8-868a-926054a9e76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:23.199172 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32342f14-29c1-40e8-868a-926054a9e76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:23.199449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32342f14-29c1-40e8-868a-926054a9e76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:23.199724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32342f14-29c1-40e8-868a-926054a9e76d admin admin] PATH_INFO: `/v3/users/c4de29da23da47b6a4eab89b89722d54` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:23.200987 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32342f14-29c1-40e8-868a-926054a9e76d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4de29da23da47b6a4eab89b89722d54)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:23.203049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32342f14-29c1-40e8-868a-926054a9e76d admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:23.252995 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-32342f14-29c1-40e8-868a-926054a9e76d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4de29da23da47b6a4eab89b89722d54'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:23.264666 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-32342f14-29c1-40e8-868a-926054a9e76d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4de29da23da47b6a4eab89b89722d54'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:23.274218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-32342f14-29c1-40e8-868a-926054a9e76d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4de29da23da47b6a4eab89b89722d54'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:23.281636 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-32342f14-29c1-40e8-868a-926054a9e76d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4de29da23da47b6a4eab89b89722d54'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:23.282578 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-32342f14-29c1-40e8-868a-926054a9e76d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4de29da23da47b6a4eab89b89722d54'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:23.288854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1348/2698] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:02:23 2022] DELETE /identity/v3/users/c4de29da23da47b6a4eab89b89722d54 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:23.293186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f6617-c7cf-4dc2-8f65-1a2ab9a1b8ae None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:23.293673 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f6617-c7cf-4dc2-8f65-1a2ab9a1b8ae None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:23.293969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f6617-c7cf-4dc2-8f65-1a2ab9a1b8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:23.313676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e34f6617-c7cf-4dc2-8f65-1a2ab9a1b8ae None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:23.315047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e34f6617-c7cf-4dc2-8f65-1a2ab9a1b8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:23.393213 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1351/2699] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:23.403337 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32342f14-29c1-40e8-868a-926054a9e76d admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:23.405136 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-32342f14-29c1-40e8-868a-926054a9e76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:23.464743 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32342f14-29c1-40e8-868a-926054a9e76d admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:23.468483 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16c54f-a86e-40f9-ad19-e4b39081f08d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:23.469094 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16c54f-a86e-40f9-ad19-e4b39081f08d service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:23.469407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16c54f-a86e-40f9-ad19-e4b39081f08d service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:23.469734 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16c54f-a86e-40f9-ad19-e4b39081f08d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:23.479461 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16c54f-a86e-40f9-ad19-e4b39081f08d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:23.480882 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16c54f-a86e-40f9-ad19-e4b39081f08d service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:23.490926 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1349/2700] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:23.794560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f6617-c7cf-4dc2-8f65-1a2ab9a1b8ae None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:23.796145 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e34f6617-c7cf-4dc2-8f65-1a2ab9a1b8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:23.810791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f6617-c7cf-4dc2-8f65-1a2ab9a1b8ae None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:23.816230 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b04585-038e-43fb-9e80-1e11a971972e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:23.817086 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b04585-038e-43fb-9e80-1e11a971972e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:23.817467 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b04585-038e-43fb-9e80-1e11a971972e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:23.817793 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b04585-038e-43fb-9e80-1e11a971972e admin admin] PATH_INFO: `/v3/projects/a4482ca961704439abeddb013e596b6e` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:23.819136 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b04585-038e-43fb-9e80-1e11a971972e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4482ca961704439abeddb013e596b6e)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:23.821087 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b04585-038e-43fb-9e80-1e11a971972e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:23.870188 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-41b04585-038e-43fb-9e80-1e11a971972e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4482ca961704439abeddb013e596b6e', 'request_id': 'req-41b04585-038e-43fb-9e80-1e11a971972e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:23.876600 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-41b04585-038e-43fb-9e80-1e11a971972e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4482ca961704439abeddb013e596b6e', 'request_id': 'req-41b04585-038e-43fb-9e80-1e11a971972e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:23.885854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-41b04585-038e-43fb-9e80-1e11a971972e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4482ca961704439abeddb013e596b6e', 'request_id': 'req-41b04585-038e-43fb-9e80-1e11a971972e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:23.897086 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-41b04585-038e-43fb-9e80-1e11a971972e admin admin] The token cache is being invalidate because project a4482ca961704439abeddb013e596b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:02:23.897393 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-41b04585-038e-43fb-9e80-1e11a971972e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:23.898035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-41b04585-038e-43fb-9e80-1e11a971972e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:23.899591 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1352/2701] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:02:23 2022] DELETE /identity/v3/projects/a4482ca961704439abeddb013e596b6e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:23.904655 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c8736-89c6-4ca3-a460-fe6b51adb3ff None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:23.904944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c8736-89c6-4ca3-a460-fe6b51adb3ff None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:23.905248 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c8736-89c6-4ca3-a460-fe6b51adb3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:23.931931 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-4a9c8736-89c6-4ca3-a460-fe6b51adb3ff None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:23.933839 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-4a9c8736-89c6-4ca3-a460-fe6b51adb3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:23.955035 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:24.000487 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1350/2702] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:24.010060 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fb7cd-5edb-4be5-ba3e-bf421be0e98d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:24.010347 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fb7cd-5edb-4be5-ba3e-bf421be0e98d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:24.010625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fb7cd-5edb-4be5-ba3e-bf421be0e98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:24.031873 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-aa4fb7cd-5edb-4be5-ba3e-bf421be0e98d None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:24.033171 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-aa4fb7cd-5edb-4be5-ba3e-bf421be0e98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:24.042662 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1353/2703] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:24.047088 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c8736-89c6-4ca3-a460-fe6b51adb3ff None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:24.057293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c8736-89c6-4ca3-a460-fe6b51adb3ff None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:24.062429 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a124f7f-52c7-4979-853f-0903e1448bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:24.063046 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a124f7f-52c7-4979-853f-0903e1448bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:24.063306 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a124f7f-52c7-4979-853f-0903e1448bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:24.063654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a124f7f-52c7-4979-853f-0903e1448bd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:24.064351 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a124f7f-52c7-4979-853f-0903e1448bd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:02:24.064659 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a124f7f-52c7-4979-853f-0903e1448bd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:24.066303 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a124f7f-52c7-4979-853f-0903e1448bd4 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:24.078498 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1351/2704] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 18:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:02:24.083991 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fb7cd-5edb-4be5-ba3e-bf421be0e98d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:24.097723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fb7cd-5edb-4be5-ba3e-bf421be0e98d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:24.102910 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb7ccb-651b-4801-a7dc-f3932203ae82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:24.103550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb7ccb-651b-4801-a7dc-f3932203ae82 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:24.103828 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb7ccb-651b-4801-a7dc-f3932203ae82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:24.104098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb7ccb-651b-4801-a7dc-f3932203ae82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:24.104769 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb7ccb-651b-4801-a7dc-f3932203ae82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:24.106753 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb7ccb-651b-4801-a7dc-f3932203ae82 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:24.138996 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1354/2705] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:02:24 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:02:24.143964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a124f7f-52c7-4979-853f-0903e1448bd4 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:24.154441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a124f7f-52c7-4979-853f-0903e1448bd4 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:24.213792 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cb632-ab26-42ce-9c0f-c9027e4ee17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:24.214419 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cb632-ab26-42ce-9c0f-c9027e4ee17f admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:24.214697 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cb632-ab26-42ce-9c0f-c9027e4ee17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:24.214972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cb632-ab26-42ce-9c0f-c9027e4ee17f admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:24.215653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cb632-ab26-42ce-9c0f-c9027e4ee17f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:24.217630 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cb632-ab26-42ce-9c0f-c9027e4ee17f admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:24.241311 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1352/2706] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:02:24 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:02:24.245956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb7ccb-651b-4801-a7dc-f3932203ae82 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:24.257596 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb7ccb-651b-4801-a7dc-f3932203ae82 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:24.264733 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18f595-9b56-4d6f-96b4-8386fae4e37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:24.265418 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18f595-9b56-4d6f-96b4-8386fae4e37f admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:24.265756 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18f595-9b56-4d6f-96b4-8386fae4e37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:24.266089 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18f595-9b56-4d6f-96b4-8386fae4e37f admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:24.267404 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18f595-9b56-4d6f-96b4-8386fae4e37f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:24.269885 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18f595-9b56-4d6f-96b4-8386fae4e37f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:24.285718 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1355/2707] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:02:24.291209 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cb632-ab26-42ce-9c0f-c9027e4ee17f admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:24.302173 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cb632-ab26-42ce-9c0f-c9027e4ee17f admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:24.307974 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0feee-349e-495f-96cd-3228db1140e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:24.308590 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0feee-349e-495f-96cd-3228db1140e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:24.308868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0feee-349e-495f-96cd-3228db1140e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:24.309170 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0feee-349e-495f-96cd-3228db1140e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:24.309866 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0feee-349e-495f-96cd-3228db1140e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:24.311499 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0feee-349e-495f-96cd-3228db1140e0 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:24.322612 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1353/2708] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:02:24.326980 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18f595-9b56-4d6f-96b4-8386fae4e37f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:24.338224 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18f595-9b56-4d6f-96b4-8386fae4e37f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:24.344625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13996e-ca20-4aa6-aec4-935398413fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:24.345354 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13996e-ca20-4aa6-aec4-935398413fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:24.345626 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13996e-ca20-4aa6-aec4-935398413fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:24.345904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13996e-ca20-4aa6-aec4-935398413fc8 admin admin] PATH_INFO: `/v3/projects/7d6e348ec66645ed8fc9c88eb3694675/users/be1b3b870b184055b532d22a05860444/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:24.363003 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13996e-ca20-4aa6-aec4-935398413fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d6e348ec66645ed8fc9c88eb3694675, user_id=be1b3b870b184055b532d22a05860444, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:24.366075 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13996e-ca20-4aa6-aec4-935398413fc8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:24.381416 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1356/2709] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:02:24 2022] PUT /identity/v3/projects/7d6e348ec66645ed8fc9c88eb3694675/users/be1b3b870b184055b532d22a05860444/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:24.382272 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90682343-ccd0-4f79-ad22-ba88854c64eb None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:24.382584 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90682343-ccd0-4f79-ad22-ba88854c64eb None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:24.382863 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90682343-ccd0-4f79-ad22-ba88854c64eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:24.391031 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948ddd2-4e4d-41fa-8fe2-6a52ba4ce4c9 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:24.391031 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948ddd2-4e4d-41fa-8fe2-6a52ba4ce4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:24.391273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948ddd2-4e4d-41fa-8fe2-6a52ba4ce4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:24.403824 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-90682343-ccd0-4f79-ad22-ba88854c64eb None None] MFA Rules not processed for user `a1936a2649c349d481f56304b3ee55b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:24.405125 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-90682343-ccd0-4f79-ad22-ba88854c64eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:24.412489 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7948ddd2-4e4d-41fa-8fe2-6a52ba4ce4c9 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:24.413824 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7948ddd2-4e4d-41fa-8fe2-6a52ba4ce4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:24.426997 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:24.466242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1354/2710] 10.222.0.96 () {58 vars in 967 bytes} [Thu Jul 28 18:02:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:24.475509 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1357/2711] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:24.480359 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90682343-ccd0-4f79-ad22-ba88854c64eb None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:24.481792 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-90682343-ccd0-4f79-ad22-ba88854c64eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:24.486485 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948ddd2-4e4d-41fa-8fe2-6a52ba4ce4c9 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:24.487928 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7948ddd2-4e4d-41fa-8fe2-6a52ba4ce4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:24.518539 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:24.549708 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948ddd2-4e4d-41fa-8fe2-6a52ba4ce4c9 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:24.553391 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879b519-4c02-43bb-b126-d8c90dd25c2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:24.553960 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879b519-4c02-43bb-b126-d8c90dd25c2b service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:24.554238 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879b519-4c02-43bb-b126-d8c90dd25c2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:24.554512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879b519-4c02-43bb-b126-d8c90dd25c2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:24.554617 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90682343-ccd0-4f79-ad22-ba88854c64eb None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:24.559488 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19844c0b-7d92-4232-8b15-1399d6643db1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ea1a9023eaf427f96f86af909a803fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:24.560106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19844c0b-7d92-4232-8b15-1399d6643db1 service swift] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:24.560413 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19844c0b-7d92-4232-8b15-1399d6643db1 service swift] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:24.560683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19844c0b-7d92-4232-8b15-1399d6643db1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:24.563661 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879b519-4c02-43bb-b126-d8c90dd25c2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:24.565268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879b519-4c02-43bb-b126-d8c90dd25c2b service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:24.568787 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19844c0b-7d92-4232-8b15-1399d6643db1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:24.570400 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19844c0b-7d92-4232-8b15-1399d6643db1 service swift] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:24.574908 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1358/2712] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:24.578545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1355/2713] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Jul 28 18:02:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:02:26.346715 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879b519-4c02-43bb-b126-d8c90dd25c2b service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:26.348669 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6879b519-4c02-43bb-b126-d8c90dd25c2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:26.366185 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879b519-4c02-43bb-b126-d8c90dd25c2b service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:26.370996 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc960a-db36-4426-b19b-d60b35adbcdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:26.371715 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc960a-db36-4426-b19b-d60b35adbcdf service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:26.372059 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc960a-db36-4426-b19b-d60b35adbcdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:26.372397 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc960a-db36-4426-b19b-d60b35adbcdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:26.374963 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-15cc960a-db36-4426-b19b-d60b35adbcdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:26.443358 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc960a-db36-4426-b19b-d60b35adbcdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:26.444879 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc960a-db36-4426-b19b-d60b35adbcdf service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:26.455984 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1359/2714] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:27.714907 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19844c0b-7d92-4232-8b15-1399d6643db1 service swift] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:27.716440 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-19844c0b-7d92-4232-8b15-1399d6643db1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:27.887206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19844c0b-7d92-4232-8b15-1399d6643db1 service swift] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:27.896182 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fa757-6e8b-4d63-b333-769289978f6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ac367247aa54671ae5c33d251017470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:27.897323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fa757-6e8b-4d63-b333-769289978f6c service nova] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:27.898458 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fa757-6e8b-4d63-b333-769289978f6c service nova] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:27.899105 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fa757-6e8b-4d63-b333-769289978f6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:27.902628 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-3c8fa757-6e8b-4d63-b333-769289978f6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:27.920244 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fa757-6e8b-4d63-b333-769289978f6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:27.923285 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fa757-6e8b-4d63-b333-769289978f6c service nova] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:27.937133 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1356/2715] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:29.071020 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb023c7c-b046-4963-a1e6-658dfae0c8d5 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:29.072026 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb023c7c-b046-4963-a1e6-658dfae0c8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:29.072489 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb023c7c-b046-4963-a1e6-658dfae0c8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:29.119927 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-bb023c7c-b046-4963-a1e6-658dfae0c8d5 None None] MFA Rules not processed for user `be1b3b870b184055b532d22a05860444`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:29.121569 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-bb023c7c-b046-4963-a1e6-658dfae0c8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:29.177883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:29.232877 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1360/2716] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:02:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:02:29.237665 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fa757-6e8b-4d63-b333-769289978f6c service nova] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:29.251138 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fa757-6e8b-4d63-b333-769289978f6c service nova] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:29.261789 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772048ba-9616-45e2-98fc-92bd9a871dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:29.262451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772048ba-9616-45e2-98fc-92bd9a871dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:29.262717 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772048ba-9616-45e2-98fc-92bd9a871dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:29.263018 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772048ba-9616-45e2-98fc-92bd9a871dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:29.263683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772048ba-9616-45e2-98fc-92bd9a871dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:29.265944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772048ba-9616-45e2-98fc-92bd9a871dc8 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:29.296881 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1357/2717] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:02:29 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:02:29.301577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb023c7c-b046-4963-a1e6-658dfae0c8d5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:29.313550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb023c7c-b046-4963-a1e6-658dfae0c8d5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:29.419415 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea563fac-67b1-479b-a19b-df0c59b73d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:29.420377 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea563fac-67b1-479b-a19b-df0c59b73d23 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:29.420377 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea563fac-67b1-479b-a19b-df0c59b73d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:29.420377 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea563fac-67b1-479b-a19b-df0c59b73d23 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:29.421143 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea563fac-67b1-479b-a19b-df0c59b73d23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:29.423593 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea563fac-67b1-479b-a19b-df0c59b73d23 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:29.454931 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1361/2718] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:02:29 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:02:29.459605 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772048ba-9616-45e2-98fc-92bd9a871dc8 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:29.474882 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772048ba-9616-45e2-98fc-92bd9a871dc8 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:29.480417 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf731a-bc75-4a3c-a16d-5deabb99d4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:29.481221 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf731a-bc75-4a3c-a16d-5deabb99d4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:29.481572 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf731a-bc75-4a3c-a16d-5deabb99d4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:29.482557 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf731a-bc75-4a3c-a16d-5deabb99d4c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:29.482698 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf731a-bc75-4a3c-a16d-5deabb99d4c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:29.484438 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf731a-bc75-4a3c-a16d-5deabb99d4c0 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:29.499271 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1358/2719] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:02:29.503666 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea563fac-67b1-479b-a19b-df0c59b73d23 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:29.523140 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea563fac-67b1-479b-a19b-df0c59b73d23 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:29.530861 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018bc3a-e794-4d5d-8448-324eb17cec03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:29.531896 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018bc3a-e794-4d5d-8448-324eb17cec03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:29.532424 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018bc3a-e794-4d5d-8448-324eb17cec03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:29.532798 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018bc3a-e794-4d5d-8448-324eb17cec03 admin admin] PATH_INFO: `/v3/projects/1594b2299ddc445aa5109d0f85195be7/users/cb60f548ae3041b38bc87567097b28ad/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:29.556273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018bc3a-e794-4d5d-8448-324eb17cec03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1594b2299ddc445aa5109d0f85195be7, user_id=cb60f548ae3041b38bc87567097b28ad, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:29.559025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018bc3a-e794-4d5d-8448-324eb17cec03 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:29.575485 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1362/2720] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:02:29 2022] PUT /identity/v3/projects/1594b2299ddc445aa5109d0f85195be7/users/cb60f548ae3041b38bc87567097b28ad/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:29.580237 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf731a-bc75-4a3c-a16d-5deabb99d4c0 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:29.591506 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf731a-bc75-4a3c-a16d-5deabb99d4c0 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:29.662483 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6e738-8b5e-411b-8dcf-dad2e7a6c113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:29.663333 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6e738-8b5e-411b-8dcf-dad2e7a6c113 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:29.663615 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6e738-8b5e-411b-8dcf-dad2e7a6c113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:29.663882 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6e738-8b5e-411b-8dcf-dad2e7a6c113 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:29.664578 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6e738-8b5e-411b-8dcf-dad2e7a6c113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:29.666306 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6e738-8b5e-411b-8dcf-dad2e7a6c113 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:29.677766 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1359/2721] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:02:29.682110 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018bc3a-e794-4d5d-8448-324eb17cec03 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:29.695383 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018bc3a-e794-4d5d-8448-324eb17cec03 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:29.700150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64e8ae-26ef-4a4a-ac67-ac0f402b04d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:29.700845 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64e8ae-26ef-4a4a-ac67-ac0f402b04d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:29.701166 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64e8ae-26ef-4a4a-ac67-ac0f402b04d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:29.701474 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64e8ae-26ef-4a4a-ac67-ac0f402b04d2 admin admin] PATH_INFO: `/v3/projects/1594b2299ddc445aa5109d0f85195be7/users/cb60f548ae3041b38bc87567097b28ad/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:29.703706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64e8ae-26ef-4a4a-ac67-ac0f402b04d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1594b2299ddc445aa5109d0f85195be7, user_id=cb60f548ae3041b38bc87567097b28ad, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:29.706540 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64e8ae-26ef-4a4a-ac67-ac0f402b04d2 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:29.722153 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1363/2722] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:02:29 2022] PUT /identity/v3/projects/1594b2299ddc445aa5109d0f85195be7/users/cb60f548ae3041b38bc87567097b28ad/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:32.328916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6e738-8b5e-411b-8dcf-dad2e7a6c113 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:32.351971 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:32.476259 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6e738-8b5e-411b-8dcf-dad2e7a6c113 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:32.566679 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd41821-ac1e-4778-b8dd-8bdbd965c6fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:32.567332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd41821-ac1e-4778-b8dd-8bdbd965c6fa service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:32.567854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd41821-ac1e-4778-b8dd-8bdbd965c6fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:32.567854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd41821-ac1e-4778-b8dd-8bdbd965c6fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:32.569752 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-3dd41821-ac1e-4778-b8dd-8bdbd965c6fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:32.669948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd41821-ac1e-4778-b8dd-8bdbd965c6fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:32.681230 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd41821-ac1e-4778-b8dd-8bdbd965c6fa service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:32.719012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1360/2723] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:35.725407 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc6cd7-9dfd-4b33-94c3-d7aa1601a141 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:35.726204 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc6cd7-9dfd-4b33-94c3-d7aa1601a141 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:35.726491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc6cd7-9dfd-4b33-94c3-d7aa1601a141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:35.760257 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-00bc6cd7-9dfd-4b33-94c3-d7aa1601a141 None None] MFA Rules not processed for user `cb60f548ae3041b38bc87567097b28ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:35.761859 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-00bc6cd7-9dfd-4b33-94c3-d7aa1601a141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:35.876513 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1364/2724] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:02:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:35.891921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd41821-ac1e-4778-b8dd-8bdbd965c6fa service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:35.893810 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-3dd41821-ac1e-4778-b8dd-8bdbd965c6fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:35.994878 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd41821-ac1e-4778-b8dd-8bdbd965c6fa service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:35.999821 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a910c35-ab3d-4c0f-81c2-ebd571249a4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98465c2d73e540b5bf506f5a7423e035', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:36.000617 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a910c35-ab3d-4c0f-81c2-ebd571249a4f service glance] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:36.001161 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a910c35-ab3d-4c0f-81c2-ebd571249a4f service glance] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:36.001537 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a910c35-ab3d-4c0f-81c2-ebd571249a4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:36.047370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:36.078164 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a910c35-ab3d-4c0f-81c2-ebd571249a4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:36.079656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a910c35-ab3d-4c0f-81c2-ebd571249a4f service glance] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:36.090156 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1361/2725] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:36.268142 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44132b-23c4-490d-aa1b-d09657b24294 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:36.268438 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44132b-23c4-490d-aa1b-d09657b24294 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:36.268722 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44132b-23c4-490d-aa1b-d09657b24294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:36.300955 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-0c44132b-23c4-490d-aa1b-d09657b24294 None None] MFA Rules not processed for user `a1936a2649c349d481f56304b3ee55b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:36.302384 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0c44132b-23c4-490d-aa1b-d09657b24294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:36.335554 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:36.374208 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1365/2726] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Jul 28 18:02:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:02:36.393367 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a910c35-ab3d-4c0f-81c2-ebd571249a4f service glance] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:36.488464 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a910c35-ab3d-4c0f-81c2-ebd571249a4f service glance] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:36.493949 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eac5c6-803a-4bf0-9f53-c45c06c26d7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ea1a9023eaf427f96f86af909a803fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:36.494599 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eac5c6-803a-4bf0-9f53-c45c06c26d7b service swift] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:36.494878 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eac5c6-803a-4bf0-9f53-c45c06c26d7b service swift] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:36.495270 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eac5c6-803a-4bf0-9f53-c45c06c26d7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:36.505466 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eac5c6-803a-4bf0-9f53-c45c06c26d7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:36.507106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eac5c6-803a-4bf0-9f53-c45c06c26d7b service swift] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:36.516421 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1362/2727] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Jul 28 18:02:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:02:38.085444 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44132b-23c4-490d-aa1b-d09657b24294 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:38.087055 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0c44132b-23c4-490d-aa1b-d09657b24294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:38.214570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44132b-23c4-490d-aa1b-d09657b24294 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:38.220565 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaebfda-ef80-4473-8607-4fc579c1729c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38257735924d44488e1407fefb886324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:38.222047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaebfda-ef80-4473-8607-4fc579c1729c service placement] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:38.222550 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaebfda-ef80-4473-8607-4fc579c1729c service placement] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:38.222904 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaebfda-ef80-4473-8607-4fc579c1729c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:38.224916 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-daaebfda-ef80-4473-8607-4fc579c1729c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:38.248708 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaebfda-ef80-4473-8607-4fc579c1729c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:38.251341 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaebfda-ef80-4473-8607-4fc579c1729c service placement] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:38.268758 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1366/2728] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:42.324307 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eac5c6-803a-4bf0-9f53-c45c06c26d7b service swift] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:42.353755 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eac5c6-803a-4bf0-9f53-c45c06c26d7b service swift] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:42.361623 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababe19a-b31b-4476-86ef-8f6ce27e7f41 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38257735924d44488e1407fefb886324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:42.362374 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababe19a-b31b-4476-86ef-8f6ce27e7f41 service placement] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:42.365165 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababe19a-b31b-4476-86ef-8f6ce27e7f41 service placement] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:42.365165 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababe19a-b31b-4476-86ef-8f6ce27e7f41 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:42.371935 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ababe19a-b31b-4476-86ef-8f6ce27e7f41 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:42.390471 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababe19a-b31b-4476-86ef-8f6ce27e7f41 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:42.392372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababe19a-b31b-4476-86ef-8f6ce27e7f41 service placement] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:42.416305 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1363/2729] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:42.466325 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaebfda-ef80-4473-8607-4fc579c1729c service placement] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:42.467875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-daaebfda-ef80-4473-8607-4fc579c1729c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:42.493346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaebfda-ef80-4473-8607-4fc579c1729c service placement] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:42.513787 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65433fb-b006-4091-a473-5df91ef23a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:42.514332 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65433fb-b006-4091-a473-5df91ef23a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:42.514637 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65433fb-b006-4091-a473-5df91ef23a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:42.514916 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65433fb-b006-4091-a473-5df91ef23a8f admin admin] PATH_INFO: `/v3/users/b58d9d1ef4954e79ad98bd8abdc71dab` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:42.525031 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65433fb-b006-4091-a473-5df91ef23a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b58d9d1ef4954e79ad98bd8abdc71dab)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:42.527272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65433fb-b006-4091-a473-5df91ef23a8f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:42.636651 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d65433fb-b006-4091-a473-5df91ef23a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b58d9d1ef4954e79ad98bd8abdc71dab'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:42.637265 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d65433fb-b006-4091-a473-5df91ef23a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b58d9d1ef4954e79ad98bd8abdc71dab'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:42.651990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d65433fb-b006-4091-a473-5df91ef23a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b58d9d1ef4954e79ad98bd8abdc71dab'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:42.669554 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d65433fb-b006-4091-a473-5df91ef23a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b58d9d1ef4954e79ad98bd8abdc71dab'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:42.670415 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d65433fb-b006-4091-a473-5df91ef23a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b58d9d1ef4954e79ad98bd8abdc71dab'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:42.691831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1367/2730] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:02:42 2022] DELETE /identity/v3/users/b58d9d1ef4954e79ad98bd8abdc71dab => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:42.927813 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababe19a-b31b-4476-86ef-8f6ce27e7f41 service placement] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:42.951958 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababe19a-b31b-4476-86ef-8f6ce27e7f41 service placement] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:43.075895 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee033cf4-5fe1-46f2-88af-90b488205c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:43.077254 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee033cf4-5fe1-46f2-88af-90b488205c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:43.077626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee033cf4-5fe1-46f2-88af-90b488205c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:43.078166 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee033cf4-5fe1-46f2-88af-90b488205c13 admin admin] PATH_INFO: `/v3/projects/a9c4e18008c649eab473e8fcd4cd13bd` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:43.079711 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee033cf4-5fe1-46f2-88af-90b488205c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9c4e18008c649eab473e8fcd4cd13bd)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:43.081837 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee033cf4-5fe1-46f2-88af-90b488205c13 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:43.147008 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-ee033cf4-5fe1-46f2-88af-90b488205c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9c4e18008c649eab473e8fcd4cd13bd', 'request_id': 'req-ee033cf4-5fe1-46f2-88af-90b488205c13'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:43.149315 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:43.161303 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-ee033cf4-5fe1-46f2-88af-90b488205c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9c4e18008c649eab473e8fcd4cd13bd', 'request_id': 'req-ee033cf4-5fe1-46f2-88af-90b488205c13'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:43.183378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-ee033cf4-5fe1-46f2-88af-90b488205c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9c4e18008c649eab473e8fcd4cd13bd', 'request_id': 'req-ee033cf4-5fe1-46f2-88af-90b488205c13'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:43.217715 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-ee033cf4-5fe1-46f2-88af-90b488205c13 admin admin] The token cache is being invalidate because project a9c4e18008c649eab473e8fcd4cd13bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:02:43.218163 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-ee033cf4-5fe1-46f2-88af-90b488205c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:43.219132 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-ee033cf4-5fe1-46f2-88af-90b488205c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:43.221681 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1364/2731] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:02:42 2022] DELETE /identity/v3/projects/a9c4e18008c649eab473e8fcd4cd13bd => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:43.225394 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65433fb-b006-4091-a473-5df91ef23a8f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:43.226882 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d65433fb-b006-4091-a473-5df91ef23a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:43.250915 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65433fb-b006-4091-a473-5df91ef23a8f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:43.310316 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:43.352280 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff0c97-3a3f-4afd-9a1c-97df8978295f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:43.353271 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff0c97-3a3f-4afd-9a1c-97df8978295f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:43.353618 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff0c97-3a3f-4afd-9a1c-97df8978295f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:43.354179 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff0c97-3a3f-4afd-9a1c-97df8978295f admin admin] PATH_INFO: `/v3/users/b4237b16661b4e0f859c0fa7e8f46562` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:43.355581 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff0c97-3a3f-4afd-9a1c-97df8978295f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4237b16661b4e0f859c0fa7e8f46562)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:43.357932 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff0c97-3a3f-4afd-9a1c-97df8978295f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:43.455849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8bff0c97-3a3f-4afd-9a1c-97df8978295f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4237b16661b4e0f859c0fa7e8f46562'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:43.456801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8bff0c97-3a3f-4afd-9a1c-97df8978295f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4237b16661b4e0f859c0fa7e8f46562'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:43.472366 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8bff0c97-3a3f-4afd-9a1c-97df8978295f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4237b16661b4e0f859c0fa7e8f46562'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:43.489856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8bff0c97-3a3f-4afd-9a1c-97df8978295f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4237b16661b4e0f859c0fa7e8f46562'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:43.490554 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8bff0c97-3a3f-4afd-9a1c-97df8978295f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4237b16661b4e0f859c0fa7e8f46562'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:43.508950 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1368/2732] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:02:43 2022] DELETE /identity/v3/users/b4237b16661b4e0f859c0fa7e8f46562 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:43.759427 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee033cf4-5fe1-46f2-88af-90b488205c13 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:43.760984 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ee033cf4-5fe1-46f2-88af-90b488205c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:43.780959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee033cf4-5fe1-46f2-88af-90b488205c13 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:43.862315 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63b2f3-4fb7-4d11-bedf-cca720e86bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:43.863508 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63b2f3-4fb7-4d11-bedf-cca720e86bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:43.863817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63b2f3-4fb7-4d11-bedf-cca720e86bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:43.864095 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63b2f3-4fb7-4d11-bedf-cca720e86bd1 admin admin] PATH_INFO: `/v3/projects/97c6a56a130a4c59954d2e6e0152aea5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:43.865336 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63b2f3-4fb7-4d11-bedf-cca720e86bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c6a56a130a4c59954d2e6e0152aea5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:43.867329 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63b2f3-4fb7-4d11-bedf-cca720e86bd1 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:43.929520 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2f63b2f3-4fb7-4d11-bedf-cca720e86bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c6a56a130a4c59954d2e6e0152aea5', 'request_id': 'req-2f63b2f3-4fb7-4d11-bedf-cca720e86bd1'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:43.944484 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2f63b2f3-4fb7-4d11-bedf-cca720e86bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c6a56a130a4c59954d2e6e0152aea5', 'request_id': 'req-2f63b2f3-4fb7-4d11-bedf-cca720e86bd1'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:43.951964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2f63b2f3-4fb7-4d11-bedf-cca720e86bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c6a56a130a4c59954d2e6e0152aea5', 'request_id': 'req-2f63b2f3-4fb7-4d11-bedf-cca720e86bd1'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:43.963932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2f63b2f3-4fb7-4d11-bedf-cca720e86bd1 admin admin] The token cache is being invalidate because project 97c6a56a130a4c59954d2e6e0152aea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:02:43.964261 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2f63b2f3-4fb7-4d11-bedf-cca720e86bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:43.965044 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2f63b2f3-4fb7-4d11-bedf-cca720e86bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:02:43.966927 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1365/2733] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:02:43 2022] DELETE /identity/v3/projects/97c6a56a130a4c59954d2e6e0152aea5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:02:47.308738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1642c-19f9-4f0d-819d-5bd24688dc16 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:47.309335 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1642c-19f9-4f0d-819d-5bd24688dc16 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:47.309335 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1642c-19f9-4f0d-819d-5bd24688dc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:47.329265 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-72d1642c-19f9-4f0d-819d-5bd24688dc16 None None] MFA Rules not processed for user `be1b3b870b184055b532d22a05860444`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:47.330514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-72d1642c-19f9-4f0d-819d-5bd24688dc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:47.388675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1369/2734] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:02:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:49.379117 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4af6c-8aab-4a07-a3ab-8947ef93b6ea None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:49.380140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4af6c-8aab-4a07-a3ab-8947ef93b6ea None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:49.380649 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4af6c-8aab-4a07-a3ab-8947ef93b6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:49.403992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-44f4af6c-8aab-4a07-a3ab-8947ef93b6ea None None] MFA Rules not processed for user `a1936a2649c349d481f56304b3ee55b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:49.405388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-44f4af6c-8aab-4a07-a3ab-8947ef93b6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:49.470457 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1366/2735] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Jul 28 18:02:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:49.482181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1642c-19f9-4f0d-819d-5bd24688dc16 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:49.483716 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-72d1642c-19f9-4f0d-819d-5bd24688dc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:49.569407 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:49.574556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1642c-19f9-4f0d-819d-5bd24688dc16 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:49.581922 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca1a45-fa97-4765-b3b3-ccdf77ed0909 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ea1a9023eaf427f96f86af909a803fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:49.582606 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca1a45-fa97-4765-b3b3-ccdf77ed0909 service swift] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:49.583170 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca1a45-fa97-4765-b3b3-ccdf77ed0909 service swift] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:49.583746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca1a45-fa97-4765-b3b3-ccdf77ed0909 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:49.593381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca1a45-fa97-4765-b3b3-ccdf77ed0909 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:49.595091 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca1a45-fa97-4765-b3b3-ccdf77ed0909 service swift] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:49.605726 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1370/2736] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Jul 28 18:02:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:02:59.461047 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=82 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:59.602077 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:03:07.706068 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05483315-e15f-4c3f-b0df-5c646b511e58 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:07.706646 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05483315-e15f-4c3f-b0df-5c646b511e58 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:07.706754 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05483315-e15f-4c3f-b0df-5c646b511e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:07.726663 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-05483315-e15f-4c3f-b0df-5c646b511e58 None None] MFA Rules not processed for user `2984a1ad28044641bff1d12fa7de7851`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:03:07.727982 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-05483315-e15f-4c3f-b0df-5c646b511e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:03:07.789548 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1367/2737] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:03:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:03:11.527098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca1a45-fa97-4765-b3b3-ccdf77ed0909 service swift] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:03:11.529476 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-aeca1a45-fa97-4765-b3b3-ccdf77ed0909 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:03:11.591950 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca1a45-fa97-4765-b3b3-ccdf77ed0909 service swift] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:03:11.595920 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d20f76-61c7-4d8f-a2c3-bd2cafe5c620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:03:11.596551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d20f76-61c7-4d8f-a2c3-bd2cafe5c620 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:03:11.596875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d20f76-61c7-4d8f-a2c3-bd2cafe5c620 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:03:11.597212 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d20f76-61c7-4d8f-a2c3-bd2cafe5c620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:03:11.599357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-80d20f76-61c7-4d8f-a2c3-bd2cafe5c620 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:03:11.667243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d20f76-61c7-4d8f-a2c3-bd2cafe5c620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:03:11.668623 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d20f76-61c7-4d8f-a2c3-bd2cafe5c620 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:03:11.678557 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1371/2738] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:03:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:03:17.782184 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=25 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:03:21.674118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=50 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:14.750140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b2272-fc67-4c0c-bb0d-bbc4f2b822a4 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:14.750915 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b2272-fc67-4c0c-bb0d-bbc4f2b822a4 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:14.750915 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b2272-fc67-4c0c-bb0d-bbc4f2b822a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:14.793769 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-064b2272-fc67-4c0c-bb0d-bbc4f2b822a4 None None] MFA Rules not processed for user `a1936a2649c349d481f56304b3ee55b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:04:14.794981 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-064b2272-fc67-4c0c-bb0d-bbc4f2b822a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:14.833258 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1368/2739] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Jul 28 18:04:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:04:14.877340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d20f76-61c7-4d8f-a2c3-bd2cafe5c620 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:04:14.930625 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d20f76-61c7-4d8f-a2c3-bd2cafe5c620 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:04:14.935783 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a35e14-92f2-4878-99b1-8a8eca87cb0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ea1a9023eaf427f96f86af909a803fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:04:14.936335 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a35e14-92f2-4878-99b1-8a8eca87cb0b service swift] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:14.936623 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a35e14-92f2-4878-99b1-8a8eca87cb0b service swift] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:14.937098 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a35e14-92f2-4878-99b1-8a8eca87cb0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:14.945945 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a35e14-92f2-4878-99b1-8a8eca87cb0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:04:14.947564 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a35e14-92f2-4878-99b1-8a8eca87cb0b service swift] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:04:14.956514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1372/2740] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Jul 28 18:04:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:04:24.830611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=23 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:24.952669 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=20 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:26.662179 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b2272-fc67-4c0c-bb0d-bbc4f2b822a4 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:04:26.663713 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-064b2272-fc67-4c0c-bb0d-bbc4f2b822a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:26.771352 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b2272-fc67-4c0c-bb0d-bbc4f2b822a4 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:04:26.776650 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c04c5f-53aa-40e8-a221-f8e59486e838 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38257735924d44488e1407fefb886324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:04:26.777320 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c04c5f-53aa-40e8-a221-f8e59486e838 service placement] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:26.777603 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c04c5f-53aa-40e8-a221-f8e59486e838 service placement] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:26.777880 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c04c5f-53aa-40e8-a221-f8e59486e838 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:26.781768 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-40c04c5f-53aa-40e8-a221-f8e59486e838 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:26.799954 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c04c5f-53aa-40e8-a221-f8e59486e838 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:04:26.801596 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c04c5f-53aa-40e8-a221-f8e59486e838 service placement] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:04:26.817265 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1369/2741] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:04:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:04:29.052312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14984677-940d-454c-afd8-74d5e7d211c0 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:29.052810 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14984677-940d-454c-afd8-74d5e7d211c0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:29.052975 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14984677-940d-454c-afd8-74d5e7d211c0 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:29.054582 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1373/2742] 10.222.0.96 () {54 vars in 921 bytes} [Thu Jul 28 18:04:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:04:29.060105 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082fc05-d43d-41b2-a056-f853ad51d791 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:29.060629 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082fc05-d43d-41b2-a056-f853ad51d791 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:29.060722 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082fc05-d43d-41b2-a056-f853ad51d791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:29.128799 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-f082fc05-d43d-41b2-a056-f853ad51d791 None None] MFA Rules not processed for user `5ac367247aa54671ae5c33d251017470`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:04:29.132854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f082fc05-d43d-41b2-a056-f853ad51d791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:29.232049 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1370/2743] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Jul 28 18:04:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:04:29.245590 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14984677-940d-454c-afd8-74d5e7d211c0 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:04:29.247392 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-14984677-940d-454c-afd8-74d5e7d211c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:29.310520 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14984677-940d-454c-afd8-74d5e7d211c0 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:04:29.314183 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702f9f8-c3f8-4948-9022-95752a40d44c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98465c2d73e540b5bf506f5a7423e035', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:04:29.314845 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702f9f8-c3f8-4948-9022-95752a40d44c service glance] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:29.315219 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702f9f8-c3f8-4948-9022-95752a40d44c service glance] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:29.315497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702f9f8-c3f8-4948-9022-95752a40d44c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:29.330236 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702f9f8-c3f8-4948-9022-95752a40d44c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:04:29.331820 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702f9f8-c3f8-4948-9022-95752a40d44c service glance] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:04:29.343934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1374/2744] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:04:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:04:31.333197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a5d8f-5955-4584-9058-e9e2263a8e54 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:31.333700 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a5d8f-5955-4584-9058-e9e2263a8e54 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:31.333700 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a5d8f-5955-4584-9058-e9e2263a8e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:31.353745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-466a5d8f-5955-4584-9058-e9e2263a8e54 None None] MFA Rules not processed for user `a1936a2649c349d481f56304b3ee55b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:04:31.354977 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-466a5d8f-5955-4584-9058-e9e2263a8e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:31.364040 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1371/2745] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Jul 28 18:04:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:04:31.376796 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702f9f8-c3f8-4948-9022-95752a40d44c service glance] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:04:31.388629 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702f9f8-c3f8-4948-9022-95752a40d44c service glance] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:04:31.394289 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b2352-ddcd-4965-9914-d8e02de2adcd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ea1a9023eaf427f96f86af909a803fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:04:31.394909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b2352-ddcd-4965-9914-d8e02de2adcd service swift] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:31.395209 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b2352-ddcd-4965-9914-d8e02de2adcd service swift] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:31.395556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b2352-ddcd-4965-9914-d8e02de2adcd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:31.404412 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b2352-ddcd-4965-9914-d8e02de2adcd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:04:31.406057 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b2352-ddcd-4965-9914-d8e02de2adcd service swift] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:04:31.415114 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1375/2746] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Jul 28 18:04:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:04:41.348146 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=88 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:41.411403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=32 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:44.700297 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36decdc1-0345-4ce2-9ea9-4bf69f88781c None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:44.700775 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36decdc1-0345-4ce2-9ea9-4bf69f88781c None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:44.700891 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36decdc1-0345-4ce2-9ea9-4bf69f88781c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:44.720240 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-36decdc1-0345-4ce2-9ea9-4bf69f88781c None None] MFA Rules not processed for user `a1936a2649c349d481f56304b3ee55b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:04:44.721471 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-36decdc1-0345-4ce2-9ea9-4bf69f88781c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:44.729264 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1372/2747] 10.222.0.96 () {58 vars in 967 bytes} [Thu Jul 28 18:04:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:04:44.744183 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b2352-ddcd-4965-9914-d8e02de2adcd service swift] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:04:44.755908 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b2352-ddcd-4965-9914-d8e02de2adcd service swift] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:04:44.762513 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c8bc2-59c2-43a6-89a1-a82ba8437418 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ea1a9023eaf427f96f86af909a803fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:04:44.763177 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c8bc2-59c2-43a6-89a1-a82ba8437418 service swift] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:44.763484 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c8bc2-59c2-43a6-89a1-a82ba8437418 service swift] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:44.763789 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c8bc2-59c2-43a6-89a1-a82ba8437418 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:44.773145 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c8bc2-59c2-43a6-89a1-a82ba8437418 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:04:44.774531 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c8bc2-59c2-43a6-89a1-a82ba8437418 service swift] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:04:44.782994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1376/2748] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Jul 28 18:04:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:04:46.929192 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffc792-317b-4ddb-bfc2-387a964aee2f None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:46.930036 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffc792-317b-4ddb-bfc2-387a964aee2f None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:46.930488 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffc792-317b-4ddb-bfc2-387a964aee2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:46.952348 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-aeffc792-317b-4ddb-bfc2-387a964aee2f None None] MFA Rules not processed for user `a1936a2649c349d481f56304b3ee55b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:04:46.953959 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-aeffc792-317b-4ddb-bfc2-387a964aee2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:46.961828 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1373/2749] 10.222.0.96 () {58 vars in 967 bytes} [Thu Jul 28 18:04:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:04:46.978973 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c8bc2-59c2-43a6-89a1-a82ba8437418 service swift] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:04:46.991071 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c8bc2-59c2-43a6-89a1-a82ba8437418 service swift] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:04:46.997332 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9c370-3971-47c4-8f2f-0e6bda9451b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ea1a9023eaf427f96f86af909a803fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:04:46.998030 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9c370-3971-47c4-8f2f-0e6bda9451b9 service swift] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:46.998319 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9c370-3971-47c4-8f2f-0e6bda9451b9 service swift] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:46.998595 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9c370-3971-47c4-8f2f-0e6bda9451b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:47.009392 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9c370-3971-47c4-8f2f-0e6bda9451b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:04:47.011243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9c370-3971-47c4-8f2f-0e6bda9451b9 service swift] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:04:47.025756 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1377/2750] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Jul 28 18:04:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 18:04:51.882439 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffc792-317b-4ddb-bfc2-387a964aee2f None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:04:51.884104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-aeffc792-317b-4ddb-bfc2-387a964aee2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:51.998747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffc792-317b-4ddb-bfc2-387a964aee2f None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:04:52.003588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501a3f8-f8d3-43f2-abe7-3964607f02ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:04:52.004184 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501a3f8-f8d3-43f2-abe7-3964607f02ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:52.004464 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501a3f8-f8d3-43f2-abe7-3964607f02ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:52.004740 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501a3f8-f8d3-43f2-abe7-3964607f02ae admin admin] PATH_INFO: `/v3/users/be1b3b870b184055b532d22a05860444` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:52.006015 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501a3f8-f8d3-43f2-abe7-3964607f02ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=be1b3b870b184055b532d22a05860444)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:04:52.007980 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501a3f8-f8d3-43f2-abe7-3964607f02ae admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:04:52.057407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-8501a3f8-f8d3-43f2-abe7-3964607f02ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be1b3b870b184055b532d22a05860444'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:52.069290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-8501a3f8-f8d3-43f2-abe7-3964607f02ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be1b3b870b184055b532d22a05860444'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:52.079517 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-8501a3f8-f8d3-43f2-abe7-3964607f02ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be1b3b870b184055b532d22a05860444'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:52.086603 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-8501a3f8-f8d3-43f2-abe7-3964607f02ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be1b3b870b184055b532d22a05860444'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:52.087299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-8501a3f8-f8d3-43f2-abe7-3964607f02ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be1b3b870b184055b532d22a05860444'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:52.093404 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1374/2751] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:04:51 2022] DELETE /identity/v3/users/be1b3b870b184055b532d22a05860444 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:04:52.295367 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9c370-3971-47c4-8f2f-0e6bda9451b9 service swift] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:04:52.307737 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9c370-3971-47c4-8f2f-0e6bda9451b9 service swift] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:04:52.371772 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448e6f2-21c7-414a-95a9-f3704870989d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:04:52.372365 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448e6f2-21c7-414a-95a9-f3704870989d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:52.372644 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448e6f2-21c7-414a-95a9-f3704870989d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:52.372943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448e6f2-21c7-414a-95a9-f3704870989d admin admin] PATH_INFO: `/v3/projects/7d6e348ec66645ed8fc9c88eb3694675` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:52.374119 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448e6f2-21c7-414a-95a9-f3704870989d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d6e348ec66645ed8fc9c88eb3694675)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:04:52.376013 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448e6f2-21c7-414a-95a9-f3704870989d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:04:52.433164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7448e6f2-21c7-414a-95a9-f3704870989d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d6e348ec66645ed8fc9c88eb3694675', 'request_id': 'req-7448e6f2-21c7-414a-95a9-f3704870989d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:52.439414 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7448e6f2-21c7-414a-95a9-f3704870989d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d6e348ec66645ed8fc9c88eb3694675', 'request_id': 'req-7448e6f2-21c7-414a-95a9-f3704870989d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:52.448964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7448e6f2-21c7-414a-95a9-f3704870989d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d6e348ec66645ed8fc9c88eb3694675', 'request_id': 'req-7448e6f2-21c7-414a-95a9-f3704870989d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:52.460390 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7448e6f2-21c7-414a-95a9-f3704870989d admin admin] The token cache is being invalidate because project 7d6e348ec66645ed8fc9c88eb3694675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:04:52.460693 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7448e6f2-21c7-414a-95a9-f3704870989d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:52.461392 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7448e6f2-21c7-414a-95a9-f3704870989d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:52.462894 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1378/2752] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:04:52 2022] DELETE /identity/v3/projects/7d6e348ec66645ed8fc9c88eb3694675 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:04:52.467747 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501a3f8-f8d3-43f2-abe7-3964607f02ae admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:04:52.469827 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-8501a3f8-f8d3-43f2-abe7-3964607f02ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:52.486499 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501a3f8-f8d3-43f2-abe7-3964607f02ae admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:04:52.521615 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:52.550392 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8546f4c-5bdd-4a75-a3aa-761445121ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:04:52.551051 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8546f4c-5bdd-4a75-a3aa-761445121ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:52.551329 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8546f4c-5bdd-4a75-a3aa-761445121ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:52.551602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8546f4c-5bdd-4a75-a3aa-761445121ea4 admin admin] PATH_INFO: `/v3/users/cb60f548ae3041b38bc87567097b28ad` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:52.552805 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8546f4c-5bdd-4a75-a3aa-761445121ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb60f548ae3041b38bc87567097b28ad)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:04:52.554852 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8546f4c-5bdd-4a75-a3aa-761445121ea4 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:04:52.605467 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e8546f4c-5bdd-4a75-a3aa-761445121ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb60f548ae3041b38bc87567097b28ad'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:52.618454 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e8546f4c-5bdd-4a75-a3aa-761445121ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb60f548ae3041b38bc87567097b28ad'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:52.628617 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e8546f4c-5bdd-4a75-a3aa-761445121ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb60f548ae3041b38bc87567097b28ad'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:52.636588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e8546f4c-5bdd-4a75-a3aa-761445121ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb60f548ae3041b38bc87567097b28ad'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:52.637219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-e8546f4c-5bdd-4a75-a3aa-761445121ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb60f548ae3041b38bc87567097b28ad'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:52.643228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1375/2753] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:04:52 2022] DELETE /identity/v3/users/cb60f548ae3041b38bc87567097b28ad => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:04:52.828194 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448e6f2-21c7-414a-95a9-f3704870989d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:04:52.829781 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7448e6f2-21c7-414a-95a9-f3704870989d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:52.846965 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448e6f2-21c7-414a-95a9-f3704870989d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:04:52.908581 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042604f-8def-4092-93af-0c06c4256910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:04:52.909185 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042604f-8def-4092-93af-0c06c4256910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:52.909468 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042604f-8def-4092-93af-0c06c4256910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:52.909739 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042604f-8def-4092-93af-0c06c4256910 admin admin] PATH_INFO: `/v3/projects/1594b2299ddc445aa5109d0f85195be7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:52.911012 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042604f-8def-4092-93af-0c06c4256910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1594b2299ddc445aa5109d0f85195be7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:04:52.912941 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042604f-8def-4092-93af-0c06c4256910 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:04:52.922381 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:52.973908 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e042604f-8def-4092-93af-0c06c4256910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1594b2299ddc445aa5109d0f85195be7', 'request_id': 'req-e042604f-8def-4092-93af-0c06c4256910'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:52.980814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e042604f-8def-4092-93af-0c06c4256910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1594b2299ddc445aa5109d0f85195be7', 'request_id': 'req-e042604f-8def-4092-93af-0c06c4256910'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:52.991330 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e042604f-8def-4092-93af-0c06c4256910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1594b2299ddc445aa5109d0f85195be7', 'request_id': 'req-e042604f-8def-4092-93af-0c06c4256910'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:53.002492 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e042604f-8def-4092-93af-0c06c4256910 admin admin] The token cache is being invalidate because project 1594b2299ddc445aa5109d0f85195be7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:04:53.002778 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e042604f-8def-4092-93af-0c06c4256910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:53.003447 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e042604f-8def-4092-93af-0c06c4256910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:53.005034 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1379/2754] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:04:52 2022] DELETE /identity/v3/projects/1594b2299ddc445aa5109d0f85195be7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:02.639752 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=36,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:02.999771 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:29.361299 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8546f4c-5bdd-4a75-a3aa-761445121ea4 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:29.362921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e8546f4c-5bdd-4a75-a3aa-761445121ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:29.377014 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8546f4c-5bdd-4a75-a3aa-761445121ea4 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:29.437474 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa010ef-5ac2-43a1-b3e5-61db5530bd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:29.438120 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa010ef-5ac2-43a1-b3e5-61db5530bd58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:29.438403 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa010ef-5ac2-43a1-b3e5-61db5530bd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:29.438676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa010ef-5ac2-43a1-b3e5-61db5530bd58 admin admin] PATH_INFO: `/v3/users/2984a1ad28044641bff1d12fa7de7851` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:29.439867 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa010ef-5ac2-43a1-b3e5-61db5530bd58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2984a1ad28044641bff1d12fa7de7851)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:29.441819 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa010ef-5ac2-43a1-b3e5-61db5530bd58 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:29.490257 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-1aa010ef-5ac2-43a1-b3e5-61db5530bd58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2984a1ad28044641bff1d12fa7de7851'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:29.502230 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-1aa010ef-5ac2-43a1-b3e5-61db5530bd58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2984a1ad28044641bff1d12fa7de7851'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:29.510889 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-1aa010ef-5ac2-43a1-b3e5-61db5530bd58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2984a1ad28044641bff1d12fa7de7851'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:29.518190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-1aa010ef-5ac2-43a1-b3e5-61db5530bd58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2984a1ad28044641bff1d12fa7de7851'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:29.518915 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-1aa010ef-5ac2-43a1-b3e5-61db5530bd58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2984a1ad28044641bff1d12fa7de7851'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:29.524940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1376/2755] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:05:29 2022] DELETE /identity/v3/users/2984a1ad28044641bff1d12fa7de7851 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:29.712354 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042604f-8def-4092-93af-0c06c4256910 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:29.714197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e042604f-8def-4092-93af-0c06c4256910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:29.733801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042604f-8def-4092-93af-0c06c4256910 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:29.798055 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecde81-ca2d-44e0-a08b-619ea55b717b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:29.798622 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecde81-ca2d-44e0-a08b-619ea55b717b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:29.798891 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecde81-ca2d-44e0-a08b-619ea55b717b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:29.799162 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecde81-ca2d-44e0-a08b-619ea55b717b admin admin] PATH_INFO: `/v3/projects/6933c67f8c634fb79269e646480bc887` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:29.800450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ecde81-ca2d-44e0-a08b-619ea55b717b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6933c67f8c634fb79269e646480bc887)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:29.802395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ecde81-ca2d-44e0-a08b-619ea55b717b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:29.855712 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-12ecde81-ca2d-44e0-a08b-619ea55b717b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6933c67f8c634fb79269e646480bc887', 'request_id': 'req-12ecde81-ca2d-44e0-a08b-619ea55b717b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:29.862297 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-12ecde81-ca2d-44e0-a08b-619ea55b717b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6933c67f8c634fb79269e646480bc887', 'request_id': 'req-12ecde81-ca2d-44e0-a08b-619ea55b717b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:29.871364 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-12ecde81-ca2d-44e0-a08b-619ea55b717b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6933c67f8c634fb79269e646480bc887', 'request_id': 'req-12ecde81-ca2d-44e0-a08b-619ea55b717b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:29.882194 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-12ecde81-ca2d-44e0-a08b-619ea55b717b admin admin] The token cache is being invalidate because project 6933c67f8c634fb79269e646480bc887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:05:29.882478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-12ecde81-ca2d-44e0-a08b-619ea55b717b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:29.883112 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-12ecde81-ca2d-44e0-a08b-619ea55b717b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:29.884744 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1380/2756] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:05:29 2022] DELETE /identity/v3/projects/6933c67f8c634fb79269e646480bc887 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:05:29.890739 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727e630-8025-41bc-ac8d-22efe780553c None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:29.891106 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727e630-8025-41bc-ac8d-22efe780553c None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:29.891590 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727e630-8025-41bc-ac8d-22efe780553c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:29.948653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-7727e630-8025-41bc-ac8d-22efe780553c None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:29.950699 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-7727e630-8025-41bc-ac8d-22efe780553c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:30.005350 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:30.016591 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1377/2757] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:30.024831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702672e6-1d0e-45aa-b8d3-26d4934199d5 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:30.025196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702672e6-1d0e-45aa-b8d3-26d4934199d5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:30.025442 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702672e6-1d0e-45aa-b8d3-26d4934199d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:30.046065 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-702672e6-1d0e-45aa-b8d3-26d4934199d5 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:30.047288 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-702672e6-1d0e-45aa-b8d3-26d4934199d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:30.056820 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1381/2758] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:30.061396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727e630-8025-41bc-ac8d-22efe780553c None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:30.071422 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727e630-8025-41bc-ac8d-22efe780553c None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:30.077005 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9daa619-0392-4ddd-bc4d-0d2f948ad53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:30.077657 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daa619-0392-4ddd-bc4d-0d2f948ad53e admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:30.077930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daa619-0392-4ddd-bc4d-0d2f948ad53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:30.078195 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daa619-0392-4ddd-bc4d-0d2f948ad53e admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:30.078884 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9daa619-0392-4ddd-bc4d-0d2f948ad53e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:05:30.079182 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9daa619-0392-4ddd-bc4d-0d2f948ad53e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:30.080802 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9daa619-0392-4ddd-bc4d-0d2f948ad53e admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:30.093407 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1378/2759] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 18:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:05:30.097868 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702672e6-1d0e-45aa-b8d3-26d4934199d5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:30.107671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702672e6-1d0e-45aa-b8d3-26d4934199d5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:30.113045 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03295946-3c02-4f73-b00d-831a0b32eda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:30.113676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03295946-3c02-4f73-b00d-831a0b32eda8 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:30.114004 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03295946-3c02-4f73-b00d-831a0b32eda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:30.114244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03295946-3c02-4f73-b00d-831a0b32eda8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:30.114931 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03295946-3c02-4f73-b00d-831a0b32eda8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:30.116857 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03295946-3c02-4f73-b00d-831a0b32eda8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:30.156185 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1382/2760] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:30 2022] POST /identity/v3/projects => generated 405 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:30.162210 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9daa619-0392-4ddd-bc4d-0d2f948ad53e admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:30.172363 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9daa619-0392-4ddd-bc4d-0d2f948ad53e admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:30.231077 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643077b-314d-492a-9b09-f0ccd06f44af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:30.231937 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643077b-314d-492a-9b09-f0ccd06f44af admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:30.232378 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643077b-314d-492a-9b09-f0ccd06f44af admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:30.232659 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643077b-314d-492a-9b09-f0ccd06f44af admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:30.233367 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643077b-314d-492a-9b09-f0ccd06f44af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:30.235656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643077b-314d-492a-9b09-f0ccd06f44af admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:30.258631 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1379/2761] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:30 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:05:30.263247 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03295946-3c02-4f73-b00d-831a0b32eda8 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:30.279080 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03295946-3c02-4f73-b00d-831a0b32eda8 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:30.285163 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d31987-60e2-470b-adf4-f89764fcb6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:30.285786 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d31987-60e2-470b-adf4-f89764fcb6ca admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:30.286060 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d31987-60e2-470b-adf4-f89764fcb6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:30.286336 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d31987-60e2-470b-adf4-f89764fcb6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:30.287025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d31987-60e2-470b-adf4-f89764fcb6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:30.288679 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d31987-60e2-470b-adf4-f89764fcb6ca admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:30.299134 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1383/2762] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:30.303545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643077b-314d-492a-9b09-f0ccd06f44af admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:30.314291 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643077b-314d-492a-9b09-f0ccd06f44af admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:30.319422 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29746d-4ec5-44ee-88fa-fd4ec18484bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:30.320058 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29746d-4ec5-44ee-88fa-fd4ec18484bd admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:30.320324 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29746d-4ec5-44ee-88fa-fd4ec18484bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:30.320622 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29746d-4ec5-44ee-88fa-fd4ec18484bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:30.321311 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29746d-4ec5-44ee-88fa-fd4ec18484bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:30.322922 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29746d-4ec5-44ee-88fa-fd4ec18484bd admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:30.334138 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1380/2763] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:30.338351 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d31987-60e2-470b-adf4-f89764fcb6ca admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:30.348431 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d31987-60e2-470b-adf4-f89764fcb6ca admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:30.353262 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb6306-ac9a-4c7e-9438-292baf954e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:30.353939 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb6306-ac9a-4c7e-9438-292baf954e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:30.354218 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb6306-ac9a-4c7e-9438-292baf954e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:30.354491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb6306-ac9a-4c7e-9438-292baf954e0b admin admin] PATH_INFO: `/v3/projects/88e6e71667c74ed2ba0dde44267d6d33/users/b4e4fcd06f044da8a403177c6355bfaa/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:30.370232 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb6306-ac9a-4c7e-9438-292baf954e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=88e6e71667c74ed2ba0dde44267d6d33, user_id=b4e4fcd06f044da8a403177c6355bfaa, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:30.372966 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb6306-ac9a-4c7e-9438-292baf954e0b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:30.387764 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1384/2764] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:30 2022] PUT /identity/v3/projects/88e6e71667c74ed2ba0dde44267d6d33/users/b4e4fcd06f044da8a403177c6355bfaa/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:30.393323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa690fb-94ff-4820-bb81-8f3d68f061a9 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:30.393854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa690fb-94ff-4820-bb81-8f3d68f061a9 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:30.393854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa690fb-94ff-4820-bb81-8f3d68f061a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:30.416354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-7fa690fb-94ff-4820-bb81-8f3d68f061a9 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:30.417632 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-7fa690fb-94ff-4820-bb81-8f3d68f061a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:30.477433 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1381/2765] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:05:30.488068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb6306-ac9a-4c7e-9438-292baf954e0b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:30.490103 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-efbb6306-ac9a-4c7e-9438-292baf954e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:30.513943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:30.575229 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb6306-ac9a-4c7e-9438-292baf954e0b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:30.579497 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2df24b-a591-4c2c-9fc8-1c2b4a9091e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:30.580143 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2df24b-a591-4c2c-9fc8-1c2b4a9091e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:30.580420 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2df24b-a591-4c2c-9fc8-1c2b4a9091e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:30.580696 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2df24b-a591-4c2c-9fc8-1c2b4a9091e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:30.590808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2df24b-a591-4c2c-9fc8-1c2b4a9091e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:30.592484 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2df24b-a591-4c2c-9fc8-1c2b4a9091e1 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:30.603193 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1385/2766] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:31.281790 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2742bfa-2ed7-4659-a26d-4fcff7fe430b None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:31.282105 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2742bfa-2ed7-4659-a26d-4fcff7fe430b None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:31.282389 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2742bfa-2ed7-4659-a26d-4fcff7fe430b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:31.312013 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-e2742bfa-2ed7-4659-a26d-4fcff7fe430b None None] MFA Rules not processed for user `b4e4fcd06f044da8a403177c6355bfaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:31.313298 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e2742bfa-2ed7-4659-a26d-4fcff7fe430b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:31.372148 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:31.385668 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1382/2767] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:31 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:31.390312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2df24b-a591-4c2c-9fc8-1c2b4a9091e1 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:31.400913 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2df24b-a591-4c2c-9fc8-1c2b4a9091e1 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:31.405774 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c2d1b-e1e7-4cdb-aedc-b96badab996d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:31.406406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c2d1b-e1e7-4cdb-aedc-b96badab996d admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:31.406686 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c2d1b-e1e7-4cdb-aedc-b96badab996d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:31.406958 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c2d1b-e1e7-4cdb-aedc-b96badab996d admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:31.407620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c2d1b-e1e7-4cdb-aedc-b96badab996d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:31.409577 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c2d1b-e1e7-4cdb-aedc-b96badab996d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:31.440102 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1386/2768] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:31 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:31.444223 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2742bfa-2ed7-4659-a26d-4fcff7fe430b None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:31.459847 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2742bfa-2ed7-4659-a26d-4fcff7fe430b None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:31.525461 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d67e51-05b3-438f-a4b6-d98b991c2a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:31.526064 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d67e51-05b3-438f-a4b6-d98b991c2a0f admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:31.526339 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d67e51-05b3-438f-a4b6-d98b991c2a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:31.526724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d67e51-05b3-438f-a4b6-d98b991c2a0f admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:31.527441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d67e51-05b3-438f-a4b6-d98b991c2a0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:31.529447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d67e51-05b3-438f-a4b6-d98b991c2a0f admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:31.552607 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1383/2769] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:31 2022] POST /identity/v3/users => generated 308 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:05:31.556812 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c2d1b-e1e7-4cdb-aedc-b96badab996d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:31.567709 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c2d1b-e1e7-4cdb-aedc-b96badab996d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:31.572227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3eba2-6314-4f5c-b08d-208c2fe2fe9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:31.572854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3eba2-6314-4f5c-b08d-208c2fe2fe9c admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:31.573164 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3eba2-6314-4f5c-b08d-208c2fe2fe9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:31.573532 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3eba2-6314-4f5c-b08d-208c2fe2fe9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:31.574250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3eba2-6314-4f5c-b08d-208c2fe2fe9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:31.576230 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3eba2-6314-4f5c-b08d-208c2fe2fe9c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:31.586374 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1387/2770] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:31.590743 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d67e51-05b3-438f-a4b6-d98b991c2a0f admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:31.601472 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d67e51-05b3-438f-a4b6-d98b991c2a0f admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:31.607566 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf2dd9-90f7-4845-816a-5aadf978de9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:31.608242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf2dd9-90f7-4845-816a-5aadf978de9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:31.608851 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf2dd9-90f7-4845-816a-5aadf978de9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:31.609158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf2dd9-90f7-4845-816a-5aadf978de9b admin admin] PATH_INFO: `/v3/projects/29a975662369439eadc734bb2dc7e292/users/a39a641d3bd0451196288a30496f17c2/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:31.627210 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf2dd9-90f7-4845-816a-5aadf978de9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=29a975662369439eadc734bb2dc7e292, user_id=a39a641d3bd0451196288a30496f17c2, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:31.630103 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf2dd9-90f7-4845-816a-5aadf978de9b admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:31.646441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1384/2771] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:31 2022] PUT /identity/v3/projects/29a975662369439eadc734bb2dc7e292/users/a39a641d3bd0451196288a30496f17c2/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:31.650664 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3eba2-6314-4f5c-b08d-208c2fe2fe9c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:31.661271 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3eba2-6314-4f5c-b08d-208c2fe2fe9c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:31.722907 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfed9e-bdaf-4932-b83c-7aeb6691c8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:31.723529 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfed9e-bdaf-4932-b83c-7aeb6691c8ae admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:31.723821 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfed9e-bdaf-4932-b83c-7aeb6691c8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:31.724090 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfed9e-bdaf-4932-b83c-7aeb6691c8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:31.724772 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfed9e-bdaf-4932-b83c-7aeb6691c8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:31.726432 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfed9e-bdaf-4932-b83c-7aeb6691c8ae admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:31.737570 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1388/2772] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:05:31.741924 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf2dd9-90f7-4845-816a-5aadf978de9b admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:31.752538 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf2dd9-90f7-4845-816a-5aadf978de9b admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:31.757525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9af8a-32a8-4fc7-9775-c57be2491eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:31.758192 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9af8a-32a8-4fc7-9775-c57be2491eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:31.758470 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9af8a-32a8-4fc7-9775-c57be2491eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:31.758748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9af8a-32a8-4fc7-9775-c57be2491eb8 admin admin] PATH_INFO: `/v3/projects/29a975662369439eadc734bb2dc7e292/users/a39a641d3bd0451196288a30496f17c2/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:31.760774 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9af8a-32a8-4fc7-9775-c57be2491eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29a975662369439eadc734bb2dc7e292, user_id=a39a641d3bd0451196288a30496f17c2, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:31.763425 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9af8a-32a8-4fc7-9775-c57be2491eb8 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:31.774055 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1385/2773] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:31 2022] PUT /identity/v3/projects/29a975662369439eadc734bb2dc7e292/users/a39a641d3bd0451196288a30496f17c2/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:32.441553 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36223946-27e1-4e3b-b10c-9eb57aeab667 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:32.442156 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36223946-27e1-4e3b-b10c-9eb57aeab667 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:32.442156 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36223946-27e1-4e3b-b10c-9eb57aeab667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:32.471008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-36223946-27e1-4e3b-b10c-9eb57aeab667 None None] MFA Rules not processed for user `a39a641d3bd0451196288a30496f17c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:32.472248 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-36223946-27e1-4e3b-b10c-9eb57aeab667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:32.527902 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:32.554251 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1389/2774] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:32 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:33.898166 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9af8a-32a8-4fc7-9775-c57be2491eb8 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:33.966875 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9af8a-32a8-4fc7-9775-c57be2491eb8 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:33.972807 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321254dd-df08-4dac-b321-a70dc0ba32b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:33.973481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321254dd-df08-4dac-b321-a70dc0ba32b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:33.973750 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321254dd-df08-4dac-b321-a70dc0ba32b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:33.974029 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321254dd-df08-4dac-b321-a70dc0ba32b5 admin admin] PATH_INFO: `/v3/users/b4e4fcd06f044da8a403177c6355bfaa` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:33.975306 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321254dd-df08-4dac-b321-a70dc0ba32b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4e4fcd06f044da8a403177c6355bfaa)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:33.977432 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321254dd-df08-4dac-b321-a70dc0ba32b5 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:34.040743 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-321254dd-df08-4dac-b321-a70dc0ba32b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4e4fcd06f044da8a403177c6355bfaa'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:34.041946 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:34.061359 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-321254dd-df08-4dac-b321-a70dc0ba32b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4e4fcd06f044da8a403177c6355bfaa'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:34.072221 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-321254dd-df08-4dac-b321-a70dc0ba32b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4e4fcd06f044da8a403177c6355bfaa'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:34.079894 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-321254dd-df08-4dac-b321-a70dc0ba32b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4e4fcd06f044da8a403177c6355bfaa'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:34.080537 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-321254dd-df08-4dac-b321-a70dc0ba32b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4e4fcd06f044da8a403177c6355bfaa'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:34.086712 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1386/2775] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:05:33 2022] DELETE /identity/v3/users/b4e4fcd06f044da8a403177c6355bfaa => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:34.272879 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36223946-27e1-4e3b-b10c-9eb57aeab667 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:34.284811 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36223946-27e1-4e3b-b10c-9eb57aeab667 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:34.347271 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c277311-d75f-4b52-bd25-d03eb630c1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:34.347919 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c277311-d75f-4b52-bd25-d03eb630c1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:34.348198 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c277311-d75f-4b52-bd25-d03eb630c1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:34.348474 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c277311-d75f-4b52-bd25-d03eb630c1f6 admin admin] PATH_INFO: `/v3/projects/88e6e71667c74ed2ba0dde44267d6d33` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:34.349673 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c277311-d75f-4b52-bd25-d03eb630c1f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88e6e71667c74ed2ba0dde44267d6d33)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:34.351587 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c277311-d75f-4b52-bd25-d03eb630c1f6 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:34.398965 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8c277311-d75f-4b52-bd25-d03eb630c1f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88e6e71667c74ed2ba0dde44267d6d33', 'request_id': 'req-8c277311-d75f-4b52-bd25-d03eb630c1f6'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:34.405150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8c277311-d75f-4b52-bd25-d03eb630c1f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88e6e71667c74ed2ba0dde44267d6d33', 'request_id': 'req-8c277311-d75f-4b52-bd25-d03eb630c1f6'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:34.414408 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8c277311-d75f-4b52-bd25-d03eb630c1f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88e6e71667c74ed2ba0dde44267d6d33', 'request_id': 'req-8c277311-d75f-4b52-bd25-d03eb630c1f6'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:34.425745 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8c277311-d75f-4b52-bd25-d03eb630c1f6 admin admin] The token cache is being invalidate because project 88e6e71667c74ed2ba0dde44267d6d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:05:34.426029 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8c277311-d75f-4b52-bd25-d03eb630c1f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:34.426657 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8c277311-d75f-4b52-bd25-d03eb630c1f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:34.428181 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1390/2776] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:05:34 2022] DELETE /identity/v3/projects/88e6e71667c74ed2ba0dde44267d6d33 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:34.432438 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321254dd-df08-4dac-b321-a70dc0ba32b5 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:34.434041 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-321254dd-df08-4dac-b321-a70dc0ba32b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:34.448067 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321254dd-df08-4dac-b321-a70dc0ba32b5 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:34.513966 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891d16f-67fd-4d75-84f9-d8354444cbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:34.515194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891d16f-67fd-4d75-84f9-d8354444cbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:34.515491 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891d16f-67fd-4d75-84f9-d8354444cbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:34.515769 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891d16f-67fd-4d75-84f9-d8354444cbef admin admin] PATH_INFO: `/v3/users/a39a641d3bd0451196288a30496f17c2` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:34.516978 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891d16f-67fd-4d75-84f9-d8354444cbef admin admin] RBAC: Authorizing `identity:delete_user(user_id=a39a641d3bd0451196288a30496f17c2)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:34.519006 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891d16f-67fd-4d75-84f9-d8354444cbef admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:34.569556 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-1891d16f-67fd-4d75-84f9-d8354444cbef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a39a641d3bd0451196288a30496f17c2'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:34.581994 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-1891d16f-67fd-4d75-84f9-d8354444cbef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a39a641d3bd0451196288a30496f17c2'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:34.596384 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-1891d16f-67fd-4d75-84f9-d8354444cbef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a39a641d3bd0451196288a30496f17c2'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:34.604907 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-1891d16f-67fd-4d75-84f9-d8354444cbef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a39a641d3bd0451196288a30496f17c2'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:34.605580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-1891d16f-67fd-4d75-84f9-d8354444cbef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a39a641d3bd0451196288a30496f17c2'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:34.612107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1387/2777] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:05:34 2022] DELETE /identity/v3/users/a39a641d3bd0451196288a30496f17c2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:34.813466 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c277311-d75f-4b52-bd25-d03eb630c1f6 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:34.815069 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8c277311-d75f-4b52-bd25-d03eb630c1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:34.830390 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c277311-d75f-4b52-bd25-d03eb630c1f6 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:34.897011 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f213ba-9797-45e8-ab5b-938e10225610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:34.897702 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f213ba-9797-45e8-ab5b-938e10225610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:34.897990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f213ba-9797-45e8-ab5b-938e10225610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:34.898262 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f213ba-9797-45e8-ab5b-938e10225610 admin admin] PATH_INFO: `/v3/projects/29a975662369439eadc734bb2dc7e292` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:34.899427 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f213ba-9797-45e8-ab5b-938e10225610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29a975662369439eadc734bb2dc7e292)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:34.901368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f213ba-9797-45e8-ab5b-938e10225610 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:34.924053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:34.950643 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-11f213ba-9797-45e8-ab5b-938e10225610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29a975662369439eadc734bb2dc7e292', 'request_id': 'req-11f213ba-9797-45e8-ab5b-938e10225610'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:34.957641 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-11f213ba-9797-45e8-ab5b-938e10225610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29a975662369439eadc734bb2dc7e292', 'request_id': 'req-11f213ba-9797-45e8-ab5b-938e10225610'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:34.966424 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-11f213ba-9797-45e8-ab5b-938e10225610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29a975662369439eadc734bb2dc7e292', 'request_id': 'req-11f213ba-9797-45e8-ab5b-938e10225610'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:34.977613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-11f213ba-9797-45e8-ab5b-938e10225610 admin admin] The token cache is being invalidate because project 29a975662369439eadc734bb2dc7e292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:05:34.977897 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-11f213ba-9797-45e8-ab5b-938e10225610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:34.978516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-11f213ba-9797-45e8-ab5b-938e10225610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:34.980020 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1391/2778] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:05:34 2022] DELETE /identity/v3/projects/29a975662369439eadc734bb2dc7e292 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:34.985722 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7a8d7-2b30-463d-970f-230f73a3b0ae None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:34.986204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7a8d7-2b30-463d-970f-230f73a3b0ae None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:34.986320 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7a8d7-2b30-463d-970f-230f73a3b0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:35.006525 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-64b7a8d7-2b30-463d-970f-230f73a3b0ae None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:35.007717 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-64b7a8d7-2b30-463d-970f-230f73a3b0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:35.051629 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:35.072035 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1388/2779] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:35.085095 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47db670-2166-4f5e-ae59-388496b17eff None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:35.085292 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47db670-2166-4f5e-ae59-388496b17eff None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:35.085675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47db670-2166-4f5e-ae59-388496b17eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:35.110770 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c47db670-2166-4f5e-ae59-388496b17eff None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:35.112004 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c47db670-2166-4f5e-ae59-388496b17eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:35.121117 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1392/2780] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:35.125907 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7a8d7-2b30-463d-970f-230f73a3b0ae None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:35.135873 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7a8d7-2b30-463d-970f-230f73a3b0ae None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:35.142875 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4d4c9-01b4-4595-943a-4ba3723090d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:35.143482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4d4c9-01b4-4595-943a-4ba3723090d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:35.143762 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4d4c9-01b4-4595-943a-4ba3723090d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:35.144119 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4d4c9-01b4-4595-943a-4ba3723090d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:35.145251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4d4c9-01b4-4595-943a-4ba3723090d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:05:35.145682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4d4c9-01b4-4595-943a-4ba3723090d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:35.147990 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4d4c9-01b4-4595-943a-4ba3723090d4 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:35.167002 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1389/2781] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 18:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:05:35.173121 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47db670-2166-4f5e-ae59-388496b17eff None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:35.183444 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47db670-2166-4f5e-ae59-388496b17eff None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:35.189519 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ead833-f2c5-4c69-9040-8f6dfd3ad889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:35.190140 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ead833-f2c5-4c69-9040-8f6dfd3ad889 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:35.190421 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ead833-f2c5-4c69-9040-8f6dfd3ad889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:35.190695 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ead833-f2c5-4c69-9040-8f6dfd3ad889 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:35.191362 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ead833-f2c5-4c69-9040-8f6dfd3ad889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:35.193345 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ead833-f2c5-4c69-9040-8f6dfd3ad889 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:35.227537 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1393/2782] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:35 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:35.233906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4d4c9-01b4-4595-943a-4ba3723090d4 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:35.243951 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4d4c9-01b4-4595-943a-4ba3723090d4 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:35.301808 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca030720-e6c0-4b81-bc5a-c98f81024e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:35.302454 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca030720-e6c0-4b81-bc5a-c98f81024e46 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:35.302730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca030720-e6c0-4b81-bc5a-c98f81024e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:35.303033 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca030720-e6c0-4b81-bc5a-c98f81024e46 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:35.303728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca030720-e6c0-4b81-bc5a-c98f81024e46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:35.305749 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca030720-e6c0-4b81-bc5a-c98f81024e46 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:35.334677 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1390/2783] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:35 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:35.339041 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ead833-f2c5-4c69-9040-8f6dfd3ad889 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:35.349919 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ead833-f2c5-4c69-9040-8f6dfd3ad889 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:35.355957 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a38a0-74cf-44e8-93be-b0c064e97473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:35.356573 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a38a0-74cf-44e8-93be-b0c064e97473 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:35.356843 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a38a0-74cf-44e8-93be-b0c064e97473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:35.357137 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a38a0-74cf-44e8-93be-b0c064e97473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:35.357829 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a38a0-74cf-44e8-93be-b0c064e97473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:35.359795 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a38a0-74cf-44e8-93be-b0c064e97473 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:35.371159 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1394/2784] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:35.375142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca030720-e6c0-4b81-bc5a-c98f81024e46 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:35.387334 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca030720-e6c0-4b81-bc5a-c98f81024e46 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:35.392597 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5039e-0c63-4898-bb15-4f52013a07a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:35.393266 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5039e-0c63-4898-bb15-4f52013a07a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:35.393546 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5039e-0c63-4898-bb15-4f52013a07a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:35.393822 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5039e-0c63-4898-bb15-4f52013a07a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:35.394519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5039e-0c63-4898-bb15-4f52013a07a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:35.396110 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5039e-0c63-4898-bb15-4f52013a07a4 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:35.406813 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1391/2785] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:35.411269 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a38a0-74cf-44e8-93be-b0c064e97473 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:35.424772 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a38a0-74cf-44e8-93be-b0c064e97473 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:35.430883 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34607fe-43b4-40ef-90ba-3408b3e099c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:35.431954 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34607fe-43b4-40ef-90ba-3408b3e099c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:35.432439 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34607fe-43b4-40ef-90ba-3408b3e099c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:35.432941 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34607fe-43b4-40ef-90ba-3408b3e099c6 admin admin] PATH_INFO: `/v3/projects/56dd4c1ea97f42f3914323674e16121e/users/590bda1c94e24a2697da1fcb980bce74/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:35.456441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34607fe-43b4-40ef-90ba-3408b3e099c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56dd4c1ea97f42f3914323674e16121e, user_id=590bda1c94e24a2697da1fcb980bce74, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:35.459475 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34607fe-43b4-40ef-90ba-3408b3e099c6 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:35.477519 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1395/2786] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:35 2022] PUT /identity/v3/projects/56dd4c1ea97f42f3914323674e16121e/users/590bda1c94e24a2697da1fcb980bce74/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:35.490788 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b91d8-632d-46c4-b0e2-c9be63d6c0ed None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:35.491243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b91d8-632d-46c4-b0e2-c9be63d6c0ed None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:35.491586 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b91d8-632d-46c4-b0e2-c9be63d6c0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:35.522498 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-944b91d8-632d-46c4-b0e2-c9be63d6c0ed None None] MFA Rules not processed for user `590bda1c94e24a2697da1fcb980bce74`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:35.523709 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-944b91d8-632d-46c4-b0e2-c9be63d6c0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:35.595284 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1392/2787] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:35 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:35.599968 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34607fe-43b4-40ef-90ba-3408b3e099c6 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:35.666293 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34607fe-43b4-40ef-90ba-3408b3e099c6 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:35.671737 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1dc5af-5b43-481f-81bf-3a1feb4e4d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:35.672366 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1dc5af-5b43-481f-81bf-3a1feb4e4d5a admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:35.672644 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1dc5af-5b43-481f-81bf-3a1feb4e4d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:35.672917 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1dc5af-5b43-481f-81bf-3a1feb4e4d5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:35.673613 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1dc5af-5b43-481f-81bf-3a1feb4e4d5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:35.675521 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1dc5af-5b43-481f-81bf-3a1feb4e4d5a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:35.704367 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1396/2788] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:35 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:35.708522 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b91d8-632d-46c4-b0e2-c9be63d6c0ed None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:35.720234 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b91d8-632d-46c4-b0e2-c9be63d6c0ed None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:35.760394 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:35.788085 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ff2f8-3015-417b-9a58-ba10e90f3e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:35.788703 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ff2f8-3015-417b-9a58-ba10e90f3e73 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:35.788983 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ff2f8-3015-417b-9a58-ba10e90f3e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:35.789295 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ff2f8-3015-417b-9a58-ba10e90f3e73 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:35.789979 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ff2f8-3015-417b-9a58-ba10e90f3e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:35.791924 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ff2f8-3015-417b-9a58-ba10e90f3e73 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:35.816345 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1393/2789] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:35 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:35.822573 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1dc5af-5b43-481f-81bf-3a1feb4e4d5a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:35.839193 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1dc5af-5b43-481f-81bf-3a1feb4e4d5a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:35.847317 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95d1fb-86fc-45a4-b18a-0410b42aa529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:35.848786 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95d1fb-86fc-45a4-b18a-0410b42aa529 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:35.848786 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95d1fb-86fc-45a4-b18a-0410b42aa529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:35.849032 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95d1fb-86fc-45a4-b18a-0410b42aa529 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:35.849980 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95d1fb-86fc-45a4-b18a-0410b42aa529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:35.852504 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95d1fb-86fc-45a4-b18a-0410b42aa529 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:35.866957 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1397/2790] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:35.873343 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ff2f8-3015-417b-9a58-ba10e90f3e73 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:35.885563 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ff2f8-3015-417b-9a58-ba10e90f3e73 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:35.892480 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064e0f9-4f11-463c-b0e5-9e57f9f744dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:35.893212 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064e0f9-4f11-463c-b0e5-9e57f9f744dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:35.893494 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064e0f9-4f11-463c-b0e5-9e57f9f744dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:35.893780 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064e0f9-4f11-463c-b0e5-9e57f9f744dd admin admin] PATH_INFO: `/v3/projects/8709274c1878486cb69a5731d621ff92/users/fb89a78bb6894e54a2ddbffb9eabe66d/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:35.909930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064e0f9-4f11-463c-b0e5-9e57f9f744dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8709274c1878486cb69a5731d621ff92, user_id=fb89a78bb6894e54a2ddbffb9eabe66d, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:35.912570 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064e0f9-4f11-463c-b0e5-9e57f9f744dd admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:35.928424 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1394/2791] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:35 2022] PUT /identity/v3/projects/8709274c1878486cb69a5731d621ff92/users/fb89a78bb6894e54a2ddbffb9eabe66d/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:35.932556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95d1fb-86fc-45a4-b18a-0410b42aa529 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:35.943320 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95d1fb-86fc-45a4-b18a-0410b42aa529 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:35.960639 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:36.005455 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede22d92-ae94-43c6-8ef0-bff0c8cc38a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:36.006072 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede22d92-ae94-43c6-8ef0-bff0c8cc38a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:36.006346 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede22d92-ae94-43c6-8ef0-bff0c8cc38a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:36.006611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede22d92-ae94-43c6-8ef0-bff0c8cc38a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:36.007285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede22d92-ae94-43c6-8ef0-bff0c8cc38a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:36.008880 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede22d92-ae94-43c6-8ef0-bff0c8cc38a3 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:36.018994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1398/2792] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:36.023308 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064e0f9-4f11-463c-b0e5-9e57f9f744dd admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:36.034926 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064e0f9-4f11-463c-b0e5-9e57f9f744dd admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:36.040579 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebfec2-02d4-4da4-a6d1-e5ee1f5457a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:36.041274 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebfec2-02d4-4da4-a6d1-e5ee1f5457a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:36.041549 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebfec2-02d4-4da4-a6d1-e5ee1f5457a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:36.041821 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebfec2-02d4-4da4-a6d1-e5ee1f5457a3 admin admin] PATH_INFO: `/v3/projects/8709274c1878486cb69a5731d621ff92/users/fb89a78bb6894e54a2ddbffb9eabe66d/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:36.043840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebfec2-02d4-4da4-a6d1-e5ee1f5457a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8709274c1878486cb69a5731d621ff92, user_id=fb89a78bb6894e54a2ddbffb9eabe66d, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:36.046551 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebfec2-02d4-4da4-a6d1-e5ee1f5457a3 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:36.057178 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1395/2793] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:36 2022] PUT /identity/v3/projects/8709274c1878486cb69a5731d621ff92/users/fb89a78bb6894e54a2ddbffb9eabe66d/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:36.126325 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186b659-495f-4c43-93b0-e995d5ff7162 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:36.126725 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186b659-495f-4c43-93b0-e995d5ff7162 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:36.127193 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186b659-495f-4c43-93b0-e995d5ff7162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:36.170363 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-4186b659-495f-4c43-93b0-e995d5ff7162 None None] MFA Rules not processed for user `fb89a78bb6894e54a2ddbffb9eabe66d`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:36.171969 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4186b659-495f-4c43-93b0-e995d5ff7162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:36.245942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1399/2794] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:36 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:36.258198 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebfec2-02d4-4da4-a6d1-e5ee1f5457a3 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:36.260216 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f5ebfec2-02d4-4da4-a6d1-e5ee1f5457a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:36.343554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebfec2-02d4-4da4-a6d1-e5ee1f5457a3 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:36.348628 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99091192-bc5e-4ddf-a780-ef253ed0b9b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:36.349296 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99091192-bc5e-4ddf-a780-ef253ed0b9b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:36.349574 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99091192-bc5e-4ddf-a780-ef253ed0b9b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:36.349845 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99091192-bc5e-4ddf-a780-ef253ed0b9b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:36.360550 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99091192-bc5e-4ddf-a780-ef253ed0b9b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:36.362070 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99091192-bc5e-4ddf-a780-ef253ed0b9b8 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:36.371466 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1396/2795] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:36 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:36.840189 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186b659-495f-4c43-93b0-e995d5ff7162 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:36.908616 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186b659-495f-4c43-93b0-e995d5ff7162 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:36.913597 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790a68e-a9f1-4a1f-b024-0f926808e3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:36.914218 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790a68e-a9f1-4a1f-b024-0f926808e3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:36.914520 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790a68e-a9f1-4a1f-b024-0f926808e3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:36.914804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790a68e-a9f1-4a1f-b024-0f926808e3a7 admin admin] PATH_INFO: `/v3/users/590bda1c94e24a2697da1fcb980bce74` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:36.916000 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790a68e-a9f1-4a1f-b024-0f926808e3a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=590bda1c94e24a2697da1fcb980bce74)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:36.918033 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790a68e-a9f1-4a1f-b024-0f926808e3a7 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:36.976862 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:36.981623 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b790a68e-a9f1-4a1f-b024-0f926808e3a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '590bda1c94e24a2697da1fcb980bce74'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:36.982804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b790a68e-a9f1-4a1f-b024-0f926808e3a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '590bda1c94e24a2697da1fcb980bce74'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:36.991556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b790a68e-a9f1-4a1f-b024-0f926808e3a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '590bda1c94e24a2697da1fcb980bce74'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:37.004168 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b790a68e-a9f1-4a1f-b024-0f926808e3a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '590bda1c94e24a2697da1fcb980bce74'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:37.004852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b790a68e-a9f1-4a1f-b024-0f926808e3a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '590bda1c94e24a2697da1fcb980bce74'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:37.020912 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1400/2796] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:05:36 2022] DELETE /identity/v3/users/590bda1c94e24a2697da1fcb980bce74 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:37.026178 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76df34-1968-4748-aa8b-f9261f1d4cab None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:37.027128 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76df34-1968-4748-aa8b-f9261f1d4cab None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:37.027441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76df34-1968-4748-aa8b-f9261f1d4cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:37.048144 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-ac76df34-1968-4748-aa8b-f9261f1d4cab None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:37.049392 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ac76df34-1968-4748-aa8b-f9261f1d4cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:37.111254 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1397/2797] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:37.123705 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790a68e-a9f1-4a1f-b024-0f926808e3a7 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:37.125864 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b790a68e-a9f1-4a1f-b024-0f926808e3a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:37.194943 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790a68e-a9f1-4a1f-b024-0f926808e3a7 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:37.199084 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2760b37-07c2-4402-823c-d034649fd3ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:37.199706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2760b37-07c2-4402-823c-d034649fd3ea service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:37.199989 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2760b37-07c2-4402-823c-d034649fd3ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:37.200268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2760b37-07c2-4402-823c-d034649fd3ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:37.210706 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2760b37-07c2-4402-823c-d034649fd3ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:37.212150 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2760b37-07c2-4402-823c-d034649fd3ea service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:37.222647 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1401/2798] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:37.515444 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76df34-1968-4748-aa8b-f9261f1d4cab None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:37.517232 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ac76df34-1968-4748-aa8b-f9261f1d4cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:37.534719 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76df34-1968-4748-aa8b-f9261f1d4cab None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:37.540645 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e41c3f-ea7c-4f7f-8b23-ff88cfd31d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:37.541428 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e41c3f-ea7c-4f7f-8b23-ff88cfd31d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:37.541597 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e41c3f-ea7c-4f7f-8b23-ff88cfd31d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:37.541872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e41c3f-ea7c-4f7f-8b23-ff88cfd31d99 admin admin] PATH_INFO: `/v3/projects/56dd4c1ea97f42f3914323674e16121e` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:37.543149 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e41c3f-ea7c-4f7f-8b23-ff88cfd31d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56dd4c1ea97f42f3914323674e16121e)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:37.545125 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e41c3f-ea7c-4f7f-8b23-ff88cfd31d99 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:37.556229 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:37.597622 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-01e41c3f-ea7c-4f7f-8b23-ff88cfd31d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56dd4c1ea97f42f3914323674e16121e', 'request_id': 'req-01e41c3f-ea7c-4f7f-8b23-ff88cfd31d99'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:37.607082 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-01e41c3f-ea7c-4f7f-8b23-ff88cfd31d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56dd4c1ea97f42f3914323674e16121e', 'request_id': 'req-01e41c3f-ea7c-4f7f-8b23-ff88cfd31d99'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:37.614704 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-01e41c3f-ea7c-4f7f-8b23-ff88cfd31d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56dd4c1ea97f42f3914323674e16121e', 'request_id': 'req-01e41c3f-ea7c-4f7f-8b23-ff88cfd31d99'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:37.626801 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-01e41c3f-ea7c-4f7f-8b23-ff88cfd31d99 admin admin] The token cache is being invalidate because project 56dd4c1ea97f42f3914323674e16121e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:05:37.627080 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-01e41c3f-ea7c-4f7f-8b23-ff88cfd31d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:37.627860 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-01e41c3f-ea7c-4f7f-8b23-ff88cfd31d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:37.629450 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1398/2799] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:05:37 2022] DELETE /identity/v3/projects/56dd4c1ea97f42f3914323674e16121e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:37.634737 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2760b37-07c2-4402-823c-d034649fd3ea service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:37.645231 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2760b37-07c2-4402-823c-d034649fd3ea service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:37.703681 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9a931-908e-428b-ac0f-f70c18399b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:37.704377 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9a931-908e-428b-ac0f-f70c18399b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:37.704589 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9a931-908e-428b-ac0f-f70c18399b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:37.704861 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9a931-908e-428b-ac0f-f70c18399b76 admin admin] PATH_INFO: `/v3/users/fb89a78bb6894e54a2ddbffb9eabe66d` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:37.706053 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9a931-908e-428b-ac0f-f70c18399b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb89a78bb6894e54a2ddbffb9eabe66d)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:37.707990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9a931-908e-428b-ac0f-f70c18399b76 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:37.757707 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d2a9a931-908e-428b-ac0f-f70c18399b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb89a78bb6894e54a2ddbffb9eabe66d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:37.758353 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d2a9a931-908e-428b-ac0f-f70c18399b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb89a78bb6894e54a2ddbffb9eabe66d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:37.765312 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d2a9a931-908e-428b-ac0f-f70c18399b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb89a78bb6894e54a2ddbffb9eabe66d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:37.772066 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:37.778055 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d2a9a931-908e-428b-ac0f-f70c18399b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb89a78bb6894e54a2ddbffb9eabe66d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:37.779042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d2a9a931-908e-428b-ac0f-f70c18399b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb89a78bb6894e54a2ddbffb9eabe66d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:37.795328 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1402/2800] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:05:37 2022] DELETE /identity/v3/users/fb89a78bb6894e54a2ddbffb9eabe66d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:05:38.078499 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e41c3f-ea7c-4f7f-8b23-ff88cfd31d99 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:38.080030 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-01e41c3f-ea7c-4f7f-8b23-ff88cfd31d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:38.096225 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e41c3f-ea7c-4f7f-8b23-ff88cfd31d99 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:38.156638 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced0c99-72cf-4b31-a0b1-b677d4b8f9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:38.157328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced0c99-72cf-4b31-a0b1-b677d4b8f9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:38.157606 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced0c99-72cf-4b31-a0b1-b677d4b8f9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:38.157876 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced0c99-72cf-4b31-a0b1-b677d4b8f9eb admin admin] PATH_INFO: `/v3/projects/8709274c1878486cb69a5731d621ff92` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:38.159178 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced0c99-72cf-4b31-a0b1-b677d4b8f9eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8709274c1878486cb69a5731d621ff92)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:38.161171 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced0c99-72cf-4b31-a0b1-b677d4b8f9eb admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:38.213689 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2ced0c99-72cf-4b31-a0b1-b677d4b8f9eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8709274c1878486cb69a5731d621ff92', 'request_id': 'req-2ced0c99-72cf-4b31-a0b1-b677d4b8f9eb'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:38.223573 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2ced0c99-72cf-4b31-a0b1-b677d4b8f9eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8709274c1878486cb69a5731d621ff92', 'request_id': 'req-2ced0c99-72cf-4b31-a0b1-b677d4b8f9eb'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:38.230272 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2ced0c99-72cf-4b31-a0b1-b677d4b8f9eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8709274c1878486cb69a5731d621ff92', 'request_id': 'req-2ced0c99-72cf-4b31-a0b1-b677d4b8f9eb'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:38.241242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2ced0c99-72cf-4b31-a0b1-b677d4b8f9eb admin admin] The token cache is being invalidate because project 8709274c1878486cb69a5731d621ff92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:05:38.241652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2ced0c99-72cf-4b31-a0b1-b677d4b8f9eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:38.242448 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2ced0c99-72cf-4b31-a0b1-b677d4b8f9eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:38.244213 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1399/2801] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:05:38 2022] DELETE /identity/v3/projects/8709274c1878486cb69a5731d621ff92 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:38.249713 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df6b3b-3be1-4391-a419-931f5c278678 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:38.250223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df6b3b-3be1-4391-a419-931f5c278678 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:38.250333 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df6b3b-3be1-4391-a419-931f5c278678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:38.271885 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-26df6b3b-3be1-4391-a419-931f5c278678 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:38.273153 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-26df6b3b-3be1-4391-a419-931f5c278678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:38.337779 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1403/2802] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:38.346443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a33fc-db98-4076-80e3-9eb838d96489 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:38.346724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a33fc-db98-4076-80e3-9eb838d96489 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:38.347000 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a33fc-db98-4076-80e3-9eb838d96489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:38.367936 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-e94a33fc-db98-4076-80e3-9eb838d96489 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:38.369156 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-e94a33fc-db98-4076-80e3-9eb838d96489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:38.377164 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1400/2803] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:38.381671 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df6b3b-3be1-4391-a419-931f5c278678 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:38.391916 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df6b3b-3be1-4391-a419-931f5c278678 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:38.396793 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59861c-eadd-4e99-a408-e5f6f49684f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:38.397443 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59861c-eadd-4e99-a408-e5f6f49684f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:38.397718 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59861c-eadd-4e99-a408-e5f6f49684f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:38.398009 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59861c-eadd-4e99-a408-e5f6f49684f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:38.398693 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59861c-eadd-4e99-a408-e5f6f49684f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:05:38.398989 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59861c-eadd-4e99-a408-e5f6f49684f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:38.400592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59861c-eadd-4e99-a408-e5f6f49684f0 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:38.412514 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1404/2804] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 18:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:05:38.417285 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a33fc-db98-4076-80e3-9eb838d96489 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:38.426944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a33fc-db98-4076-80e3-9eb838d96489 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:38.431706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03f0ad-8c38-457e-9ad9-16401db7fc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:38.432316 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03f0ad-8c38-457e-9ad9-16401db7fc42 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:38.432587 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03f0ad-8c38-457e-9ad9-16401db7fc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:38.432844 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03f0ad-8c38-457e-9ad9-16401db7fc42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:38.433542 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03f0ad-8c38-457e-9ad9-16401db7fc42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:38.435449 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03f0ad-8c38-457e-9ad9-16401db7fc42 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:38.462964 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:38.473454 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1401/2805] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:38 2022] POST /identity/v3/projects => generated 363 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:38.477692 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59861c-eadd-4e99-a408-e5f6f49684f0 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:38.488956 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59861c-eadd-4e99-a408-e5f6f49684f0 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:38.558389 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45564a5-b4c4-401a-824f-fed1654247e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:38.559113 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45564a5-b4c4-401a-824f-fed1654247e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:38.559294 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45564a5-b4c4-401a-824f-fed1654247e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:38.559580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45564a5-b4c4-401a-824f-fed1654247e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:38.560264 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45564a5-b4c4-401a-824f-fed1654247e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:38.562371 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45564a5-b4c4-401a-824f-fed1654247e2 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:38.585797 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1405/2806] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:38 2022] POST /identity/v3/users => generated 282 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:05:38.590441 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03f0ad-8c38-457e-9ad9-16401db7fc42 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:38.602264 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03f0ad-8c38-457e-9ad9-16401db7fc42 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:38.609286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7cc164-17d6-4781-a2d9-ee8ab9b5fe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:38.609908 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cc164-17d6-4781-a2d9-ee8ab9b5fe5e admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:38.610184 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cc164-17d6-4781-a2d9-ee8ab9b5fe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:38.610451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cc164-17d6-4781-a2d9-ee8ab9b5fe5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:38.611152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7cc164-17d6-4781-a2d9-ee8ab9b5fe5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:38.612760 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7cc164-17d6-4781-a2d9-ee8ab9b5fe5e admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:38.623511 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1402/2807] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:38.627884 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45564a5-b4c4-401a-824f-fed1654247e2 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:38.638660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45564a5-b4c4-401a-824f-fed1654247e2 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:38.646120 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbfdcc-66a0-41dd-b41b-4243b37001ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:38.646746 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbfdcc-66a0-41dd-b41b-4243b37001ee admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:38.647025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbfdcc-66a0-41dd-b41b-4243b37001ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:38.647301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbfdcc-66a0-41dd-b41b-4243b37001ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:38.647997 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbfdcc-66a0-41dd-b41b-4243b37001ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:38.649677 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbfdcc-66a0-41dd-b41b-4243b37001ee admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:38.661273 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1406/2808] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:38.665653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7cc164-17d6-4781-a2d9-ee8ab9b5fe5e admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:38.676221 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7cc164-17d6-4781-a2d9-ee8ab9b5fe5e admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:38.681363 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebc102-7a5e-4c7e-b3c0-54cbf7ec7114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:38.682017 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebc102-7a5e-4c7e-b3c0-54cbf7ec7114 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:38.682294 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebc102-7a5e-4c7e-b3c0-54cbf7ec7114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:38.682565 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebc102-7a5e-4c7e-b3c0-54cbf7ec7114 admin admin] PATH_INFO: `/v3/projects/5b473e2f5fbf4e5c85896d25f87e78b4/users/fe9c94a6e432480cb11b31d5c4ce4a65/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:38.697910 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebc102-7a5e-4c7e-b3c0-54cbf7ec7114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b473e2f5fbf4e5c85896d25f87e78b4, user_id=fe9c94a6e432480cb11b31d5c4ce4a65, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:38.700526 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebc102-7a5e-4c7e-b3c0-54cbf7ec7114 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:38.717233 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1403/2809] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:38 2022] PUT /identity/v3/projects/5b473e2f5fbf4e5c85896d25f87e78b4/users/fe9c94a6e432480cb11b31d5c4ce4a65/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:38.727705 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5a96f-5951-4cde-a2d7-c9d1593fe8b5 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:38.727909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5a96f-5951-4cde-a2d7-c9d1593fe8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:38.728196 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5a96f-5951-4cde-a2d7-c9d1593fe8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:38.757898 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-def5a96f-5951-4cde-a2d7-c9d1593fe8b5 None None] MFA Rules not processed for user `fe9c94a6e432480cb11b31d5c4ce4a65`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:38.759127 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-def5a96f-5951-4cde-a2d7-c9d1593fe8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:38.810068 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:38.839281 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1407/2810] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:38 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:38.844344 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebc102-7a5e-4c7e-b3c0-54cbf7ec7114 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:38.915624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebc102-7a5e-4c7e-b3c0-54cbf7ec7114 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:38.920840 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2762545-66dd-453d-97cf-d375829be5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:38.921529 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2762545-66dd-453d-97cf-d375829be5ae admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:38.921805 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2762545-66dd-453d-97cf-d375829be5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:38.922061 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2762545-66dd-453d-97cf-d375829be5ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:38.922724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2762545-66dd-453d-97cf-d375829be5ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:38.924643 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2762545-66dd-453d-97cf-d375829be5ae admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:38.955006 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1404/2811] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:38 2022] POST /identity/v3/projects => generated 363 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:38.959239 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5a96f-5951-4cde-a2d7-c9d1593fe8b5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:38.970617 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5a96f-5951-4cde-a2d7-c9d1593fe8b5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:39.033456 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621842a-e285-4b03-8a83-d44d2d26e79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:39.034095 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621842a-e285-4b03-8a83-d44d2d26e79f admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:39.034373 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621842a-e285-4b03-8a83-d44d2d26e79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:39.034643 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621842a-e285-4b03-8a83-d44d2d26e79f admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:39.035329 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621842a-e285-4b03-8a83-d44d2d26e79f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:39.037372 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621842a-e285-4b03-8a83-d44d2d26e79f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:39.059970 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1408/2812] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:38 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:39.064156 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2762545-66dd-453d-97cf-d375829be5ae admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:39.074591 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2762545-66dd-453d-97cf-d375829be5ae admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:39.079453 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06809a0c-ea29-4cce-af12-149dce4be286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:39.080075 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06809a0c-ea29-4cce-af12-149dce4be286 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:39.080326 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06809a0c-ea29-4cce-af12-149dce4be286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:39.080598 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06809a0c-ea29-4cce-af12-149dce4be286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:39.081337 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06809a0c-ea29-4cce-af12-149dce4be286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:39.082926 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06809a0c-ea29-4cce-af12-149dce4be286 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:39.093611 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1405/2813] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:39.098051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621842a-e285-4b03-8a83-d44d2d26e79f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:39.108305 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621842a-e285-4b03-8a83-d44d2d26e79f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:39.113687 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860236eb-3cbf-455a-9002-5e7168e0e84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:39.114343 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860236eb-3cbf-455a-9002-5e7168e0e84d admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:39.114618 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860236eb-3cbf-455a-9002-5e7168e0e84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:39.114890 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860236eb-3cbf-455a-9002-5e7168e0e84d admin admin] PATH_INFO: `/v3/projects/d64084285375418fa83e13d12ea26b41/users/1c3dae858c354884b0933f013fc127ee/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:39.131395 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860236eb-3cbf-455a-9002-5e7168e0e84d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d64084285375418fa83e13d12ea26b41, user_id=1c3dae858c354884b0933f013fc127ee, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:39.134309 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860236eb-3cbf-455a-9002-5e7168e0e84d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:39.150262 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1409/2814] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:39 2022] PUT /identity/v3/projects/d64084285375418fa83e13d12ea26b41/users/1c3dae858c354884b0933f013fc127ee/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:39.154962 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06809a0c-ea29-4cce-af12-149dce4be286 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:39.170628 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06809a0c-ea29-4cce-af12-149dce4be286 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:39.247530 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53feaf-97de-413d-b641-e63d721612a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:39.248462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53feaf-97de-413d-b641-e63d721612a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:39.248906 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53feaf-97de-413d-b641-e63d721612a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:39.249356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53feaf-97de-413d-b641-e63d721612a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:39.250602 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53feaf-97de-413d-b641-e63d721612a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:39.252798 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53feaf-97de-413d-b641-e63d721612a4 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:39.264546 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1406/2815] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:39.273294 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860236eb-3cbf-455a-9002-5e7168e0e84d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:39.285467 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860236eb-3cbf-455a-9002-5e7168e0e84d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:39.290589 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845c3b2-f951-49bb-b97a-1eee11e0e3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:39.291285 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845c3b2-f951-49bb-b97a-1eee11e0e3d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:39.291563 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845c3b2-f951-49bb-b97a-1eee11e0e3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:39.291839 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845c3b2-f951-49bb-b97a-1eee11e0e3d2 admin admin] PATH_INFO: `/v3/projects/d64084285375418fa83e13d12ea26b41/users/1c3dae858c354884b0933f013fc127ee/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:39.293882 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845c3b2-f951-49bb-b97a-1eee11e0e3d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d64084285375418fa83e13d12ea26b41, user_id=1c3dae858c354884b0933f013fc127ee, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:39.296588 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845c3b2-f951-49bb-b97a-1eee11e0e3d2 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:39.308384 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1410/2816] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:39 2022] PUT /identity/v3/projects/d64084285375418fa83e13d12ea26b41/users/1c3dae858c354884b0933f013fc127ee/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:39.318878 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047647e-1f3b-4782-8424-507d320b60b4 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:39.319171 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047647e-1f3b-4782-8424-507d320b60b4 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:39.319451 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047647e-1f3b-4782-8424-507d320b60b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:39.348471 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-8047647e-1f3b-4782-8424-507d320b60b4 None None] MFA Rules not processed for user `1c3dae858c354884b0933f013fc127ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:39.349729 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-8047647e-1f3b-4782-8424-507d320b60b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:39.374776 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:39.426262 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1407/2817] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:39 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:39.438491 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845c3b2-f951-49bb-b97a-1eee11e0e3d2 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:39.440440 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c845c3b2-f951-49bb-b97a-1eee11e0e3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:39.503152 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845c3b2-f951-49bb-b97a-1eee11e0e3d2 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:39.507376 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3f64a-bb92-4cd2-8021-1f5665865132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:39.507997 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3f64a-bb92-4cd2-8021-1f5665865132 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:39.508282 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3f64a-bb92-4cd2-8021-1f5665865132 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:39.508556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3f64a-bb92-4cd2-8021-1f5665865132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:39.518440 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3f64a-bb92-4cd2-8021-1f5665865132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:39.519945 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3f64a-bb92-4cd2-8021-1f5665865132 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:39.529810 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1411/2818] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:39 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:05:39.616418 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047647e-1f3b-4782-8424-507d320b60b4 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:39.627512 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047647e-1f3b-4782-8424-507d320b60b4 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:39.631545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3510f4-bb47-48fa-8a53-52765bd39381 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:39.632440 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3510f4-bb47-48fa-8a53-52765bd39381 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:39.632440 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3510f4-bb47-48fa-8a53-52765bd39381 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:39.633283 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3510f4-bb47-48fa-8a53-52765bd39381 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:39.697854 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3510f4-bb47-48fa-8a53-52765bd39381 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:39.700205 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3510f4-bb47-48fa-8a53-52765bd39381 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:39.711634 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1408/2819] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:39 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:42.529183 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3f64a-bb92-4cd2-8021-1f5665865132 service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:42.568931 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:42.601093 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3f64a-bb92-4cd2-8021-1f5665865132 service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:42.605984 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabf073-c194-4245-ad4e-d4a175986277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:42.606657 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabf073-c194-4245-ad4e-d4a175986277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:42.606938 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabf073-c194-4245-ad4e-d4a175986277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:42.607218 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabf073-c194-4245-ad4e-d4a175986277 admin admin] PATH_INFO: `/v3/users/fe9c94a6e432480cb11b31d5c4ce4a65` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:42.608774 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabf073-c194-4245-ad4e-d4a175986277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe9c94a6e432480cb11b31d5c4ce4a65)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:42.610780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabf073-c194-4245-ad4e-d4a175986277 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:42.664676 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5fabf073-c194-4245-ad4e-d4a175986277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe9c94a6e432480cb11b31d5c4ce4a65'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:42.665628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5fabf073-c194-4245-ad4e-d4a175986277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe9c94a6e432480cb11b31d5c4ce4a65'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:42.673516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5fabf073-c194-4245-ad4e-d4a175986277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe9c94a6e432480cb11b31d5c4ce4a65'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:42.687982 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5fabf073-c194-4245-ad4e-d4a175986277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe9c94a6e432480cb11b31d5c4ce4a65'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:42.688871 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5fabf073-c194-4245-ad4e-d4a175986277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe9c94a6e432480cb11b31d5c4ce4a65'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:42.705092 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1412/2820] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:05:42 2022] DELETE /identity/v3/users/fe9c94a6e432480cb11b31d5c4ce4a65 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:42.709866 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd39af1-2ebc-48c9-8b0f-5d306c122966 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:42.710416 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd39af1-2ebc-48c9-8b0f-5d306c122966 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:42.710518 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd39af1-2ebc-48c9-8b0f-5d306c122966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:42.730068 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-edd39af1-2ebc-48c9-8b0f-5d306c122966 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:42.731294 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-edd39af1-2ebc-48c9-8b0f-5d306c122966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:42.791940 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1409/2821] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:42.802266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabf073-c194-4245-ad4e-d4a175986277 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:42.803994 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5fabf073-c194-4245-ad4e-d4a175986277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:42.866126 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabf073-c194-4245-ad4e-d4a175986277 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:42.870543 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040e2d9-bbf7-43dd-9c64-e077f7d22f88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:42.871151 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040e2d9-bbf7-43dd-9c64-e077f7d22f88 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:42.871429 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040e2d9-bbf7-43dd-9c64-e077f7d22f88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:42.871697 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040e2d9-bbf7-43dd-9c64-e077f7d22f88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:42.882472 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040e2d9-bbf7-43dd-9c64-e077f7d22f88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:42.883916 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040e2d9-bbf7-43dd-9c64-e077f7d22f88 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:42.895405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1413/2822] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:43.183772 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd39af1-2ebc-48c9-8b0f-5d306c122966 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:43.185362 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-edd39af1-2ebc-48c9-8b0f-5d306c122966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:43.199255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd39af1-2ebc-48c9-8b0f-5d306c122966 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:43.204653 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02e2ab-2260-4f4c-8a51-2ce2aac6d3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:43.205361 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02e2ab-2260-4f4c-8a51-2ce2aac6d3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:43.205626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02e2ab-2260-4f4c-8a51-2ce2aac6d3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:43.205897 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02e2ab-2260-4f4c-8a51-2ce2aac6d3d1 admin admin] PATH_INFO: `/v3/projects/5b473e2f5fbf4e5c85896d25f87e78b4` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:43.207197 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02e2ab-2260-4f4c-8a51-2ce2aac6d3d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b473e2f5fbf4e5c85896d25f87e78b4)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:43.209107 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02e2ab-2260-4f4c-8a51-2ce2aac6d3d1 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:43.258375 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-1d02e2ab-2260-4f4c-8a51-2ce2aac6d3d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b473e2f5fbf4e5c85896d25f87e78b4', 'request_id': 'req-1d02e2ab-2260-4f4c-8a51-2ce2aac6d3d1'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:43.261928 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:43.267860 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-1d02e2ab-2260-4f4c-8a51-2ce2aac6d3d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b473e2f5fbf4e5c85896d25f87e78b4', 'request_id': 'req-1d02e2ab-2260-4f4c-8a51-2ce2aac6d3d1'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:43.274617 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-1d02e2ab-2260-4f4c-8a51-2ce2aac6d3d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b473e2f5fbf4e5c85896d25f87e78b4', 'request_id': 'req-1d02e2ab-2260-4f4c-8a51-2ce2aac6d3d1'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:43.285329 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-1d02e2ab-2260-4f4c-8a51-2ce2aac6d3d1 admin admin] The token cache is being invalidate because project 5b473e2f5fbf4e5c85896d25f87e78b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:05:43.285614 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-1d02e2ab-2260-4f4c-8a51-2ce2aac6d3d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:43.286247 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-1d02e2ab-2260-4f4c-8a51-2ce2aac6d3d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:43.287751 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1410/2823] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:05:43 2022] DELETE /identity/v3/projects/5b473e2f5fbf4e5c85896d25f87e78b4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:43.291846 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040e2d9-bbf7-43dd-9c64-e077f7d22f88 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:43.304391 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040e2d9-bbf7-43dd-9c64-e077f7d22f88 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:43.359237 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:43.367197 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d72821-2591-4504-985c-88849e7c15f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:43.367878 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d72821-2591-4504-985c-88849e7c15f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:43.368339 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d72821-2591-4504-985c-88849e7c15f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:43.369202 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d72821-2591-4504-985c-88849e7c15f9 admin admin] PATH_INFO: `/v3/users/1c3dae858c354884b0933f013fc127ee` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:43.370406 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d72821-2591-4504-985c-88849e7c15f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c3dae858c354884b0933f013fc127ee)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:43.372642 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d72821-2591-4504-985c-88849e7c15f9 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:43.432726 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-39d72821-2591-4504-985c-88849e7c15f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c3dae858c354884b0933f013fc127ee'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:43.433354 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-39d72821-2591-4504-985c-88849e7c15f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c3dae858c354884b0933f013fc127ee'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:43.440926 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-39d72821-2591-4504-985c-88849e7c15f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c3dae858c354884b0933f013fc127ee'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:43.452988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-39d72821-2591-4504-985c-88849e7c15f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c3dae858c354884b0933f013fc127ee'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:43.453895 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-39d72821-2591-4504-985c-88849e7c15f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c3dae858c354884b0933f013fc127ee'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:43.470892 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1414/2824] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:05:43 2022] DELETE /identity/v3/users/1c3dae858c354884b0933f013fc127ee => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:43.763413 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02e2ab-2260-4f4c-8a51-2ce2aac6d3d1 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:43.765162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-1d02e2ab-2260-4f4c-8a51-2ce2aac6d3d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:43.778227 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02e2ab-2260-4f4c-8a51-2ce2aac6d3d1 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:43.835437 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea91b7-c216-46df-9ba9-b586d0b387bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:43.836372 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea91b7-c216-46df-9ba9-b586d0b387bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:43.836655 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea91b7-c216-46df-9ba9-b586d0b387bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:43.836932 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea91b7-c216-46df-9ba9-b586d0b387bb admin admin] PATH_INFO: `/v3/projects/d64084285375418fa83e13d12ea26b41` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:43.838777 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea91b7-c216-46df-9ba9-b586d0b387bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d64084285375418fa83e13d12ea26b41)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:43.841074 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea91b7-c216-46df-9ba9-b586d0b387bb admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:43.894736 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f5ea91b7-c216-46df-9ba9-b586d0b387bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd64084285375418fa83e13d12ea26b41', 'request_id': 'req-f5ea91b7-c216-46df-9ba9-b586d0b387bb'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:43.903488 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f5ea91b7-c216-46df-9ba9-b586d0b387bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd64084285375418fa83e13d12ea26b41', 'request_id': 'req-f5ea91b7-c216-46df-9ba9-b586d0b387bb'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:43.910051 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f5ea91b7-c216-46df-9ba9-b586d0b387bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd64084285375418fa83e13d12ea26b41', 'request_id': 'req-f5ea91b7-c216-46df-9ba9-b586d0b387bb'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:43.920560 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f5ea91b7-c216-46df-9ba9-b586d0b387bb admin admin] The token cache is being invalidate because project d64084285375418fa83e13d12ea26b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:05:43.920897 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f5ea91b7-c216-46df-9ba9-b586d0b387bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:43.921587 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-f5ea91b7-c216-46df-9ba9-b586d0b387bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:43.923492 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1411/2825] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:05:43 2022] DELETE /identity/v3/projects/d64084285375418fa83e13d12ea26b41 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:43.929852 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a25e0-0ca3-44f0-a905-3bb5fec0717b None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:43.930383 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a25e0-0ca3-44f0-a905-3bb5fec0717b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:43.930383 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a25e0-0ca3-44f0-a905-3bb5fec0717b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:43.951479 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-5b0a25e0-0ca3-44f0-a905-3bb5fec0717b None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:43.952595 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5b0a25e0-0ca3-44f0-a905-3bb5fec0717b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:44.016754 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1415/2826] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:44.024571 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab922f61-f37b-4759-811e-27ac46206783 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:44.024861 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab922f61-f37b-4759-811e-27ac46206783 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:44.025170 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab922f61-f37b-4759-811e-27ac46206783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:44.046178 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-ab922f61-f37b-4759-811e-27ac46206783 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:44.047438 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ab922f61-f37b-4759-811e-27ac46206783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:44.056014 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1412/2827] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:44.060451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a25e0-0ca3-44f0-a905-3bb5fec0717b None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:44.072132 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a25e0-0ca3-44f0-a905-3bb5fec0717b None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:44.079954 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ba0f4-ce31-4cc6-ab51-99848af06d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:44.080574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ba0f4-ce31-4cc6-ab51-99848af06d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:44.080854 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ba0f4-ce31-4cc6-ab51-99848af06d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:44.081142 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ba0f4-ce31-4cc6-ab51-99848af06d18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:44.081830 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ba0f4-ce31-4cc6-ab51-99848af06d18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:05:44.082134 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ba0f4-ce31-4cc6-ab51-99848af06d18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:44.083738 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ba0f4-ce31-4cc6-ab51-99848af06d18 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:44.095849 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1416/2828] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 18:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:05:44.100420 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab922f61-f37b-4759-811e-27ac46206783 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:44.110996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab922f61-f37b-4759-811e-27ac46206783 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:44.116714 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bade8-4eb3-4a4b-8dfb-c4c3d67794eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:44.117364 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bade8-4eb3-4a4b-8dfb-c4c3d67794eb admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:44.117656 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bade8-4eb3-4a4b-8dfb-c4c3d67794eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:44.117930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bade8-4eb3-4a4b-8dfb-c4c3d67794eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:44.118598 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bade8-4eb3-4a4b-8dfb-c4c3d67794eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:44.120544 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bade8-4eb3-4a4b-8dfb-c4c3d67794eb admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:44.154085 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1413/2829] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:44 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:44.158955 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ba0f4-ce31-4cc6-ab51-99848af06d18 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:44.169478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ba0f4-ce31-4cc6-ab51-99848af06d18 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:44.232016 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa4616-f852-4f72-ada5-cd11c8519ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:44.232551 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa4616-f852-4f72-ada5-cd11c8519ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:44.232831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa4616-f852-4f72-ada5-cd11c8519ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:44.233087 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa4616-f852-4f72-ada5-cd11c8519ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:44.234141 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa4616-f852-4f72-ada5-cd11c8519ac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:44.236043 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa4616-f852-4f72-ada5-cd11c8519ac8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:44.245014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:44.258255 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1417/2830] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:44 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:44.262540 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bade8-4eb3-4a4b-8dfb-c4c3d67794eb admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:44.273354 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bade8-4eb3-4a4b-8dfb-c4c3d67794eb admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:44.278323 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50182f-d5bd-411b-a463-eb39d6edaf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:44.278948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50182f-d5bd-411b-a463-eb39d6edaf50 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:44.279228 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50182f-d5bd-411b-a463-eb39d6edaf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:44.279503 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50182f-d5bd-411b-a463-eb39d6edaf50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:44.280202 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50182f-d5bd-411b-a463-eb39d6edaf50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:44.281911 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50182f-d5bd-411b-a463-eb39d6edaf50 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:44.292130 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1414/2831] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:44.296277 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa4616-f852-4f72-ada5-cd11c8519ac8 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:44.307488 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa4616-f852-4f72-ada5-cd11c8519ac8 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:44.312804 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c64b2-16d5-435b-ab88-e86200c52e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:44.313458 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c64b2-16d5-435b-ab88-e86200c52e7b admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:44.313740 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c64b2-16d5-435b-ab88-e86200c52e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:44.314014 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c64b2-16d5-435b-ab88-e86200c52e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:44.314735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c64b2-16d5-435b-ab88-e86200c52e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:44.316424 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c64b2-16d5-435b-ab88-e86200c52e7b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:44.327422 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1418/2832] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:44.332853 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50182f-d5bd-411b-a463-eb39d6edaf50 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:44.348029 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50182f-d5bd-411b-a463-eb39d6edaf50 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:44.354162 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9c0c1-d5a4-4037-a7b6-f00ab610229f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:44.354836 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9c0c1-d5a4-4037-a7b6-f00ab610229f admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:44.355119 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9c0c1-d5a4-4037-a7b6-f00ab610229f admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:44.355393 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9c0c1-d5a4-4037-a7b6-f00ab610229f admin admin] PATH_INFO: `/v3/projects/53ab09db556746cc8f1393a497c540ab/users/fc563abf761d467faa11fc7c6ab71407/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:44.374066 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9c0c1-d5a4-4037-a7b6-f00ab610229f admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ab09db556746cc8f1393a497c540ab, user_id=fc563abf761d467faa11fc7c6ab71407, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:44.378263 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9c0c1-d5a4-4037-a7b6-f00ab610229f admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:44.396992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1415/2833] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:44 2022] PUT /identity/v3/projects/53ab09db556746cc8f1393a497c540ab/users/fc563abf761d467faa11fc7c6ab71407/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:44.408774 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db6924-c27c-4466-a99a-ab6b39692600 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:44.409084 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db6924-c27c-4466-a99a-ab6b39692600 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:44.409420 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db6924-c27c-4466-a99a-ab6b39692600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:44.441079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b0db6924-c27c-4466-a99a-ab6b39692600 None None] MFA Rules not processed for user `fc563abf761d467faa11fc7c6ab71407`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:44.442444 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b0db6924-c27c-4466-a99a-ab6b39692600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:44.512301 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1419/2834] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:44.516870 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9c0c1-d5a4-4037-a7b6-f00ab610229f admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:44.532683 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:44.587514 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9c0c1-d5a4-4037-a7b6-f00ab610229f admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:44.596287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12614558-aab9-445e-9fb6-f77f8d04f915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:44.597339 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12614558-aab9-445e-9fb6-f77f8d04f915 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:44.597733 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12614558-aab9-445e-9fb6-f77f8d04f915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:44.598012 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12614558-aab9-445e-9fb6-f77f8d04f915 admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:44.598722 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12614558-aab9-445e-9fb6-f77f8d04f915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:44.600617 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12614558-aab9-445e-9fb6-f77f8d04f915 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:44.632883 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1416/2835] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:44 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:05:44.638670 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db6924-c27c-4466-a99a-ab6b39692600 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:44.650884 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db6924-c27c-4466-a99a-ab6b39692600 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:44.713086 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdffde9-36e5-48c7-bbec-424c913e77a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:44.713736 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdffde9-36e5-48c7-bbec-424c913e77a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:44.714020 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdffde9-36e5-48c7-bbec-424c913e77a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:44.714300 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdffde9-36e5-48c7-bbec-424c913e77a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:44.714964 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdffde9-36e5-48c7-bbec-424c913e77a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:44.716901 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdffde9-36e5-48c7-bbec-424c913e77a0 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:44.742284 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1420/2836] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:44 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:44.746634 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12614558-aab9-445e-9fb6-f77f8d04f915 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:44.756993 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12614558-aab9-445e-9fb6-f77f8d04f915 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:44.762194 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870242de-ed7a-4a40-83b2-1b9d70afd33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:44.762921 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870242de-ed7a-4a40-83b2-1b9d70afd33e admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:44.763217 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870242de-ed7a-4a40-83b2-1b9d70afd33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:44.763486 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870242de-ed7a-4a40-83b2-1b9d70afd33e admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:44.764219 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870242de-ed7a-4a40-83b2-1b9d70afd33e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:44.766024 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870242de-ed7a-4a40-83b2-1b9d70afd33e admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:44.776850 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1417/2837] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:44.781222 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdffde9-36e5-48c7-bbec-424c913e77a0 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:44.792496 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdffde9-36e5-48c7-bbec-424c913e77a0 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:44.797884 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98886f16-af2c-4271-b497-a06b8f0dc3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:44.798535 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98886f16-af2c-4271-b497-a06b8f0dc3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:44.798841 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98886f16-af2c-4271-b497-a06b8f0dc3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:44.799089 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98886f16-af2c-4271-b497-a06b8f0dc3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:44.799791 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98886f16-af2c-4271-b497-a06b8f0dc3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:44.801463 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98886f16-af2c-4271-b497-a06b8f0dc3d3 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:44.812107 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1421/2838] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:44.816644 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870242de-ed7a-4a40-83b2-1b9d70afd33e admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:44.829919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870242de-ed7a-4a40-83b2-1b9d70afd33e admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:44.838544 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cb9ef-f860-49e9-8c64-8b7f21a90490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:44.839751 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cb9ef-f860-49e9-8c64-8b7f21a90490 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:44.840251 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cb9ef-f860-49e9-8c64-8b7f21a90490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:44.840748 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cb9ef-f860-49e9-8c64-8b7f21a90490 admin admin] PATH_INFO: `/v3/projects/2b07e651e1f44df584cb53a40ae133d0/users/f1d56f5d3a10483abd6d179b541e276f/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:44.864896 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4cb9ef-f860-49e9-8c64-8b7f21a90490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b07e651e1f44df584cb53a40ae133d0, user_id=f1d56f5d3a10483abd6d179b541e276f, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:44.868104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4cb9ef-f860-49e9-8c64-8b7f21a90490 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:44.886357 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1418/2839] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:44 2022] PUT /identity/v3/projects/2b07e651e1f44df584cb53a40ae133d0/users/f1d56f5d3a10483abd6d179b541e276f/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:44.897641 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749787b-a71a-4186-990d-f519c6a3ebc4 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:44.898122 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749787b-a71a-4186-990d-f519c6a3ebc4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:44.898441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749787b-a71a-4186-990d-f519c6a3ebc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:44.933506 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f749787b-a71a-4186-990d-f519c6a3ebc4 None None] MFA Rules not processed for user `f1d56f5d3a10483abd6d179b541e276f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:44.934761 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f749787b-a71a-4186-990d-f519c6a3ebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:44.977739 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:45.007008 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1422/2840] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:05:45.011994 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cb9ef-f860-49e9-8c64-8b7f21a90490 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:45.076398 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cb9ef-f860-49e9-8c64-8b7f21a90490 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:45.081874 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35138452-c1d1-454f-bf4c-24bf59fa411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:45.082501 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35138452-c1d1-454f-bf4c-24bf59fa411e admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:45.082814 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35138452-c1d1-454f-bf4c-24bf59fa411e admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:45.083059 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35138452-c1d1-454f-bf4c-24bf59fa411e admin admin] PATH_INFO: `/v3/projects` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:45.083862 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35138452-c1d1-454f-bf4c-24bf59fa411e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:45.085824 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35138452-c1d1-454f-bf4c-24bf59fa411e admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:45.120702 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1419/2841] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:45 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:45.125556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749787b-a71a-4186-990d-f519c6a3ebc4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:45.138021 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749787b-a71a-4186-990d-f519c6a3ebc4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:45.196245 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d1f7f-3572-48fa-b32b-d12d70517f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:45.196872 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d1f7f-3572-48fa-b32b-d12d70517f81 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:45.197182 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d1f7f-3572-48fa-b32b-d12d70517f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:45.197455 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d1f7f-3572-48fa-b32b-d12d70517f81 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:45.198124 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d1f7f-3572-48fa-b32b-d12d70517f81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:45.200047 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d1f7f-3572-48fa-b32b-d12d70517f81 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:45.227495 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1423/2842] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:45 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:05:45.231728 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35138452-c1d1-454f-bf4c-24bf59fa411e admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:45.242960 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35138452-c1d1-454f-bf4c-24bf59fa411e admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:45.247950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3b832-65b3-43cc-9a31-821df4d1a249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:45.248562 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3b832-65b3-43cc-9a31-821df4d1a249 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:45.248839 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3b832-65b3-43cc-9a31-821df4d1a249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:45.249104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3b832-65b3-43cc-9a31-821df4d1a249 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:45.249817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3b832-65b3-43cc-9a31-821df4d1a249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:45.251431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3b832-65b3-43cc-9a31-821df4d1a249 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:45.262220 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1420/2843] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:45.266638 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d1f7f-3572-48fa-b32b-d12d70517f81 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:45.279575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d1f7f-3572-48fa-b32b-d12d70517f81 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:45.287792 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f73dc-c393-484a-985d-1b4faf50d208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:45.288505 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f73dc-c393-484a-985d-1b4faf50d208 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:45.288789 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f73dc-c393-484a-985d-1b4faf50d208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:45.289090 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f73dc-c393-484a-985d-1b4faf50d208 admin admin] PATH_INFO: `/v3/projects/b5540df81f384e49a74414f0cf81630e/users/5fb474ee425445f7aece82386cb96a94/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:45.305639 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f73dc-c393-484a-985d-1b4faf50d208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5540df81f384e49a74414f0cf81630e, user_id=5fb474ee425445f7aece82386cb96a94, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:45.308314 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f73dc-c393-484a-985d-1b4faf50d208 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:45.323932 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1424/2844] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:45 2022] PUT /identity/v3/projects/b5540df81f384e49a74414f0cf81630e/users/5fb474ee425445f7aece82386cb96a94/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:45.330338 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3b832-65b3-43cc-9a31-821df4d1a249 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:45.345930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3b832-65b3-43cc-9a31-821df4d1a249 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:45.379914 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:45.407811 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6b114-317d-45c5-ba6d-0d224a86cf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:45.408438 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6b114-317d-45c5-ba6d-0d224a86cf70 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:45.408717 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6b114-317d-45c5-ba6d-0d224a86cf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:45.409153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6b114-317d-45c5-ba6d-0d224a86cf70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:45.409716 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6b114-317d-45c5-ba6d-0d224a86cf70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:45.411356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6b114-317d-45c5-ba6d-0d224a86cf70 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:45.421405 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1421/2845] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:45.425983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f73dc-c393-484a-985d-1b4faf50d208 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:45.436976 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f73dc-c393-484a-985d-1b4faf50d208 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:45.441942 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7208ed-62ab-43f8-aded-31fb8b8e7afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:45.442645 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7208ed-62ab-43f8-aded-31fb8b8e7afb admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:45.442990 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7208ed-62ab-43f8-aded-31fb8b8e7afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:45.443437 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7208ed-62ab-43f8-aded-31fb8b8e7afb admin admin] PATH_INFO: `/v3/projects/b5540df81f384e49a74414f0cf81630e/users/5fb474ee425445f7aece82386cb96a94/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:45.446006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7208ed-62ab-43f8-aded-31fb8b8e7afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5540df81f384e49a74414f0cf81630e, user_id=5fb474ee425445f7aece82386cb96a94, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:45.448667 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7208ed-62ab-43f8-aded-31fb8b8e7afb admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:45.459010 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1425/2846] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:45 2022] PUT /identity/v3/projects/b5540df81f384e49a74414f0cf81630e/users/5fb474ee425445f7aece82386cb96a94/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:45.469538 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6deea-44b3-4ecc-97d1-141c20c02c67 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:45.469823 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6deea-44b3-4ecc-97d1-141c20c02c67 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:45.470097 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6deea-44b3-4ecc-97d1-141c20c02c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:45.499629 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-71d6deea-44b3-4ecc-97d1-141c20c02c67 None None] MFA Rules not processed for user `5fb474ee425445f7aece82386cb96a94`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:45.500824 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-71d6deea-44b3-4ecc-97d1-141c20c02c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:45.572003 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1422/2847] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:45.583182 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7208ed-62ab-43f8-aded-31fb8b8e7afb admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:45.585538 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2c7208ed-62ab-43f8-aded-31fb8b8e7afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:45.654569 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7208ed-62ab-43f8-aded-31fb8b8e7afb admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:45.659123 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1020b-6b91-468e-a407-c2c0ae5f7bf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:45.659755 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1020b-6b91-468e-a407-c2c0ae5f7bf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:45.660035 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1020b-6b91-468e-a407-c2c0ae5f7bf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:45.660308 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1020b-6b91-468e-a407-c2c0ae5f7bf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:45.670243 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1020b-6b91-468e-a407-c2c0ae5f7bf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:45.671713 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1020b-6b91-468e-a407-c2c0ae5f7bf9 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:45.681574 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1426/2848] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:46.236724 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6deea-44b3-4ecc-97d1-141c20c02c67 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:46.238431 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-71d6deea-44b3-4ecc-97d1-141c20c02c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:46.250853 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6deea-44b3-4ecc-97d1-141c20c02c67 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:46.254761 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe230c-5246-4604-9b74-80c104df0623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:46.255402 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe230c-5246-4604-9b74-80c104df0623 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:46.255672 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe230c-5246-4604-9b74-80c104df0623 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:46.255965 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe230c-5246-4604-9b74-80c104df0623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:46.312966 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe230c-5246-4604-9b74-80c104df0623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:46.314482 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe230c-5246-4604-9b74-80c104df0623 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:46.323749 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1423/2849] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:50.423623 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1020b-6b91-468e-a407-c2c0ae5f7bf9 service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:50.433461 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1020b-6b91-468e-a407-c2c0ae5f7bf9 service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:50.437799 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abef5f-3dd7-4819-9364-a55e79687d5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:50.438420 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abef5f-3dd7-4819-9364-a55e79687d5b service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:50.438693 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abef5f-3dd7-4819-9364-a55e79687d5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:50.438955 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abef5f-3dd7-4819-9364-a55e79687d5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:50.473309 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:50.504101 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abef5f-3dd7-4819-9364-a55e79687d5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:50.505631 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abef5f-3dd7-4819-9364-a55e79687d5b service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:50.515620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1427/2850] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:52.700462 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe230c-5246-4604-9b74-80c104df0623 service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:52.755575 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=100 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:52.768078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe230c-5246-4604-9b74-80c104df0623 service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:52.772919 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bf8ed-891b-414a-b5e7-9728e8781463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:52.773593 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bf8ed-891b-414a-b5e7-9728e8781463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:52.773868 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bf8ed-891b-414a-b5e7-9728e8781463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:52.774204 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bf8ed-891b-414a-b5e7-9728e8781463 admin admin] PATH_INFO: `/v3/users/fc563abf761d467faa11fc7c6ab71407` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:52.775938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bf8ed-891b-414a-b5e7-9728e8781463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc563abf761d467faa11fc7c6ab71407)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:52.779706 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bf8ed-891b-414a-b5e7-9728e8781463 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:52.833894 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5e1bf8ed-891b-414a-b5e7-9728e8781463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc563abf761d467faa11fc7c6ab71407'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:52.845738 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5e1bf8ed-891b-414a-b5e7-9728e8781463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc563abf761d467faa11fc7c6ab71407'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:52.856176 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5e1bf8ed-891b-414a-b5e7-9728e8781463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc563abf761d467faa11fc7c6ab71407'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:52.863745 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5e1bf8ed-891b-414a-b5e7-9728e8781463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc563abf761d467faa11fc7c6ab71407'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:52.864367 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-5e1bf8ed-891b-414a-b5e7-9728e8781463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc563abf761d467faa11fc7c6ab71407'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:52.870585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1424/2851] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:05:52 2022] DELETE /identity/v3/users/fc563abf761d467faa11fc7c6ab71407 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:52.875344 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5664ec-a01b-4061-99e6-8a8c5382e6df None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:52.875903 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5664ec-a01b-4061-99e6-8a8c5382e6df None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:52.875903 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5664ec-a01b-4061-99e6-8a8c5382e6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:52.895851 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-4f5664ec-a01b-4061-99e6-8a8c5382e6df None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:52.897118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4f5664ec-a01b-4061-99e6-8a8c5382e6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:52.965106 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1428/2852] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:05:52.975137 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bf8ed-891b-414a-b5e7-9728e8781463 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:52.976737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-5e1bf8ed-891b-414a-b5e7-9728e8781463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:53.039243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bf8ed-891b-414a-b5e7-9728e8781463 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:53.043816 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ce967-9d31-47d5-8805-017cf7713b48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:53.044453 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ce967-9d31-47d5-8805-017cf7713b48 service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:53.044769 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ce967-9d31-47d5-8805-017cf7713b48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:53.045046 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ce967-9d31-47d5-8805-017cf7713b48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:53.054836 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ce967-9d31-47d5-8805-017cf7713b48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:53.056337 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ce967-9d31-47d5-8805-017cf7713b48 service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:53.066296 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1425/2853] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:53.343136 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5664ec-a01b-4061-99e6-8a8c5382e6df None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:53.344783 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4f5664ec-a01b-4061-99e6-8a8c5382e6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:53.359434 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5664ec-a01b-4061-99e6-8a8c5382e6df None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:53.364079 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f976b68-fb12-410f-a261-e68d95f65f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:53.364734 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f976b68-fb12-410f-a261-e68d95f65f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:53.365025 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f976b68-fb12-410f-a261-e68d95f65f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:53.365330 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f976b68-fb12-410f-a261-e68d95f65f8c admin admin] PATH_INFO: `/v3/projects/53ab09db556746cc8f1393a497c540ab` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:53.366602 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f976b68-fb12-410f-a261-e68d95f65f8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ab09db556746cc8f1393a497c540ab)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:53.369267 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f976b68-fb12-410f-a261-e68d95f65f8c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:53.418950 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-3f976b68-fb12-410f-a261-e68d95f65f8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ab09db556746cc8f1393a497c540ab', 'request_id': 'req-3f976b68-fb12-410f-a261-e68d95f65f8c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:53.425120 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-3f976b68-fb12-410f-a261-e68d95f65f8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ab09db556746cc8f1393a497c540ab', 'request_id': 'req-3f976b68-fb12-410f-a261-e68d95f65f8c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:53.434232 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-3f976b68-fb12-410f-a261-e68d95f65f8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ab09db556746cc8f1393a497c540ab', 'request_id': 'req-3f976b68-fb12-410f-a261-e68d95f65f8c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:53.444909 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-3f976b68-fb12-410f-a261-e68d95f65f8c admin admin] The token cache is being invalidate because project 53ab09db556746cc8f1393a497c540ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:05:53.445230 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-3f976b68-fb12-410f-a261-e68d95f65f8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:53.445865 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-3f976b68-fb12-410f-a261-e68d95f65f8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:53.447580 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1429/2854] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:05:53 2022] DELETE /identity/v3/projects/53ab09db556746cc8f1393a497c540ab => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:53.451808 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ce967-9d31-47d5-8805-017cf7713b48 service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:53.462510 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ce967-9d31-47d5-8805-017cf7713b48 service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:53.539275 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c736f8-30d0-4828-8ddc-dd57226d3a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:53.540086 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c736f8-30d0-4828-8ddc-dd57226d3a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:53.540365 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c736f8-30d0-4828-8ddc-dd57226d3a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:53.540641 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c736f8-30d0-4828-8ddc-dd57226d3a6f admin admin] PATH_INFO: `/v3/users/f1d56f5d3a10483abd6d179b541e276f` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:53.542032 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c736f8-30d0-4828-8ddc-dd57226d3a6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d56f5d3a10483abd6d179b541e276f)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:53.543970 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c736f8-30d0-4828-8ddc-dd57226d3a6f admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:53.559812 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:53.593226 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-83c736f8-30d0-4828-8ddc-dd57226d3a6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d56f5d3a10483abd6d179b541e276f'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:53.605778 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-83c736f8-30d0-4828-8ddc-dd57226d3a6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d56f5d3a10483abd6d179b541e276f'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:53.615415 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-83c736f8-30d0-4828-8ddc-dd57226d3a6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d56f5d3a10483abd6d179b541e276f'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:53.623537 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-83c736f8-30d0-4828-8ddc-dd57226d3a6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d56f5d3a10483abd6d179b541e276f'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:53.624180 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-83c736f8-30d0-4828-8ddc-dd57226d3a6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d56f5d3a10483abd6d179b541e276f'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:53.630278 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1426/2855] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:05:53 2022] DELETE /identity/v3/users/f1d56f5d3a10483abd6d179b541e276f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:53.927126 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f976b68-fb12-410f-a261-e68d95f65f8c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:53.928747 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3f976b68-fb12-410f-a261-e68d95f65f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:53.946481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f976b68-fb12-410f-a261-e68d95f65f8c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:54.003895 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:54.011727 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ac505-2f08-4688-b39c-a36438997a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:54.013086 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ac505-2f08-4688-b39c-a36438997a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:54.013418 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ac505-2f08-4688-b39c-a36438997a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:54.014352 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ac505-2f08-4688-b39c-a36438997a5f admin admin] PATH_INFO: `/v3/projects/2b07e651e1f44df584cb53a40ae133d0` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:54.016007 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ac505-2f08-4688-b39c-a36438997a5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b07e651e1f44df584cb53a40ae133d0)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:54.018082 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ac505-2f08-4688-b39c-a36438997a5f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:54.069441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-db8ac505-2f08-4688-b39c-a36438997a5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b07e651e1f44df584cb53a40ae133d0', 'request_id': 'req-db8ac505-2f08-4688-b39c-a36438997a5f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:54.076184 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-db8ac505-2f08-4688-b39c-a36438997a5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b07e651e1f44df584cb53a40ae133d0', 'request_id': 'req-db8ac505-2f08-4688-b39c-a36438997a5f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:54.085693 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-db8ac505-2f08-4688-b39c-a36438997a5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b07e651e1f44df584cb53a40ae133d0', 'request_id': 'req-db8ac505-2f08-4688-b39c-a36438997a5f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:54.097045 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-db8ac505-2f08-4688-b39c-a36438997a5f admin admin] The token cache is being invalidate because project 2b07e651e1f44df584cb53a40ae133d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:05:54.097369 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-db8ac505-2f08-4688-b39c-a36438997a5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:54.098037 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-db8ac505-2f08-4688-b39c-a36438997a5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:54.099592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1430/2856] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:05:53 2022] DELETE /identity/v3/projects/2b07e651e1f44df584cb53a40ae133d0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:54.104138 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c736f8-30d0-4828-8ddc-dd57226d3a6f admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:54.105716 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-83c736f8-30d0-4828-8ddc-dd57226d3a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:54.120332 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c736f8-30d0-4828-8ddc-dd57226d3a6f admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:54.182542 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbbd65-9434-457b-9598-0e4f8d860313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:54.183217 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbbd65-9434-457b-9598-0e4f8d860313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:54.183491 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbbd65-9434-457b-9598-0e4f8d860313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:54.183770 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbbd65-9434-457b-9598-0e4f8d860313 admin admin] PATH_INFO: `/v3/users/5fb474ee425445f7aece82386cb96a94` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:54.184948 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbbd65-9434-457b-9598-0e4f8d860313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb474ee425445f7aece82386cb96a94)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:54.186938 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbbd65-9434-457b-9598-0e4f8d860313 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:54.239289 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2bdbbd65-9434-457b-9598-0e4f8d860313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb474ee425445f7aece82386cb96a94'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:54.252480 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2bdbbd65-9434-457b-9598-0e4f8d860313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb474ee425445f7aece82386cb96a94'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:54.262401 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2bdbbd65-9434-457b-9598-0e4f8d860313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb474ee425445f7aece82386cb96a94'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:54.269379 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2bdbbd65-9434-457b-9598-0e4f8d860313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb474ee425445f7aece82386cb96a94'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:54.269996 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-2bdbbd65-9434-457b-9598-0e4f8d860313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb474ee425445f7aece82386cb96a94'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:54.275972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1427/2857] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:05:54 2022] DELETE /identity/v3/users/5fb474ee425445f7aece82386cb96a94 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:54.571831 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ac505-2f08-4688-b39c-a36438997a5f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:54.573628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-db8ac505-2f08-4688-b39c-a36438997a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:54.589247 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ac505-2f08-4688-b39c-a36438997a5f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:54.653523 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06746d-1bb8-4afd-8bcf-5b3f06128368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:54.654089 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06746d-1bb8-4afd-8bcf-5b3f06128368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:54.654368 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06746d-1bb8-4afd-8bcf-5b3f06128368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:54.654640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06746d-1bb8-4afd-8bcf-5b3f06128368 admin admin] PATH_INFO: `/v3/projects/b5540df81f384e49a74414f0cf81630e` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:54.655875 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06746d-1bb8-4afd-8bcf-5b3f06128368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5540df81f384e49a74414f0cf81630e)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:54.657834 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06746d-1bb8-4afd-8bcf-5b3f06128368 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:54.708226 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4b06746d-1bb8-4afd-8bcf-5b3f06128368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5540df81f384e49a74414f0cf81630e', 'request_id': 'req-4b06746d-1bb8-4afd-8bcf-5b3f06128368'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:54.714444 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4b06746d-1bb8-4afd-8bcf-5b3f06128368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5540df81f384e49a74414f0cf81630e', 'request_id': 'req-4b06746d-1bb8-4afd-8bcf-5b3f06128368'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:54.724071 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4b06746d-1bb8-4afd-8bcf-5b3f06128368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5540df81f384e49a74414f0cf81630e', 'request_id': 'req-4b06746d-1bb8-4afd-8bcf-5b3f06128368'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:54.734777 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4b06746d-1bb8-4afd-8bcf-5b3f06128368 admin admin] The token cache is being invalidate because project b5540df81f384e49a74414f0cf81630e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:05:54.735062 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4b06746d-1bb8-4afd-8bcf-5b3f06128368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:54.735677 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4b06746d-1bb8-4afd-8bcf-5b3f06128368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:54.737223 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1431/2858] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:05:54 2022] DELETE /identity/v3/projects/b5540df81f384e49a74414f0cf81630e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:54.743242 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b2750-7ab2-4949-95c1-50c51263ee97 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:54.743608 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b2750-7ab2-4949-95c1-50c51263ee97 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:54.743927 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b2750-7ab2-4949-95c1-50c51263ee97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:54.764873 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-6e9b2750-7ab2-4949-95c1-50c51263ee97 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:54.766103 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6e9b2750-7ab2-4949-95c1-50c51263ee97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:54.775467 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:54.845201 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1428/2859] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:54.855934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718ac53-086e-457c-94a8-cc30d295fd7f None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:54.856230 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718ac53-086e-457c-94a8-cc30d295fd7f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:54.856539 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718ac53-086e-457c-94a8-cc30d295fd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:54.883744 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-3718ac53-086e-457c-94a8-cc30d295fd7f None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:54.885006 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3718ac53-086e-457c-94a8-cc30d295fd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:54.894735 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1432/2860] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:54.899985 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b2750-7ab2-4949-95c1-50c51263ee97 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:54.912951 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b2750-7ab2-4949-95c1-50c51263ee97 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:54.919365 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918ab53-dc75-4b8e-a426-6217c8c96481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:54.920008 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918ab53-dc75-4b8e-a426-6217c8c96481 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:54.920284 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918ab53-dc75-4b8e-a426-6217c8c96481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:54.920554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918ab53-dc75-4b8e-a426-6217c8c96481 admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:54.921519 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918ab53-dc75-4b8e-a426-6217c8c96481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:05:54.921826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918ab53-dc75-4b8e-a426-6217c8c96481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:54.923479 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918ab53-dc75-4b8e-a426-6217c8c96481 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:54.936368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1429/2861] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 18:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:05:54.941390 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718ac53-086e-457c-94a8-cc30d295fd7f None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:54.951268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718ac53-086e-457c-94a8-cc30d295fd7f None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:54.957515 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ffb98-a67b-4ebc-8415-cf9c73d1d99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:54.958280 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ffb98-a67b-4ebc-8415-cf9c73d1d99b admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:54.958558 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ffb98-a67b-4ebc-8415-cf9c73d1d99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:54.958814 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ffb98-a67b-4ebc-8415-cf9c73d1d99b admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:54.959486 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ffb98-a67b-4ebc-8415-cf9c73d1d99b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:54.961445 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ffb98-a67b-4ebc-8415-cf9c73d1d99b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:54.967378 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:54.994210 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1433/2862] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:54 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:05:54.998502 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918ab53-dc75-4b8e-a426-6217c8c96481 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:55.008700 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918ab53-dc75-4b8e-a426-6217c8c96481 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:55.069041 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4d42f-e672-4237-b281-d18f726da69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:55.069684 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4d42f-e672-4237-b281-d18f726da69c admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:55.069962 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4d42f-e672-4237-b281-d18f726da69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:55.070217 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4d42f-e672-4237-b281-d18f726da69c admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:55.070894 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4d42f-e672-4237-b281-d18f726da69c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:55.072863 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4d42f-e672-4237-b281-d18f726da69c admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:55.095092 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1430/2863] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:54 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:55.099582 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ffb98-a67b-4ebc-8415-cf9c73d1d99b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:55.110729 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ffb98-a67b-4ebc-8415-cf9c73d1d99b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:55.115425 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d24e3-254c-47c9-8afa-c1abccb67322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:55.116042 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d24e3-254c-47c9-8afa-c1abccb67322 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:55.116319 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d24e3-254c-47c9-8afa-c1abccb67322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:55.116592 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d24e3-254c-47c9-8afa-c1abccb67322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:55.117418 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d24e3-254c-47c9-8afa-c1abccb67322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:55.119109 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d24e3-254c-47c9-8afa-c1abccb67322 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:55.129215 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1434/2864] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:55.133320 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4d42f-e672-4237-b281-d18f726da69c admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:55.143661 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4d42f-e672-4237-b281-d18f726da69c admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:55.148545 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28983be5-44e0-41c0-b4bf-13dcf2364894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:55.149172 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28983be5-44e0-41c0-b4bf-13dcf2364894 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:55.149600 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28983be5-44e0-41c0-b4bf-13dcf2364894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:55.149826 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28983be5-44e0-41c0-b4bf-13dcf2364894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:55.150537 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28983be5-44e0-41c0-b4bf-13dcf2364894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:55.152145 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28983be5-44e0-41c0-b4bf-13dcf2364894 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:55.163190 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1431/2865] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:05:55.167529 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d24e3-254c-47c9-8afa-c1abccb67322 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:55.183211 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d24e3-254c-47c9-8afa-c1abccb67322 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:55.189488 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf4286-a9d3-4254-80de-1a336e8924a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:55.190168 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf4286-a9d3-4254-80de-1a336e8924a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:55.190453 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf4286-a9d3-4254-80de-1a336e8924a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:55.190699 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf4286-a9d3-4254-80de-1a336e8924a8 admin admin] PATH_INFO: `/v3/projects/e40d08f711a94c038c0f3753aa010cbf/users/2e3eb5ea5d52400d8ae522f9e0c3f449/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:55.208585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf4286-a9d3-4254-80de-1a336e8924a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40d08f711a94c038c0f3753aa010cbf, user_id=2e3eb5ea5d52400d8ae522f9e0c3f449, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:55.211315 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf4286-a9d3-4254-80de-1a336e8924a8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:55.231093 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1435/2866] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:55 2022] PUT /identity/v3/projects/e40d08f711a94c038c0f3753aa010cbf/users/2e3eb5ea5d52400d8ae522f9e0c3f449/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:55.247266 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe77cee-7560-45d9-8c3b-308e20d94347 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:55.247552 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe77cee-7560-45d9-8c3b-308e20d94347 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:55.247825 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe77cee-7560-45d9-8c3b-308e20d94347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:55.276277 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-abe77cee-7560-45d9-8c3b-308e20d94347 None None] MFA Rules not processed for user `2e3eb5ea5d52400d8ae522f9e0c3f449`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:55.277538 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-abe77cee-7560-45d9-8c3b-308e20d94347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:55.345206 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1432/2867] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:55.350075 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf4286-a9d3-4254-80de-1a336e8924a8 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:55.418351 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf4286-a9d3-4254-80de-1a336e8924a8 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:55.423170 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470c592-7504-473a-8c3c-f8bc4ea7ceb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:55.423817 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470c592-7504-473a-8c3c-f8bc4ea7ceb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:55.424102 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470c592-7504-473a-8c3c-f8bc4ea7ceb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:55.424375 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470c592-7504-473a-8c3c-f8bc4ea7ceb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:55.425039 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470c592-7504-473a-8c3c-f8bc4ea7ceb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:55.427000 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470c592-7504-473a-8c3c-f8bc4ea7ceb6 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:55.456504 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1436/2868] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:05:55 2022] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:55.460950 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe77cee-7560-45d9-8c3b-308e20d94347 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:55.472159 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe77cee-7560-45d9-8c3b-308e20d94347 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:55.477953 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:55.540581 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b462bc-02ec-4e2a-a98a-38923abf49f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:55.541255 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b462bc-02ec-4e2a-a98a-38923abf49f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:55.541542 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b462bc-02ec-4e2a-a98a-38923abf49f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:55.541815 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b462bc-02ec-4e2a-a98a-38923abf49f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:55.542513 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b462bc-02ec-4e2a-a98a-38923abf49f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:55.544440 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b462bc-02ec-4e2a-a98a-38923abf49f0 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:55.569804 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1433/2869] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:05:55 2022] POST /identity/v3/users => generated 302 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:05:55.574228 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470c592-7504-473a-8c3c-f8bc4ea7ceb6 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:55.589575 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470c592-7504-473a-8c3c-f8bc4ea7ceb6 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:55.596680 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf751d8-91dd-48e5-bd0d-b3de95b014eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:55.597587 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf751d8-91dd-48e5-bd0d-b3de95b014eb admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:55.597869 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf751d8-91dd-48e5-bd0d-b3de95b014eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:55.598144 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf751d8-91dd-48e5-bd0d-b3de95b014eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:55.598844 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf751d8-91dd-48e5-bd0d-b3de95b014eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:55.600500 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf751d8-91dd-48e5-bd0d-b3de95b014eb admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:55.613856 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1437/2870] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:05:55.618293 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b462bc-02ec-4e2a-a98a-38923abf49f0 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:55.629398 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b462bc-02ec-4e2a-a98a-38923abf49f0 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:55.634328 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994f133-3a37-45f5-b07c-a7264620c811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:55.634956 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994f133-3a37-45f5-b07c-a7264620c811 admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:55.635612 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994f133-3a37-45f5-b07c-a7264620c811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:55.635895 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994f133-3a37-45f5-b07c-a7264620c811 admin admin] PATH_INFO: `/v3/projects/446788773db140069a8d0001d11411dd/users/00de2086f7f349b1a34524b499942134/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:55.651159 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b994f133-3a37-45f5-b07c-a7264620c811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=446788773db140069a8d0001d11411dd, user_id=00de2086f7f349b1a34524b499942134, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:55.653824 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b994f133-3a37-45f5-b07c-a7264620c811 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:55.668580 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1434/2871] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:55 2022] PUT /identity/v3/projects/446788773db140069a8d0001d11411dd/users/00de2086f7f349b1a34524b499942134/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:55.672608 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf751d8-91dd-48e5-bd0d-b3de95b014eb admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:55.682703 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf751d8-91dd-48e5-bd0d-b3de95b014eb admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:55.741665 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2771c-6c01-4910-9b16-e329ba681321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:55.742291 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2771c-6c01-4910-9b16-e329ba681321 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:55.742568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2771c-6c01-4910-9b16-e329ba681321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:55.742839 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2771c-6c01-4910-9b16-e329ba681321 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:55.743636 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2771c-6c01-4910-9b16-e329ba681321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:55.745266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2771c-6c01-4910-9b16-e329ba681321 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:55.754940 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1438/2872] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:05:55.761086 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994f133-3a37-45f5-b07c-a7264620c811 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:55.776654 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994f133-3a37-45f5-b07c-a7264620c811 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:55.784246 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efe67f-5f6d-444f-a2b2-98910f2d2fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:55.785164 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efe67f-5f6d-444f-a2b2-98910f2d2fac admin admin] REQUEST_METHOD: `PUT` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:55.785527 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efe67f-5f6d-444f-a2b2-98910f2d2fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:55.785824 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efe67f-5f6d-444f-a2b2-98910f2d2fac admin admin] PATH_INFO: `/v3/projects/446788773db140069a8d0001d11411dd/users/00de2086f7f349b1a34524b499942134/roles/980cae90acae42189f92fd6dd42867a5` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:55.788908 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efe67f-5f6d-444f-a2b2-98910f2d2fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=446788773db140069a8d0001d11411dd, user_id=00de2086f7f349b1a34524b499942134, role_id=980cae90acae42189f92fd6dd42867a5)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:55.792026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efe67f-5f6d-444f-a2b2-98910f2d2fac admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:55.802409 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1435/2873] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:05:55 2022] PUT /identity/v3/projects/446788773db140069a8d0001d11411dd/users/00de2086f7f349b1a34524b499942134/roles/980cae90acae42189f92fd6dd42867a5 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:55.814001 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e3ff7-5201-4273-ae67-c55d06f0641c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:55.814286 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e3ff7-5201-4273-ae67-c55d06f0641c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:55.814568 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e3ff7-5201-4273-ae67-c55d06f0641c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:55.845401 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-040e3ff7-5201-4273-ae67-c55d06f0641c None None] MFA Rules not processed for user `00de2086f7f349b1a34524b499942134`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:55.846604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-040e3ff7-5201-4273-ae67-c55d06f0641c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:55.856561 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:55.918383 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1439/2874] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:55.930481 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efe67f-5f6d-444f-a2b2-98910f2d2fac admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:55.933116 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-c4efe67f-5f6d-444f-a2b2-98910f2d2fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:55.997152 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efe67f-5f6d-444f-a2b2-98910f2d2fac admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:56.000933 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742269a-9820-45b1-81e8-44a879fe1a76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:56.001585 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742269a-9820-45b1-81e8-44a879fe1a76 service cinder] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:56.001875 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742269a-9820-45b1-81e8-44a879fe1a76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:56.002130 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742269a-9820-45b1-81e8-44a879fe1a76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:56.011165 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742269a-9820-45b1-81e8-44a879fe1a76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:56.012588 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742269a-9820-45b1-81e8-44a879fe1a76 service cinder] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:56.023257 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1436/2875] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:56.075908 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e3ff7-5201-4273-ae67-c55d06f0641c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:56.077373 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-040e3ff7-5201-4273-ae67-c55d06f0641c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:56.090481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e3ff7-5201-4273-ae67-c55d06f0641c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:56.094961 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b21b4-0d3c-4b83-9f49-b24e36244046 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:56.095595 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b21b4-0d3c-4b83-9f49-b24e36244046 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:56.095868 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b21b4-0d3c-4b83-9f49-b24e36244046 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:56.096133 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b21b4-0d3c-4b83-9f49-b24e36244046 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:56.158171 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b21b4-0d3c-4b83-9f49-b24e36244046 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:56.159630 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b21b4-0d3c-4b83-9f49-b24e36244046 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:56.168978 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1440/2876] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:59.556965 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742269a-9820-45b1-81e8-44a879fe1a76 service cinder] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:59.633370 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742269a-9820-45b1-81e8-44a879fe1a76 service cinder] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:59.638652 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f3e80-27c3-4a95-af5f-069c0a8ee6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:59.639334 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f3e80-27c3-4a95-af5f-069c0a8ee6c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:59.639614 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f3e80-27c3-4a95-af5f-069c0a8ee6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:59.639887 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f3e80-27c3-4a95-af5f-069c0a8ee6c0 admin admin] PATH_INFO: `/v3/users/2e3eb5ea5d52400d8ae522f9e0c3f449` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:59.641218 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f3e80-27c3-4a95-af5f-069c0a8ee6c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e3eb5ea5d52400d8ae522f9e0c3f449)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:59.643140 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f3e80-27c3-4a95-af5f-069c0a8ee6c0 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:59.649988 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:59.703893 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-238f3e80-27c3-4a95-af5f-069c0a8ee6c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e3eb5ea5d52400d8ae522f9e0c3f449'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:59.719571 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-238f3e80-27c3-4a95-af5f-069c0a8ee6c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e3eb5ea5d52400d8ae522f9e0c3f449'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:59.729596 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-238f3e80-27c3-4a95-af5f-069c0a8ee6c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e3eb5ea5d52400d8ae522f9e0c3f449'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:59.740877 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-238f3e80-27c3-4a95-af5f-069c0a8ee6c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e3eb5ea5d52400d8ae522f9e0c3f449'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:59.741578 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-238f3e80-27c3-4a95-af5f-069c0a8ee6c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e3eb5ea5d52400d8ae522f9e0c3f449'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:05:59.748120 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1437/2877] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:05:59 2022] DELETE /identity/v3/users/2e3eb5ea5d52400d8ae522f9e0c3f449 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:05:59.752817 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbf27e-cdfb-48b4-bf29-38dc7f39b485 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:59.753348 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbf27e-cdfb-48b4-bf29-38dc7f39b485 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:59.753444 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbf27e-cdfb-48b4-bf29-38dc7f39b485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:59.773760 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-30fbf27e-cdfb-48b4-bf29-38dc7f39b485 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:05:59.774983 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-30fbf27e-cdfb-48b4-bf29-38dc7f39b485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:59.842478 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1441/2878] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:05:59.852252 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f3e80-27c3-4a95-af5f-069c0a8ee6c0 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:05:59.853794 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-238f3e80-27c3-4a95-af5f-069c0a8ee6c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:05:59.917923 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f3e80-27c3-4a95-af5f-069c0a8ee6c0 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:05:59.923554 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791b950-818b-4a8f-8827-f836f52da3ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:05:59.924171 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791b950-818b-4a8f-8827-f836f52da3ef service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:05:59.924454 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791b950-818b-4a8f-8827-f836f52da3ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:05:59.924730 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791b950-818b-4a8f-8827-f836f52da3ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:05:59.935223 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791b950-818b-4a8f-8827-f836f52da3ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:05:59.936682 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791b950-818b-4a8f-8827-f836f52da3ef service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:05:59.946078 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1438/2879] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:05:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:00.241601 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbf27e-cdfb-48b4-bf29-38dc7f39b485 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:00.243357 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-30fbf27e-cdfb-48b4-bf29-38dc7f39b485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:00.256077 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbf27e-cdfb-48b4-bf29-38dc7f39b485 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:00.261051 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09245d94-376a-4960-9d85-88f2843c360e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:00.262185 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09245d94-376a-4960-9d85-88f2843c360e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:00.262185 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09245d94-376a-4960-9d85-88f2843c360e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:00.262416 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09245d94-376a-4960-9d85-88f2843c360e admin admin] PATH_INFO: `/v3/projects/e40d08f711a94c038c0f3753aa010cbf` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:00.263672 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09245d94-376a-4960-9d85-88f2843c360e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e40d08f711a94c038c0f3753aa010cbf)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:00.265670 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09245d94-376a-4960-9d85-88f2843c360e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:00.314378 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:00.321572 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-09245d94-376a-4960-9d85-88f2843c360e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e40d08f711a94c038c0f3753aa010cbf', 'request_id': 'req-09245d94-376a-4960-9d85-88f2843c360e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:00.328186 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-09245d94-376a-4960-9d85-88f2843c360e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e40d08f711a94c038c0f3753aa010cbf', 'request_id': 'req-09245d94-376a-4960-9d85-88f2843c360e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:00.338523 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-09245d94-376a-4960-9d85-88f2843c360e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e40d08f711a94c038c0f3753aa010cbf', 'request_id': 'req-09245d94-376a-4960-9d85-88f2843c360e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:00.349998 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-09245d94-376a-4960-9d85-88f2843c360e admin admin] The token cache is being invalidate because project e40d08f711a94c038c0f3753aa010cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:00.350286 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-09245d94-376a-4960-9d85-88f2843c360e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:00.350929 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-09245d94-376a-4960-9d85-88f2843c360e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:00.352516 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1442/2880] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:00 2022] DELETE /identity/v3/projects/e40d08f711a94c038c0f3753aa010cbf => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:00.356759 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791b950-818b-4a8f-8827-f836f52da3ef service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:00.368023 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791b950-818b-4a8f-8827-f836f52da3ef service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:00.429445 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf210b68-b50c-4509-b0cc-543732cc03c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:00.430086 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf210b68-b50c-4509-b0cc-543732cc03c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:00.430368 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf210b68-b50c-4509-b0cc-543732cc03c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:00.430634 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf210b68-b50c-4509-b0cc-543732cc03c3 admin admin] PATH_INFO: `/v3/users/00de2086f7f349b1a34524b499942134` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:00.431817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf210b68-b50c-4509-b0cc-543732cc03c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00de2086f7f349b1a34524b499942134)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:00.434276 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf210b68-b50c-4509-b0cc-543732cc03c3 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:00.466777 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:00.490143 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-cf210b68-b50c-4509-b0cc-543732cc03c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00de2086f7f349b1a34524b499942134'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:00.502965 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-cf210b68-b50c-4509-b0cc-543732cc03c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00de2086f7f349b1a34524b499942134'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:00.512217 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-cf210b68-b50c-4509-b0cc-543732cc03c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00de2086f7f349b1a34524b499942134'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:00.519001 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-cf210b68-b50c-4509-b0cc-543732cc03c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00de2086f7f349b1a34524b499942134'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:00.519623 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-cf210b68-b50c-4509-b0cc-543732cc03c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00de2086f7f349b1a34524b499942134'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:00.525516 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1439/2881] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:00 2022] DELETE /identity/v3/users/00de2086f7f349b1a34524b499942134 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:00.807792 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09245d94-376a-4960-9d85-88f2843c360e admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:00.809762 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-09245d94-376a-4960-9d85-88f2843c360e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:00.823250 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09245d94-376a-4960-9d85-88f2843c360e admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:00.892031 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a54404-aa4a-4b53-880f-d6267441a152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:00.892640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a54404-aa4a-4b53-880f-d6267441a152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:00.892986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a54404-aa4a-4b53-880f-d6267441a152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:00.893295 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a54404-aa4a-4b53-880f-d6267441a152 admin admin] PATH_INFO: `/v3/projects/446788773db140069a8d0001d11411dd` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:00.894628 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a54404-aa4a-4b53-880f-d6267441a152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=446788773db140069a8d0001d11411dd)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:00.896547 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a54404-aa4a-4b53-880f-d6267441a152 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:00.943800 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-64a54404-aa4a-4b53-880f-d6267441a152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '446788773db140069a8d0001d11411dd', 'request_id': 'req-64a54404-aa4a-4b53-880f-d6267441a152'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:00.950216 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-64a54404-aa4a-4b53-880f-d6267441a152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '446788773db140069a8d0001d11411dd', 'request_id': 'req-64a54404-aa4a-4b53-880f-d6267441a152'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:00.959379 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-64a54404-aa4a-4b53-880f-d6267441a152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '446788773db140069a8d0001d11411dd', 'request_id': 'req-64a54404-aa4a-4b53-880f-d6267441a152'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:00.971855 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-64a54404-aa4a-4b53-880f-d6267441a152 admin admin] The token cache is being invalidate because project 446788773db140069a8d0001d11411dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:00.972146 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-64a54404-aa4a-4b53-880f-d6267441a152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:00.972873 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-64a54404-aa4a-4b53-880f-d6267441a152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:00.974675 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1443/2882] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:00 2022] DELETE /identity/v3/projects/446788773db140069a8d0001d11411dd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:00.981676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9cda5-b176-42df-ac82-5184b8355511 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:00.982200 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9cda5-b176-42df-ac82-5184b8355511 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:00.982297 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9cda5-b176-42df-ac82-5184b8355511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:01.003356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-c0c9cda5-b176-42df-ac82-5184b8355511 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:01.004565 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-c0c9cda5-b176-42df-ac82-5184b8355511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:01.066398 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1440/2883] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:01.077668 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf44e27-246f-4e22-8248-c365c5a7fd9f None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:01.077962 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf44e27-246f-4e22-8248-c365c5a7fd9f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:01.078244 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf44e27-246f-4e22-8248-c365c5a7fd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:01.099481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-ecf44e27-246f-4e22-8248-c365c5a7fd9f None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:01.100718 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ecf44e27-246f-4e22-8248-c365c5a7fd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:01.112160 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1444/2884] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:01.116718 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9cda5-b176-42df-ac82-5184b8355511 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:01.127817 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9cda5-b176-42df-ac82-5184b8355511 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:01.133828 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d65ba-fe3b-49a6-857d-9636bad49c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:01.134454 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d65ba-fe3b-49a6-857d-9636bad49c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:01.134725 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d65ba-fe3b-49a6-857d-9636bad49c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:01.135000 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d65ba-fe3b-49a6-857d-9636bad49c16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:01.135697 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d65ba-fe3b-49a6-857d-9636bad49c16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:06:01.136440 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d65ba-fe3b-49a6-857d-9636bad49c16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:01.138144 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d65ba-fe3b-49a6-857d-9636bad49c16 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:01.153935 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1441/2885] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 18:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:06:01.158470 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf44e27-246f-4e22-8248-c365c5a7fd9f None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:01.168313 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf44e27-246f-4e22-8248-c365c5a7fd9f None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:01.180118 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31b13b-a723-4a41-9a41-90150c761ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:01.184029 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31b13b-a723-4a41-9a41-90150c761ace admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:01.184318 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31b13b-a723-4a41-9a41-90150c761ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:01.184640 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31b13b-a723-4a41-9a41-90150c761ace admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:01.185318 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31b13b-a723-4a41-9a41-90150c761ace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:01.187321 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31b13b-a723-4a41-9a41-90150c761ace admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:01.236988 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1445/2886] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:01 2022] POST /identity/v3/projects => generated 365 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:01.241624 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d65ba-fe3b-49a6-857d-9636bad49c16 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:01.253025 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d65ba-fe3b-49a6-857d-9636bad49c16 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:01.308662 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe0e53-f194-4188-ab31-a56f09180905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:01.309461 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe0e53-f194-4188-ab31-a56f09180905 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:01.309716 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe0e53-f194-4188-ab31-a56f09180905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:01.309986 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe0e53-f194-4188-ab31-a56f09180905 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:01.310644 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe0e53-f194-4188-ab31-a56f09180905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:01.312599 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe0e53-f194-4188-ab31-a56f09180905 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:01.337425 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1442/2887] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:01 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:01.341989 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31b13b-a723-4a41-9a41-90150c761ace admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:01.352423 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31b13b-a723-4a41-9a41-90150c761ace admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:01.357190 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04121736-7cb5-4c58-83a3-673126cfb8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:01.357808 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04121736-7cb5-4c58-83a3-673126cfb8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:01.358085 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04121736-7cb5-4c58-83a3-673126cfb8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:01.358682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04121736-7cb5-4c58-83a3-673126cfb8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:01.359382 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04121736-7cb5-4c58-83a3-673126cfb8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:01.361005 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04121736-7cb5-4c58-83a3-673126cfb8f7 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:01.371905 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1446/2888] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:01.376111 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe0e53-f194-4188-ab31-a56f09180905 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:01.386496 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe0e53-f194-4188-ab31-a56f09180905 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:01.392421 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e3541-708c-40c7-b5a7-e8cefedd5b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:01.393085 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e3541-708c-40c7-b5a7-e8cefedd5b90 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:01.393364 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e3541-708c-40c7-b5a7-e8cefedd5b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:01.393642 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e3541-708c-40c7-b5a7-e8cefedd5b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:01.394334 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e3541-708c-40c7-b5a7-e8cefedd5b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:01.396226 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e3541-708c-40c7-b5a7-e8cefedd5b90 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:01.411022 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1443/2889] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:01.415565 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04121736-7cb5-4c58-83a3-673126cfb8f7 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:01.431926 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04121736-7cb5-4c58-83a3-673126cfb8f7 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:01.438405 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe06841-dd32-444b-b4a5-b2e30849989b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:01.439081 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe06841-dd32-444b-b4a5-b2e30849989b admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:01.439362 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe06841-dd32-444b-b4a5-b2e30849989b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:01.439638 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe06841-dd32-444b-b4a5-b2e30849989b admin admin] PATH_INFO: `/v3/projects/d6766784e33b44a68a6811ac8226f306/users/d118bb5d5604430880a518da7cd1e3b0/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:01.459420 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe06841-dd32-444b-b4a5-b2e30849989b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6766784e33b44a68a6811ac8226f306, user_id=d118bb5d5604430880a518da7cd1e3b0, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:01.462169 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe06841-dd32-444b-b4a5-b2e30849989b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:01.466215 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:01.481604 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1447/2890] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:01 2022] PUT /identity/v3/projects/d6766784e33b44a68a6811ac8226f306/users/d118bb5d5604430880a518da7cd1e3b0/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:06:01.492388 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc266374-4aed-4681-8fd3-1ead24201386 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:01.492676 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc266374-4aed-4681-8fd3-1ead24201386 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:01.492947 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc266374-4aed-4681-8fd3-1ead24201386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:01.515158 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:01.524098 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-fc266374-4aed-4681-8fd3-1ead24201386 None None] MFA Rules not processed for user `d118bb5d5604430880a518da7cd1e3b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:01.526067 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-fc266374-4aed-4681-8fd3-1ead24201386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:01.593497 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1444/2891] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:06:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:01.605430 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe06841-dd32-444b-b4a5-b2e30849989b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:01.607272 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-cfe06841-dd32-444b-b4a5-b2e30849989b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:01.667621 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe06841-dd32-444b-b4a5-b2e30849989b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:01.671643 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6c3db-d679-42b0-ab2a-c7419ac04e7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:01.672320 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6c3db-d679-42b0-ab2a-c7419ac04e7f service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:01.672585 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6c3db-d679-42b0-ab2a-c7419ac04e7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:01.672861 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6c3db-d679-42b0-ab2a-c7419ac04e7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:01.682584 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6c3db-d679-42b0-ab2a-c7419ac04e7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:01.684275 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6c3db-d679-42b0-ab2a-c7419ac04e7f service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:01.694266 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1448/2892] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:11.590638 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=27 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:11.689450 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=28 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:32.031944 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc266374-4aed-4681-8fd3-1ead24201386 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:32.098966 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc266374-4aed-4681-8fd3-1ead24201386 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:32.104445 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d146308-ccd2-423f-bb61-208fe559295b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:32.105099 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d146308-ccd2-423f-bb61-208fe559295b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:32.105389 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d146308-ccd2-423f-bb61-208fe559295b admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:32.105687 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d146308-ccd2-423f-bb61-208fe559295b admin admin] PATH_INFO: `/v3/users/d118bb5d5604430880a518da7cd1e3b0` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:32.107046 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d146308-ccd2-423f-bb61-208fe559295b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d118bb5d5604430880a518da7cd1e3b0)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:32.109389 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d146308-ccd2-423f-bb61-208fe559295b admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:32.161452 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-9d146308-ccd2-423f-bb61-208fe559295b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd118bb5d5604430880a518da7cd1e3b0'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:32.173762 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-9d146308-ccd2-423f-bb61-208fe559295b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd118bb5d5604430880a518da7cd1e3b0'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:32.183447 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-9d146308-ccd2-423f-bb61-208fe559295b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd118bb5d5604430880a518da7cd1e3b0'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:32.190463 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-9d146308-ccd2-423f-bb61-208fe559295b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd118bb5d5604430880a518da7cd1e3b0'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:32.191104 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-9d146308-ccd2-423f-bb61-208fe559295b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd118bb5d5604430880a518da7cd1e3b0'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:32.197364 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1445/2893] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:32 2022] DELETE /identity/v3/users/d118bb5d5604430880a518da7cd1e3b0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:32.202022 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cdbee-7802-4b2b-a700-d4b65ae7c9be None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:32.202487 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cdbee-7802-4b2b-a700-d4b65ae7c9be None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:32.202611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cdbee-7802-4b2b-a700-d4b65ae7c9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:32.222847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-eb4cdbee-7802-4b2b-a700-d4b65ae7c9be None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:32.224071 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-eb4cdbee-7802-4b2b-a700-d4b65ae7c9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:32.285522 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1449/2894] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:32.298717 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d146308-ccd2-423f-bb61-208fe559295b admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:32.300501 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-9d146308-ccd2-423f-bb61-208fe559295b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:32.366695 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d146308-ccd2-423f-bb61-208fe559295b admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:32.371498 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cf650-39f7-4b0a-9706-31a2689c822f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:32.372127 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cf650-39f7-4b0a-9706-31a2689c822f service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:32.372409 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cf650-39f7-4b0a-9706-31a2689c822f service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:32.372664 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cf650-39f7-4b0a-9706-31a2689c822f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:32.382286 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cf650-39f7-4b0a-9706-31a2689c822f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:32.383733 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cf650-39f7-4b0a-9706-31a2689c822f service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:32.393443 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1446/2895] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:32.704980 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4cdbee-7802-4b2b-a700-d4b65ae7c9be None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:32.706519 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-eb4cdbee-7802-4b2b-a700-d4b65ae7c9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:32.719157 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4cdbee-7802-4b2b-a700-d4b65ae7c9be None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:32.724847 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae0aef-56c4-4ef0-a80e-059cde72db77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:32.725556 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae0aef-56c4-4ef0-a80e-059cde72db77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:32.725834 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae0aef-56c4-4ef0-a80e-059cde72db77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:32.726111 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae0aef-56c4-4ef0-a80e-059cde72db77 admin admin] PATH_INFO: `/v3/projects/d6766784e33b44a68a6811ac8226f306` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:32.727290 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae0aef-56c4-4ef0-a80e-059cde72db77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6766784e33b44a68a6811ac8226f306)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:32.729261 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae0aef-56c4-4ef0-a80e-059cde72db77 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:32.780040 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4fae0aef-56c4-4ef0-a80e-059cde72db77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6766784e33b44a68a6811ac8226f306', 'request_id': 'req-4fae0aef-56c4-4ef0-a80e-059cde72db77'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:32.786481 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4fae0aef-56c4-4ef0-a80e-059cde72db77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6766784e33b44a68a6811ac8226f306', 'request_id': 'req-4fae0aef-56c4-4ef0-a80e-059cde72db77'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:32.795728 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4fae0aef-56c4-4ef0-a80e-059cde72db77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6766784e33b44a68a6811ac8226f306', 'request_id': 'req-4fae0aef-56c4-4ef0-a80e-059cde72db77'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:32.806119 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4fae0aef-56c4-4ef0-a80e-059cde72db77 admin admin] The token cache is being invalidate because project d6766784e33b44a68a6811ac8226f306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:32.806401 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4fae0aef-56c4-4ef0-a80e-059cde72db77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:32.807055 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4fae0aef-56c4-4ef0-a80e-059cde72db77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:32.808682 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1450/2896] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:32 2022] DELETE /identity/v3/projects/d6766784e33b44a68a6811ac8226f306 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:32.814872 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36568c-d372-4b89-a028-00f62efd7e16 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:32.815142 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36568c-d372-4b89-a028-00f62efd7e16 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:32.815416 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36568c-d372-4b89-a028-00f62efd7e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:32.835089 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-ea36568c-d372-4b89-a028-00f62efd7e16 None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:32.836287 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-ea36568c-d372-4b89-a028-00f62efd7e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:32.853212 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:32.915916 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1447/2897] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:32.925227 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb18f4-df12-4a59-82d6-ea74d1e43d4f None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:32.925560 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb18f4-df12-4a59-82d6-ea74d1e43d4f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:32.926512 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb18f4-df12-4a59-82d6-ea74d1e43d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:32.947606 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-49eb18f4-df12-4a59-82d6-ea74d1e43d4f None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:32.948865 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-49eb18f4-df12-4a59-82d6-ea74d1e43d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:32.959094 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1451/2898] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:32.963879 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36568c-d372-4b89-a028-00f62efd7e16 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:32.974886 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36568c-d372-4b89-a028-00f62efd7e16 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:32.981249 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88323949-08d8-4288-b93c-16e9994866a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:32.981858 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88323949-08d8-4288-b93c-16e9994866a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:32.982135 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88323949-08d8-4288-b93c-16e9994866a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:32.982404 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88323949-08d8-4288-b93c-16e9994866a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:32.983121 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88323949-08d8-4288-b93c-16e9994866a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:06:32.983751 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88323949-08d8-4288-b93c-16e9994866a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:32.985396 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88323949-08d8-4288-b93c-16e9994866a5 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:32.998026 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1448/2899] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Jul 28 18:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:06:33.002769 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb18f4-df12-4a59-82d6-ea74d1e43d4f None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:33.012648 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb18f4-df12-4a59-82d6-ea74d1e43d4f None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:33.018059 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788db6f6-6bf1-4c32-8a88-3ec296260ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:33.018723 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788db6f6-6bf1-4c32-8a88-3ec296260ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:33.019018 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788db6f6-6bf1-4c32-8a88-3ec296260ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:33.019309 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788db6f6-6bf1-4c32-8a88-3ec296260ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:33.020201 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788db6f6-6bf1-4c32-8a88-3ec296260ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:33.022587 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788db6f6-6bf1-4c32-8a88-3ec296260ce5 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:33.053248 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1452/2900] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Jul 28 18:06:33 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:06:33.057596 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88323949-08d8-4288-b93c-16e9994866a5 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:33.067922 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88323949-08d8-4288-b93c-16e9994866a5 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:33.134091 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154b69d-739e-4b95-be61-3fe196a25d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:33.134727 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154b69d-739e-4b95-be61-3fe196a25d55 admin admin] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:33.134986 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154b69d-739e-4b95-be61-3fe196a25d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:33.135261 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154b69d-739e-4b95-be61-3fe196a25d55 admin admin] PATH_INFO: `/v3/users` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:33.135935 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154b69d-739e-4b95-be61-3fe196a25d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:33.137966 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154b69d-739e-4b95-be61-3fe196a25d55 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:33.166492 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1449/2901] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Jul 28 18:06:33 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:06:33.168404 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788db6f6-6bf1-4c32-8a88-3ec296260ce5 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:33.179864 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788db6f6-6bf1-4c32-8a88-3ec296260ce5 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:33.184866 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd8eb0-6603-445e-b964-9fa68f947519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:33.185515 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd8eb0-6603-445e-b964-9fa68f947519 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:33.185802 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd8eb0-6603-445e-b964-9fa68f947519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:33.186081 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd8eb0-6603-445e-b964-9fa68f947519 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:33.186780 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd8eb0-6603-445e-b964-9fa68f947519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:33.188441 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd8eb0-6603-445e-b964-9fa68f947519 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:33.198611 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1453/2902] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:33.204153 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154b69d-739e-4b95-be61-3fe196a25d55 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:33.218666 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154b69d-739e-4b95-be61-3fe196a25d55 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:33.224461 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22818beb-e634-4775-81eb-e7a6ba13d7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:33.225186 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22818beb-e634-4775-81eb-e7a6ba13d7df admin admin] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:33.225464 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22818beb-e634-4775-81eb-e7a6ba13d7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:33.225737 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22818beb-e634-4775-81eb-e7a6ba13d7df admin admin] PATH_INFO: `/v3/roles` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:33.226688 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22818beb-e634-4775-81eb-e7a6ba13d7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:33.228459 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22818beb-e634-4775-81eb-e7a6ba13d7df admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:33.240579 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1450/2903] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Jul 28 18:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:06:33.246371 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd8eb0-6603-445e-b964-9fa68f947519 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:33.258083 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd8eb0-6603-445e-b964-9fa68f947519 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:33.263660 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4bcc7-7e58-4cee-8c6f-876d4519aa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:33.264340 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4bcc7-7e58-4cee-8c6f-876d4519aa48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:33.264616 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4bcc7-7e58-4cee-8c6f-876d4519aa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:33.264889 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4bcc7-7e58-4cee-8c6f-876d4519aa48 admin admin] PATH_INFO: `/v3/projects/1e1b0307a0094bc1bef8f477cf465313/users/b6963c0dca5c4325907aac1febf2325c/roles/1e9bc5b431414d62a974beb13a8f83c7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:33.282826 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4bcc7-7e58-4cee-8c6f-876d4519aa48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1b0307a0094bc1bef8f477cf465313, user_id=b6963c0dca5c4325907aac1febf2325c, role_id=1e9bc5b431414d62a974beb13a8f83c7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:33.285801 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4bcc7-7e58-4cee-8c6f-876d4519aa48 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:33.302794 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1454/2904] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Jul 28 18:06:33 2022] PUT /identity/v3/projects/1e1b0307a0094bc1bef8f477cf465313/users/b6963c0dca5c4325907aac1febf2325c/roles/1e9bc5b431414d62a974beb13a8f83c7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:33.317091 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cc751-b72a-442f-a2cd-6b07e92fc828 None None] REQUEST_METHOD: `POST` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:33.317371 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cc751-b72a-442f-a2cd-6b07e92fc828 None None] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:33.317649 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cc751-b72a-442f-a2cd-6b07e92fc828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:33.350063 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.auth.core [None req-bd8cc751-b72a-442f-a2cd-6b07e92fc828 None None] MFA Rules not processed for user `b6963c0dca5c4325907aac1febf2325c`. Rule list: `[]` (Enabled: `True`). {{(pid=80309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:33.351321 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-bd8cc751-b72a-442f-a2cd-6b07e92fc828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:33.437493 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1451/2905] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:06:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:33.449380 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4bcc7-7e58-4cee-8c6f-876d4519aa48 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:33.452126 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f6d4bcc7-7e58-4cee-8c6f-876d4519aa48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:33.481209 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:33.521971 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4bcc7-7e58-4cee-8c6f-876d4519aa48 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:33.525934 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f46ba-d9b0-4852-9ffb-5539a8e20d17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6d20d753e37498e8664f983b0988e3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:33.526588 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f46ba-d9b0-4852-9ffb-5539a8e20d17 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:33.526887 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f46ba-d9b0-4852-9ffb-5539a8e20d17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:33.527171 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f46ba-d9b0-4852-9ffb-5539a8e20d17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:33.536532 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f46ba-d9b0-4852-9ffb-5539a8e20d17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:33.538029 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f46ba-d9b0-4852-9ffb-5539a8e20d17 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:33.547421 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1455/2906] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:43.432886 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:43.543296 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=17 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:43.934243 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cc751-b72a-442f-a2cd-6b07e92fc828 None None] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:44.006599 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cc751-b72a-442f-a2cd-6b07e92fc828 None None] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:44.012410 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42719ef-49c3-4411-8049-2b8ffa7e9313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:44.013094 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42719ef-49c3-4411-8049-2b8ffa7e9313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:44.013383 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42719ef-49c3-4411-8049-2b8ffa7e9313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:44.013657 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42719ef-49c3-4411-8049-2b8ffa7e9313 admin admin] PATH_INFO: `/v3/users/b6963c0dca5c4325907aac1febf2325c` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:44.014897 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42719ef-49c3-4411-8049-2b8ffa7e9313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6963c0dca5c4325907aac1febf2325c)` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:44.016846 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42719ef-49c3-4411-8049-2b8ffa7e9313 admin admin] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:44.069930 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a42719ef-49c3-4411-8049-2b8ffa7e9313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6963c0dca5c4325907aac1febf2325c'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:44.082461 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a42719ef-49c3-4411-8049-2b8ffa7e9313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6963c0dca5c4325907aac1febf2325c'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:44.091294 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a42719ef-49c3-4411-8049-2b8ffa7e9313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6963c0dca5c4325907aac1febf2325c'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:44.098376 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a42719ef-49c3-4411-8049-2b8ffa7e9313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6963c0dca5c4325907aac1febf2325c'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:44.098992 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.notifications [None req-a42719ef-49c3-4411-8049-2b8ffa7e9313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6963c0dca5c4325907aac1febf2325c'} {{(pid=80309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:44.106972 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1452/2907] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Jul 28 18:06:43 2022] DELETE /identity/v3/users/b6963c0dca5c4325907aac1febf2325c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:44.112078 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597fe76-c337-43ce-b3a4-0e815231ddbc None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:44.112370 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597fe76-c337-43ce-b3a4-0e815231ddbc None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:44.112656 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597fe76-c337-43ce-b3a4-0e815231ddbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:44.133005 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-1597fe76-c337-43ce-b3a4-0e815231ddbc None None] MFA Rules not processed for user `139abd87c3e347d299314e22a7c95f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:44.134403 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1597fe76-c337-43ce-b3a4-0e815231ddbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:44.196019 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1456/2908] 10.222.0.96 () {58 vars in 958 bytes} [Thu Jul 28 18:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:44.208290 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42719ef-49c3-4411-8049-2b8ffa7e9313 admin admin] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:44.210505 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-a42719ef-49c3-4411-8049-2b8ffa7e9313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:44.273435 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42719ef-49c3-4411-8049-2b8ffa7e9313 admin admin] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:44.277463 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776e968-2f1f-4463-9ad2-097018d2b57a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76add49d4be940ad846d32fa16431988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:44.278080 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776e968-2f1f-4463-9ad2-097018d2b57a service neutron] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:44.278350 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776e968-2f1f-4463-9ad2-097018d2b57a service neutron] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:44.278618 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776e968-2f1f-4463-9ad2-097018d2b57a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:44.287626 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776e968-2f1f-4463-9ad2-097018d2b57a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:44.289210 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776e968-2f1f-4463-9ad2-097018d2b57a service neutron] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:44.298679 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1453/2909] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:44.587099 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597fe76-c337-43ce-b3a4-0e815231ddbc None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:44.588727 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1597fe76-c337-43ce-b3a4-0e815231ddbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:44.601384 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597fe76-c337-43ce-b3a4-0e815231ddbc None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:44.606748 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e76e0-fe99-485e-bd40-34b039ddc9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139abd87c3e347d299314e22a7c95f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ce091dd3714924a52d3b36bdfb30f4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:44.607456 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e76e0-fe99-485e-bd40-34b039ddc9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:44.607733 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e76e0-fe99-485e-bd40-34b039ddc9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:44.608002 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e76e0-fe99-485e-bd40-34b039ddc9d3 admin admin] PATH_INFO: `/v3/projects/1e1b0307a0094bc1bef8f477cf465313` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:44.609562 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e76e0-fe99-485e-bd40-34b039ddc9d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e1b0307a0094bc1bef8f477cf465313)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:44.611533 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e76e0-fe99-485e-bd40-34b039ddc9d3 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:44.663620 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-373e76e0-fe99-485e-bd40-34b039ddc9d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1b0307a0094bc1bef8f477cf465313', 'request_id': 'req-373e76e0-fe99-485e-bd40-34b039ddc9d3'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:44.670303 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-373e76e0-fe99-485e-bd40-34b039ddc9d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1b0307a0094bc1bef8f477cf465313', 'request_id': 'req-373e76e0-fe99-485e-bd40-34b039ddc9d3'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:44.680345 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-373e76e0-fe99-485e-bd40-34b039ddc9d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1b0307a0094bc1bef8f477cf465313', 'request_id': 'req-373e76e0-fe99-485e-bd40-34b039ddc9d3'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:44.690986 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-373e76e0-fe99-485e-bd40-34b039ddc9d3 admin admin] The token cache is being invalidate because project 1e1b0307a0094bc1bef8f477cf465313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:06:44.691268 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-373e76e0-fe99-485e-bd40-34b039ddc9d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:44.691890 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-373e76e0-fe99-485e-bd40-34b039ddc9d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:06:44.693451 dv-cinder-813229-13-smb devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1457/2910] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Jul 28 18:06:44 2022] DELETE /identity/v3/projects/1e1b0307a0094bc1bef8f477cf465313 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:06:54.294931 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:54.688141 dv-cinder-813229-13-smb devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:37.824102 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776e968-2f1f-4463-9ad2-097018d2b57a service neutron] Authenticating user token {{(pid=80309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:37.826322 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-6776e968-2f1f-4463-9ad2-097018d2b57a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:37.906201 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776e968-2f1f-4463-9ad2-097018d2b57a service neutron] Validating token access rules against request {{(pid=80309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:37.973742 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd7387-1b57-4f56-9b0e-f7d439bc1555 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38257735924d44488e1407fefb886324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5ce5e789e949d09c183dbe04e53f19', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:37.974356 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd7387-1b57-4f56-9b0e-f7d439bc1555 service placement] REQUEST_METHOD: `GET` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:37.974635 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd7387-1b57-4f56-9b0e-f7d439bc1555 service placement] SCRIPT_NAME: `/identity` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:37.974909 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd7387-1b57-4f56-9b0e-f7d439bc1555 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:37.976860 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.fernet_utils [None req-f1dd7387-1b57-4f56-9b0e-f7d439bc1555 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:37.988975 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd7387-1b57-4f56-9b0e-f7d439bc1555 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:37.990609 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd7387-1b57-4f56-9b0e-f7d439bc1555 service placement] RBAC: Authorization granted {{(pid=80309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:38.000504 dv-cinder-813229-13-smb devstack@keystone.service[80309]: [pid: 80309|app: 0|req: 1454/2911] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:47.996532 dv-cinder-813229-13-smb devstack@keystone.service[80309]: DEBUG dbcounter [-] [80309] Writing DB stats keystone:SELECT=58 {{(pid=80309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}